[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[OSSTEST PATCH 00/82] Reuse test hosts

To: xen-devel@xxxxxxxxxxxxxxxxxxxx
From: Ian Jackson <iwj@xxxxxxxxxxxxxx>
Date: Wed, 7 Oct 2020 18:59:02 +0100
Cc: Ian Jackson <iwj@xxxxxxxxxxxxxx>
Delivery-date: Wed, 07 Oct 2020 18:00:47 +0000
List-id: Xen developer discussion <xen-devel.lists.xenproject.org>

This series arranges to save on host setup by reusing a test host, if
the previous test passed.  Care is taken to make sure that a host is
only reused in this way if the new test would have set it up
identically.

I have had this branch in preparation since November 2017...

-- 
2.20.1

Follow-Ups:
- [OSSTEST PATCH 52/82] host allocation: Group jobs by their reuse parameters
  - From: Ian Jackson
- [OSSTEST PATCH 35/82] resource reporting: Print username when listing "rogue tasks"
  - From: Ian Jackson
- [OSSTEST PATCH 23/82] db_retry: Make the sleeps random and increasing
  - From: Ian Jackson
- [OSSTEST PATCH 62/82] runvar access: Introduce effects_gone_before_share_reuse
  - From: Ian Jackson
- [OSSTEST PATCH 19/82] host allocation: Executive: Honour $xparams{InfraPriority}
  - From: Ian Jackson
- [OSSTEST PATCH 33/82] plan search: Move $share_compat_ok further up the file
  - From: Ian Jackson
- [OSSTEST PATCH 32/82] plan_search: Use plan's Wear information rather than tracking it ourselves
  - From: Ian Jackson
- [OSSTEST PATCH 64/82] hsot reuse: Hash the share type
  - From: Ian Jackson
- [OSSTEST PATCH 71/82] resource reporting, nfc: split a here document
  - From: Ian Jackson
- [OSSTEST PATCH 15/82] target setup refactoring: Add a doc comment
  - From: Ian Jackson
- [OSSTEST PATCH 49/82] host reuse: sg-run-job: per-host prep: Use @ for per-host-ts
  - From: Ian Jackson
- [OSSTEST PATCH 37/82] ts-hosts-allocate-Executive: Better message for hosts abandoned mid-test
  - From: Ian Jackson
- [OSSTEST PATCH 76/82] sg-report-flight: Reformat slightly
  - From: Ian Jackson
- [OSSTEST PATCH 70/82] sg-report-flight: Refactor runvar access
  - From: Ian Jackson
- [OSSTEST PATCH 16/82] abolish "kernkind"; desupport non-pvops kernels
  - From: Ian Jackson
- [OSSTEST PATCH 44/82] sg-run-job: New @ iffail tag for prep tasks
  - From: Ian Jackson
- [OSSTEST PATCH 45/82] sg-run-job: Detect improper use of @ iffail with run-ts
  - From: Ian Jackson
- [OSSTEST PATCH 81/82] sg-report-flight: Sharing reports: more task finished info
  - From: Ian Jackson
- [OSSTEST PATCH 77/82] sg-report-flight: Improvements to other job (share/reuse) reporting
  - From: Ian Jackson
- [OSSTEST PATCH 60/82] runvar access: Use runvar_glob for dmrestrict runvar search
  - From: Ian Jackson
- [OSSTEST PATCH 40/82] ts-host-reuse: Do not depend on bios
  - From: Ian Jackson
- [OSSTEST PATCH 25/82] host allocation: *_shared_mark_ready: Make $sharetype check optional
  - From: Ian Jackson
- [OSSTEST PATCH 34/82] plan_search: Track last sharing state to determine $share_reuse
  - From: Ian Jackson
- [OSSTEST PATCH 67/82] host lifecycle: Fix detection of concurrent jobs
  - From: Ian Jackson
- [OSSTEST PATCH 27/82] host allocation: *_shared_mark_ready: allow alternative $oldtypes
  - From: Ian Jackson
- [OSSTEST PATCH 74/82] host reuse: ts-host-reuse: Prepare for argument handling
  - From: Ian Jackson
- [OSSTEST PATCH 61/82] runvar access: Introduce sharing_for_build
  - From: Ian Jackson
- [OSSTEST PATCH 63/82] test host reuse: Switch to principled sharing scope runvar scheme
  - From: Ian Jackson
- [OSSTEST PATCH 38/82] ts-host-reuse: New script, to do reuse state changes
  - From: Ian Jackson
- [OSSTEST PATCH 78/82] flight other job reporting: Put nulls last in the report
  - From: Ian Jackson
- [OSSTEST PATCH 24/82] host allocation: *_shared_mark_ready: Allow other states
  - From: Ian Jackson
- [OSSTEST PATCH 73/82] host reuse: sg-run-job: Reanme post-test-ok parameter
  - From: Ian Jackson
- [OSSTEST PATCH 10/82] hsot reuse: ms-planner: Abbreviate reporting of test shares
  - From: Ian Jackson
- [OSSTEST PATCH 75/82] host reuse: New protocol between sg-run-job and ts-host-reuse
  - From: Ian Jackson
- [OSSTEST PATCH 43/82] ts-hosts-allocate-Executive print sharing info in debug output
  - From: Ian Jackson
- [OSSTEST PATCH 50/82] shared/reuse: Rely on @ for ts-host-ping-check
  - From: Ian Jackson
- [OSSTEST PATCH 20/82] ts-hosts-allocate-Executive: Fix handling of failed preps for same sharing
  - From: Ian Jackson
- [OSSTEST PATCH 39/82] ts-host-reuse: tolerate unremoveable lv
  - From: Ian Jackson
- [OSSTEST PATCH 48/82] shared/reuse: Use @ for freebsd host prep
  - From: Ian Jackson
- [OSSTEST PATCH 82/82] sg-report-flight: Word-wrapping improvements to job and step names
  - From: Ian Jackson
- [OSSTEST PATCH 36/82] resource reporting, nfc: Break out report_rogue_task_description
  - From: Ian Jackson
- [OSSTEST PATCH 18/82] host allocation: Remove some unnecessary definedness tests
  - From: Ian Jackson
- [OSSTEST PATCH 51/82] host reuse: Reuse test hosts within a flight
  - From: Ian Jackson
- [OSSTEST PATCH 41/82] ts-host-reuse: Add some missing runvars to the host sharing control
  - From: Ian Jackson
- [OSSTEST PATCH 30/82] plan_search: Break out $share_compat_ok
  - From: Ian Jackson
- [OSSTEST PATCH 21/82] sg-run-job: support +! for *only* adding things to TESTID
  - From: Ian Jackson
- [OSSTEST PATCH 29/82] host allocation: *_shared_mark_ready: Only prod when $newstate is ready
  - From: Ian Jackson
- [OSSTEST PATCH 31/82] plan_search: Improve debugging of $share_compat_ok->()
  - From: Ian Jackson
- [OSSTEST PATCH 68/82] host lifecycle: Prevent referential integrity violation
  - From: Ian Jackson
- [OSSTEST PATCH 56/82] subst_netboot_template: Do not use all of %r
  - From: Ian Jackson
- [OSSTEST PATCH 17/82] Debian: osstest-erase-other-disks: Slightly guard against races
  - From: Ian Jackson
- [OSSTEST PATCH 80/82] tsreadconfig: Change misleading "setting" message
  - From: Ian Jackson
- [OSSTEST PATCH 53/82] host reuse: Jiggle the infra-priority a bit, within a flight
  - From: Ian Jackson
- [OSSTEST PATCH 79/82] flight other job reporting: Further improvements to ordering
  - From: Ian Jackson
- [OSSTEST PATCH 22/82] sg-run-job: Use +! in per-host-ts implementation
  - From: Ian Jackson
- [OSSTEST PATCH 11/82] cr-publish-flight-logs: Fix abs_time calls
  - From: Ian Jackson
- [OSSTEST PATCH 59/82] runvar access: Provide runvar_glob
  - From: Ian Jackson
- Re: [OSSTEST PATCH 00/82] Reuse test hosts
  - From: Ian Jackson
- [OSSTEST PATCH 13/82] target setup refactoring: Move target_kernkind_console_inittab
  - From: Ian Jackson
- [OSSTEST PATCH 69/82] host lifecycle: Record lifecycle in db and runvar
  - From: Ian Jackson
- [OSSTEST PATCH 54/82] host reuse: Use literal for the hosts_infraprioritygroup runvar
  - From: Ian Jackson
- [OSSTEST PATCH 42/82] host allocation: selecthost(): Support @IDENT for reuse
  - From: Ian Jackson
- [OSSTEST PATCH 55/82] host reuse: Bump host share reuse bonus
  - From: Ian Jackson
- [OSSTEST PATCH 58/82] runvar access: Introduce access control machinery
  - From: Ian Jackson
- [OSSTEST PATCH 47/82] shared/reuse: Use @ for ts-host-install
  - From: Ian Jackson
- [OSSTEST PATCH 72/82] resource reporting: Report host reuse/sharing in job report
  - From: Ian Jackson
- [OSSTEST PATCH 26/82] host allocation: selecthost: allow sort-of-selection of prospective hosts
  - From: Ian Jackson
- [OSSTEST PATCH 12/82] target setup refactoring: Move target_kernkind_check
  - From: Ian Jackson
- [OSSTEST PATCH 65/82] hsot reuse: Make share type hash more easily greppable
  - From: Ian Jackson
- [OSSTEST PATCH 46/82] shared/reuse: Use @ for ts-xen-build-prep
  - From: Ian Jackson
- [OSSTEST PATCH 14/82] target setup refactoring: Merge target_kernkind_*
  - From: Ian Jackson
- [OSSTEST PATCH 28/82] host allocation: Support new reuse-* magic hostflag
  - From: Ian Jackson
- [OSSTEST PATCH 57/82] TestSupport: Provide runvar_is_synth
  - From: Ian Jackson
- [OSSTEST PATCH 66/82] host lifecycle: Machinery, db, for tracking relevant events
  - From: Ian Jackson
- [OSSTEST PATCH 09/82] host reuse: ms-planner: Do not show reuse as shared in the plan
  - From: Ian Jackson
- [OSSTEST PATCH 08/82] host reuse: ms-planner: Bring some variables forward
  - From: Ian Jackson
- [OSSTEST PATCH 07/82] ts-hosts-allocate-Executive: Add a comment about a warning
  - From: Ian Jackson
- [OSSTEST PATCH 06/82] show_abs_time: Represent undef $timet as <undef>
  - From: Ian Jackson
- [OSSTEST PATCH 05/82] sg-run-job: Improve some internal API docs
  - From: Ian Jackson
- [OSSTEST PATCH 04/82] sg-run-job: Minor whitespace (formatting) changes
  - From: Ian Jackson
- [OSSTEST PATCH 03/82] README.planner: Document magic job hostflags
  - From: Ian Jackson
- [OSSTEST PATCH 02/82] Executive.pm planner: fix typo
  - From: Ian Jackson
- [OSSTEST PATCH 01/82] ms-queuedaemon: Update for newer Tcl's socket channel ids
  - From: Ian Jackson

Prev by Date: [xen-unstable test] 155510: tolerable FAIL - PUSHED
Next by Date: [OSSTEST PATCH 01/82] ms-queuedaemon: Update for newer Tcl's socket channel ids
Previous by thread: [xen-unstable test] 155510: tolerable FAIL - PUSHED
Next by thread: [OSSTEST PATCH 01/82] ms-queuedaemon: Update for newer Tcl's socket channel ids
Index(es):
- Date
- Thread

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.