[xen-unstable-smoke bisection] 162438: testing test-amd64-amd64-libvirt

[osstest service owner <osstest-admin@xxxxxxxxxxxxxx>]

branch xen-unstable-smoke
xenbranch xen-unstable-smoke
job test-amd64-amd64-libvirt
testid guest-saverestore

Tree: libvirt git://xenbits.xen.org/libvirt.git
Tree: libvirt_keycodemapdb https://gitlab.com/keycodemap/keycodemapdb.git
Tree: linux git://xenbits.xen.org/linux-pvops.git
Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git

For bisection revision-tuple graph see:
   
http://logs.test-lab.xenproject.org/osstest/results/bisect/xen-unstable-smoke/test-amd64-amd64-libvirt.guest-saverestore.html
Revision IDs in each graph node refer, respectively, to the Trees above.

----------------------------------------
Running cs-bisection-step 
--graph-out=/home/logs/results/bisect/xen-unstable-smoke/test-amd64-amd64-libvirt.guest-saverestore
 --summary-out=tmp/162438.bisection-summary --basis-template=162327 
--blessings=real,real-bisect,real-retry --flight=162438 xen-unstable-smoke 
test-amd64-amd64-libvirt guest-saverestore
Searching for failure / basis pass:
 162432 fail [host=pinot0] / 162327 [host=chardonnay1] 162275 [host=elbling1] 
162245 [host=chardonnay0] 162239 [host=elbling0] 162232 [host=fiano1] 162171 
[host=elbling1] 162161 [host=elbling0] 162151 [host=godello0] 162149 
[host=chardonnay0] 162096 [host=pinot1] 162093 [host=huxelrebe1] 162089 
[host=elbling1] 162087 [host=godello0] 162083 [host=huxelrebe1] 162079 
[host=godello1] 162075 [host=albana1] 162072 [host=chardonnay1] 162067 
[host=chardonnay1] 162065 ok.
Failure / basis pass flights: 162432 / 162065
(tree with no url: minios)
(tree with no url: ovmf)
(tree with no url: seabios)
Tree: libvirt git://xenbits.xen.org/libvirt.git
Tree: libvirt_keycodemapdb https://gitlab.com/keycodemap/keycodemapdb.git
Tree: linux git://xenbits.xen.org/linux-pvops.git
Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: xen git://xenbits.xen.org/xen.git
Latest 2c846fa6bcc11929c9fb857a22430fb9945654ad 
27acf0ef828bf719b2053ba398b195829413dbdd 
c3038e718a19fc596f7b1baba0f83d5146dc7784 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
3d273dd05e51e5a1ffba3d98c7437ee84e8f8764 
7ea428895af2840d85c524f0bd11a38aac308308 
75f13e9b221e2c8603f15ee1d53318526cf56113
Basis pass 2c846fa6bcc11929c9fb857a22430fb9945654ad 
27acf0ef828bf719b2053ba398b195829413dbdd 
c3038e718a19fc596f7b1baba0f83d5146dc7784 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
3d273dd05e51e5a1ffba3d98c7437ee84e8f8764 
7ea428895af2840d85c524f0bd11a38aac308308 
01d84420fb4a9be2ec474a7c1910bb22c28b53c8
Generating revisions with ./adhoc-revtuple-generator  
git://xenbits.xen.org/libvirt.git#2c846fa6bcc11929c9fb857a22430fb9945654ad-2c846fa6bcc11929c9fb857a22430fb9945654ad
 
https://gitlab.com/keycodemap/keycodemapdb.git#27acf0ef828bf719b2053ba398b195829413dbdd-27acf0ef828bf719b2053ba398b195829413dbdd
 
git://xenbits.xen.org/linux-pvops.git#c3038e718a19fc596f7b1baba0f83d5146dc7784-c3038e718a19fc596f7b1baba0f83d5146dc7784
 
git://xenbits.xen.org/osstest/linux-firmware.git#c530a75c1e6a472b0eb9558310b518f0\
 dfcd8860-c530a75c1e6a472b0eb9558310b518f0dfcd8860 
git://xenbits.xen.org/qemu-xen-traditional.git#3d273dd05e51e5a1ffba3d98c7437ee84e8f8764-3d273dd05e51e5a1ffba3d98c7437ee84e8f8764
 
git://xenbits.xen.org/qemu-xen.git#7ea428895af2840d85c524f0bd11a38aac308308-7ea428895af2840d85c524f0bd11a38aac308308
 
git://xenbits.xen.org/xen.git#01d84420fb4a9be2ec474a7c1910bb22c28b53c8-75f13e9b221e2c8603f15ee1d53318526cf56113
Loaded 5001 nodes in revision graph
Searching for test results:
 162036 [host=pinot1]
 162055 [host=chardonnay0]
 162062 [host=chardonnay1]
 162065 pass 2c846fa6bcc11929c9fb857a22430fb9945654ad 
27acf0ef828bf719b2053ba398b195829413dbdd 
c3038e718a19fc596f7b1baba0f83d5146dc7784 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
3d273dd05e51e5a1ffba3d98c7437ee84e8f8764 
7ea428895af2840d85c524f0bd11a38aac308308 
01d84420fb4a9be2ec474a7c1910bb22c28b53c8
 162067 [host=chardonnay1]
 162072 [host=chardonnay1]
 162075 [host=albana1]
 162079 [host=godello1]
 162083 [host=huxelrebe1]
 162087 [host=godello0]
 162089 [host=elbling1]
 162093 [host=huxelrebe1]
 162096 [host=pinot1]
 162149 [host=chardonnay0]
 162151 [host=godello0]
 162161 [host=elbling0]
 162171 [host=elbling1]
 162232 [host=fiano1]
 162239 [host=elbling0]
 162245 [host=chardonnay0]
 162275 [host=elbling1]
 162327 [host=chardonnay1]
 162370 [host=huxelrebe0]
 162373 [host=huxelrebe0]
 162375 [host=huxelrebe0]
 162374 [host=godello1]
 162376 [host=huxelrebe0]
 162380 [host=godello1]
 162382 [host=godello1]
 162381 fail 2c846fa6bcc11929c9fb857a22430fb9945654ad 
27acf0ef828bf719b2053ba398b195829413dbdd 
c3038e718a19fc596f7b1baba0f83d5146dc7784 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
3d273dd05e51e5a1ffba3d98c7437ee84e8f8764 
7ea428895af2840d85c524f0bd11a38aac308308 
75f13e9b221e2c8603f15ee1d53318526cf56113
 162383 [host=godello1]
 162387 pass 2c846fa6bcc11929c9fb857a22430fb9945654ad 
27acf0ef828bf719b2053ba398b195829413dbdd 
c3038e718a19fc596f7b1baba0f83d5146dc7784 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
3d273dd05e51e5a1ffba3d98c7437ee84e8f8764 
7ea428895af2840d85c524f0bd11a38aac308308 
01d84420fb4a9be2ec474a7c1910bb22c28b53c8
 162389 fail 2c846fa6bcc11929c9fb857a22430fb9945654ad 
27acf0ef828bf719b2053ba398b195829413dbdd 
c3038e718a19fc596f7b1baba0f83d5146dc7784 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
3d273dd05e51e5a1ffba3d98c7437ee84e8f8764 
7ea428895af2840d85c524f0bd11a38aac308308 
75f13e9b221e2c8603f15ee1d53318526cf56113
 162391 pass 2c846fa6bcc11929c9fb857a22430fb9945654ad 
27acf0ef828bf719b2053ba398b195829413dbdd 
c3038e718a19fc596f7b1baba0f83d5146dc7784 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
3d273dd05e51e5a1ffba3d98c7437ee84e8f8764 
7ea428895af2840d85c524f0bd11a38aac308308 
3670abcaf0324f2aedba0c4dc7939072b27efa1d
 162388 [host=elbling0]
 162392 pass 2c846fa6bcc11929c9fb857a22430fb9945654ad 
27acf0ef828bf719b2053ba398b195829413dbdd 
c3038e718a19fc596f7b1baba0f83d5146dc7784 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
3d273dd05e51e5a1ffba3d98c7437ee84e8f8764 
7ea428895af2840d85c524f0bd11a38aac308308 
57f68dfd2d111a2ad381df740543c901b41f2299
 162394 [host=elbling0]
 162395 [host=huxelrebe1]
 162399 [host=huxelrebe1]
 162397 [host=elbling0]
 162401 [host=huxelrebe1]
 162402 [host=huxelrebe1]
 162400 [host=godello1]
 162403 [host=huxelrebe1]
 162406 [host=godello1]
 162408 [host=godello1]
 162407 [host=fiano1]
 162410 [host=godello1]
 162412 [host=fiano1]
 162413 [host=fiano1]
 162411 [host=chardonnay1]
 162414 [host=fiano1]
 162416 [host=chardonnay1]
 162418 [host=chardonnay1]
 162419 [host=chardonnay1]
 162417 [host=chardonnay0]
 162421 [host=chardonnay1]
 162424 [host=chardonnay0]
 162425 [host=huxelrebe0]
 162426 [host=chardonnay0]
 162431 [host=huxelrebe0]
 162432 fail 2c846fa6bcc11929c9fb857a22430fb9945654ad 
27acf0ef828bf719b2053ba398b195829413dbdd 
c3038e718a19fc596f7b1baba0f83d5146dc7784 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
3d273dd05e51e5a1ffba3d98c7437ee84e8f8764 
7ea428895af2840d85c524f0bd11a38aac308308 
75f13e9b221e2c8603f15ee1d53318526cf56113
 162435 [host=huxelrebe0]
Searching for interesting versions
 Result found: flight 162065 (pass), for basis pass
 For basis failure, parent search stopping at 
2c846fa6bcc11929c9fb857a22430fb9945654ad 
27acf0ef828bf719b2053ba398b195829413dbdd 
c3038e718a19fc596f7b1baba0f83d5146dc7784 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
3d273dd05e51e5a1ffba3d98c7437ee84e8f8764 
7ea428895af2840d85c524f0bd11a38aac308308 
57f68dfd2d111a2ad381df740543c901b41f2299, results HASH(0x55ab83e267d0) For 
basis failure, parent search stopping at 
2c846fa6bcc11929c9fb857a22430fb9945654ad 
27acf0ef828bf719b2053ba398b195829413dbdd c3038e718a\
 19fc596f7b1baba0f83d5146dc7784 c530a75c1e6a472b0eb9558310b518f0dfcd8860 
3d273dd05e51e5a1ffba3d98c7437ee84e8f8764 
7ea428895af2840d85c524f0bd11a38aac308308 
3670abcaf0324f2aedba0c4dc7939072b27efa1d, results HASH(0x55ab83e2f598) For 
basis failure, parent search stopping at 
2c846fa6bcc11929c9fb857a22430fb9945654ad 
27acf0ef828bf719b2053ba398b195829413dbdd 
c3038e718a19fc596f7b1baba0f83d5146dc7784 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
3d273dd05e51e5a1ffba3d98c7437ee84e8f8764 7ea428895af2840d85c524f0b\
 d11a38aac308308 01d84420fb4a9be2ec474a7c1910bb22c28b53c8, results 
HASH(0x55ab83e24348) HASH(0x55ab83e28058) Result found: flight 162381 (fail), 
for basis failure (at ancestor ~480)
 Repro found: flight 162387 (pass), for basis pass
 Repro found: flight 162389 (fail), for basis failure
 7 revisions at 2c846fa6bcc11929c9fb857a22430fb9945654ad 
27acf0ef828bf719b2053ba398b195829413dbdd 
c3038e718a19fc596f7b1baba0f83d5146dc7784 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
3d273dd05e51e5a1ffba3d98c7437ee84e8f8764 
7ea428895af2840d85c524f0bd11a38aac308308 
455790573d3bbad6d5a1bb7e9d28b6dd71075693
Looking 3 below 2c846fa6bcc11929c9fb857a22430fb9945654ad 
27acf0ef828bf719b2053ba398b195829413dbdd 
c3038e718a19fc596f7b1baba0f83d5146dc7784 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
3d273dd05e51e5a1ffba3d98c7437ee84e8f8764 
7ea428895af2840d85c524f0bd11a38aac308308 
455790573d3bbad6d5a1bb7e9d28b6dd71075693.
Should test 2c846fa6bcc11929c9fb857a22430fb9945654ad 
27acf0ef828bf719b2053ba398b195829413dbdd 
c3038e718a19fc596f7b1baba0f83d5146dc7784 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
3d273dd05e51e5a1ffba3d98c7437ee84e8f8764 
7ea428895af2840d85c524f0bd11a38aac308308 
bd7a29c3d0b937ab542abea06ff1b575abe7247a.
Revision graph left in 
/home/logs/results/bisect/xen-unstable-smoke/test-amd64-amd64-libvirt.guest-saverestore.{dot,ps,png,html,svg}.
Populating 162438...
Need 162438.test-amd64-amd64-libvirt (like 162432)
Creating 162438.test-amd64-amd64-libvirt (copying from 162432)
Need 162438.build-amd64 (like 162432)
 revision_qemu=3d273dd05e51e5a1ffba3d98c7437ee84e8f8764
 revision_qemuu=7ea428895af2840d85c524f0bd11a38aac308308
 revision_xen=bd7a29c3d0b937ab542abea06ff1b575abe7247a
Searching for build-amd64 (like 162432) to reuse...
DB confict (err=7 state=40001): DBD::Pg::db selectrow_hashref failed: ERROR:  
could not serialize access due to read/write dependencies among transactions
DETAIL:  Reason code: Canceled on identification as a pivot, during conflict 
out checking.
HINT:  The transaction might succeed if retried. [for Statement "            
SELECT  *
            FROM    flights JOIN jobs j USING (flight)
            WHERE   j.job=?
            AND     j.status='pass'
            AND     (blessing='real' OR  blessing='real-bisect' OR  
blessing='real-retry')
            AND     (TRUE)
            AND     0 = ( SELECT count(*)
                          FROM
                              ( SELECT name,val
                                FROM   runvars
                                WHERE  runvars.flight = flights.flight
                                  AND  job=? AND synth='f'
                              ) o
                          FULL OUTER JOIN
                              bisection_runvars want
                          USING (name)
                          WHERE (o.val = want.val) IS NOT TRUE
                        )
            ORDER BY flights.started desc
            LIMIT 1
"]
DB conflict (messages above may refer); retrying after 0.951710261245356...
Populating 162438...
Need 162438.test-amd64-amd64-libvirt (like 162432)
Creating 162438.test-amd64-amd64-libvirt (copying from 162432)
Need 162438.build-amd64 (like 162432)
 revision_qemu=3d273dd05e51e5a1ffba3d98c7437ee84e8f8764
 revision_qemuu=7ea428895af2840d85c524f0bd11a38aac308308
 revision_xen=bd7a29c3d0b937ab542abea06ff1b575abe7247a
Searching for build-amd64 (like 162432) to reuse...
Can reuse build 162408.build-amd64.
DB confict (err=7 state=40001): DBD::Pg::st execute failed: ERROR:  could not 
serialize access due to read/write dependencies among transactions
DETAIL:  Reason code: Canceled on identification as a pivot, during write.
HINT:  The transaction might succeed if retried. [for Statement "        UPDATE 
runvars SET val=?
            WHERE  flight=? AND job=? AND name=?
" with ParamValues: 1='162408.build-amd64', 2='162438', 
3='test-amd64-amd64-libvirt', 4='buildjob']
DB conflict (messages above may refer); retrying after 0.249255363079044...
Populating 162438...
Need 162438.test-amd64-amd64-libvirt (like 162432)
Creating 162438.test-amd64-amd64-libvirt (copying from 162432)
Need 162438.build-amd64 (like 162432)
 revision_qemu=3d273dd05e51e5a1ffba3d98c7437ee84e8f8764
 revision_qemuu=7ea428895af2840d85c524f0bd11a38aac308308
 revision_xen=bd7a29c3d0b937ab542abea06ff1b575abe7247a
Can reuse build 162408.build-amd64.
Need 162438.build-amd64-pvops (like 162385)
 revision_linux=c3038e718a19fc596f7b1baba0f83d5146dc7784
 revision_linuxfirmware=c530a75c1e6a472b0eb9558310b518f0dfcd8860
Searching for build-amd64-pvops (like 162385) to reuse...
Can reuse build-kern 162427.build-amd64-pvops.
DB confict (err=7 state=40001): DBD::Pg::st execute failed: ERROR:  could not 
serialize access due to read/write dependencies among transactions
DETAIL:  Reason code: Canceled on identification as a pivot, during write.
HINT:  The transaction might succeed if retried. [for Statement "        UPDATE 
runvars SET val=?
            WHERE  flight=? AND job=? AND name=?
" with ParamValues: 1='162427.build-amd64-pvops', 2='162438', 
3='test-amd64-amd64-libvirt', 4='kernbuildjob']
DB conflict (messages above may refer); retrying after 1.25256354745799...
Populating 162438...
Need 162438.test-amd64-amd64-libvirt (like 162432)
Creating 162438.test-amd64-amd64-libvirt (copying from 162432)
Need 162438.build-amd64 (like 162432)
 revision_qemu=3d273dd05e51e5a1ffba3d98c7437ee84e8f8764
 revision_qemuu=7ea428895af2840d85c524f0bd11a38aac308308
 revision_xen=bd7a29c3d0b937ab542abea06ff1b575abe7247a
Can reuse build 162408.build-amd64.
Need 162438.build-amd64-pvops (like 162385)
 revision_linux=c3038e718a19fc596f7b1baba0f83d5146dc7784
 revision_linuxfirmware=c530a75c1e6a472b0eb9558310b518f0dfcd8860
Can reuse build-kern 162427.build-amd64-pvops.
Need 162438.build-amd64-libvirt (like 162432)
 revision_libvirt=2c846fa6bcc11929c9fb857a22430fb9945654ad
 revision_libvirt_keycodemapdb=27acf0ef828bf719b2053ba398b195829413dbdd
 revision_xen=bd7a29c3d0b937ab542abea06ff1b575abe7247a
Creating 162438.build-amd64-libvirt (copying from 162432)
Need 162438.build-amd64 (like 162432)
 revision_qemu=3d273dd05e51e5a1ffba3d98c7437ee84e8f8764
 revision_qemuu=7ea428895af2840d85c524f0bd11a38aac308308
 revision_xen=bd7a29c3d0b937ab542abea06ff1b575abe7247a
Can reuse build 162408.build-amd64.
Need 162438.build-amd64 (like 162432)
 revision_qemu=3d273dd05e51e5a1ffba3d98c7437ee84e8f8764
 revision_qemuu=7ea428895af2840d85c524f0bd11a38aac308308
 revision_xen=bd7a29c3d0b937ab542abea06ff1b575abe7247a
Can reuse build 162408.build-amd64.
Checking for flail (since 162065)...
Flight 162438 ready to go.