[linux-5.4 bisection] complete test-arm64-arm64-xl-thunderx

[osstest service owner <osstest-admin@xxxxxxxxxxxxxx>]

branch xen-unstable
xenbranch xen-unstable
job test-arm64-arm64-xl-thunderx
testid guest-start

Tree: linux 
git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git
Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
Tree: ovmf git://xenbits.xen.org/osstest/ovmf.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: seabios git://xenbits.xen.org/osstest/seabios.git
Tree: xen git://xenbits.xen.org/xen.git

*** Found and reproduced problem changeset ***

  Bug is in tree:  linux 
git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git
  Bug introduced:  a09d4e7acdbf276b2096661ee82454ae3dd24d2b
  Bug not present: acc402fa5bf502d471d50e3d495379f093a7f9e4
  Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/159412/


  commit a09d4e7acdbf276b2096661ee82454ae3dd24d2b
  Author: David Woodhouse <dwmw@xxxxxxxxxxxx>
  Date:   Wed Jan 13 13:26:02 2021 +0000
  
      xen: Fix event channel callback via INTX/GSI
      
      [ Upstream commit 3499ba8198cad47b731792e5e56b9ec2a78a83a2 ]
      
      For a while, event channel notification via the PCI platform device
      has been broken, because we attempt to communicate with xenstore before
      we even have notifications working, with the xs_reset_watches() call
      in xs_init().
      
      We tend to get away with this on Xen versions below 4.0 because we avoid
      calling xs_reset_watches() anyway, because xenstore might not cope with
      reading a non-existent key. And newer Xen *does* have the vector
      callback support, so we rarely fall back to INTX/GSI delivery.
      
      To fix it, clean up a bit of the mess of xs_init() and xenbus_probe()
      startup. Call xs_init() directly from xenbus_init() only in the !XS_HVM
      case, deferring it to be called from xenbus_probe() in the XS_HVM case
      instead.
      
      Then fix up the invocation of xenbus_probe() to happen either from its
      device_initcall if the callback is available early enough, or when the
      callback is finally set up. This means that the hack of calling
      xenbus_probe() from a workqueue after the first interrupt, or directly
      from the PCI platform device setup, is no longer needed.
      
      Signed-off-by: David Woodhouse <dwmw@xxxxxxxxxxxx>
      Reviewed-by: Boris Ostrovsky <boris.ostrovsky@xxxxxxxxxx>
      Link: 
https://lore.kernel.org/r/20210113132606.422794-2-dwmw2@xxxxxxxxxxxxx
      Signed-off-by: Juergen Gross <jgross@xxxxxxxx>
      Signed-off-by: Sasha Levin <sashal@xxxxxxxxxx>


For bisection revision-tuple graph see:
   
http://logs.test-lab.xenproject.org/osstest/results/bisect/linux-5.4/test-arm64-arm64-xl-thunderx.guest-start.html
Revision IDs in each graph node refer, respectively, to the Trees above.

----------------------------------------
Running cs-bisection-step 
--graph-out=/home/logs/results/bisect/linux-5.4/test-arm64-arm64-xl-thunderx.guest-start
 --summary-out=tmp/159412.bisection-summary --basis-template=158387 
--blessings=real,real-bisect,real-retry linux-5.4 test-arm64-arm64-xl-thunderx 
guest-start
Searching for failure / basis pass:
 159372 fail [host=rochester0] / 158681 [host=rochester1] 158624 ok.
Failure / basis pass flights: 159372 / 158624
Tree: linux 
git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git
Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
Tree: ovmf git://xenbits.xen.org/osstest/ovmf.git
Tree: qemuu git://xenbits.xen.org/qemu-xen.git
Tree: seabios git://xenbits.xen.org/osstest/seabios.git
Tree: xen git://xenbits.xen.org/xen.git
Latest 5b9a4104c902d7dec14c9e3c5652a638194487c6 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2e1e8c35f3178df95d79da81ac6deec242da74c2 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
04085ec1ac05a362812e9b0c6b5a8713d7dc88ad
Basis pass 09f983f0c7fc0db79a5f6c883ec3510d424c369c 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
96a9acfc527964dc5ab7298862a0cd8aa5fffc6a 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
452ddbe3592b141b05a7e0676f09c8ae07f98fdd
Generating revisions with ./adhoc-revtuple-generator  
git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git#09f983f0c7fc0db79a5f6c883ec3510d424c369c-5b9a4104c902d7dec14c9e3c5652a638194487c6
 
git://xenbits.xen.org/osstest/linux-firmware.git#c530a75c1e6a472b0eb9558310b518f0dfcd8860-c530a75c1e6a472b0eb9558310b518f0dfcd8860
 
git://xenbits.xen.org/osstest/ovmf.git#96a9acfc527964dc5ab7298862a0cd8aa5fffc6a-2e1e8c35f3178df95d79da81ac6deec242da74c2
 git://xenbits.xen.org/qemu-xen.git#7ea4288\
 95af2840d85c524f0bd11a38aac308308-7ea428895af2840d85c524f0bd11a38aac308308 
git://xenbits.xen.org/osstest/seabios.git#ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e-ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e
 
git://xenbits.xen.org/xen.git#452ddbe3592b141b05a7e0676f09c8ae07f98fdd-04085ec1ac05a362812e9b0c6b5a8713d7dc88ad
Loaded 15001 nodes in revision graph
Searching for test results:
 158609 pass irrelevant
 158616 [host=rochester1]
 158624 pass 09f983f0c7fc0db79a5f6c883ec3510d424c369c 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
96a9acfc527964dc5ab7298862a0cd8aa5fffc6a 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
452ddbe3592b141b05a7e0676f09c8ae07f98fdd
 158681 [host=rochester1]
 158707 fail irrelevant
 158716 fail irrelevant
 158748 fail 131f8d8a889a5ca66a835eea82bba043ac91a7cf 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2d6fc9d36fd5ff15972bedab919f37bb4ee951d0 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
f8708b0ed6d549d1d29b8b5cc287f1f2b642bc63
 158765 fail 131f8d8a889a5ca66a835eea82bba043ac91a7cf 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2d6fc9d36fd5ff15972bedab919f37bb4ee951d0 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
6677b5a3577c16501fbc51a3341446905bd21c38
 158796 fail irrelevant
 158818 fail irrelevant
 158841 fail 0fbca6ce4174724f28be5268c5d210f51ed96e31 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
c6be6dab9c4bdf135bc02b61ecc304d5511c3588 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
9dc687f155a57216b83b17f9cde55dd43e06b0cd
 158863 fail 0fbca6ce4174724f28be5268c5d210f51ed96e31 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
c6be6dab9c4bdf135bc02b61ecc304d5511c3588 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
9dc687f155a57216b83b17f9cde55dd43e06b0cd
 158881 fail 0fbca6ce4174724f28be5268c5d210f51ed96e31 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
c6be6dab9c4bdf135bc02b61ecc304d5511c3588 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
9dc687f155a57216b83b17f9cde55dd43e06b0cd
 158929 fail 0fbca6ce4174724f28be5268c5d210f51ed96e31 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
ea56ebf67dd55483105aa9f9996a48213e78337e 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
9dc687f155a57216b83b17f9cde55dd43e06b0cd
 158962 fail irrelevant
 159023 fail irrelevant
 159129 fail irrelevant
 159200 fail irrelevant
 159238 fail irrelevant
 159295 fail irrelevant
 159324 fail irrelevant
 159339 fail 5b9a4104c902d7dec14c9e3c5652a638194487c6 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2e1e8c35f3178df95d79da81ac6deec242da74c2 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
04085ec1ac05a362812e9b0c6b5a8713d7dc88ad
 159359 fail 5b9a4104c902d7dec14c9e3c5652a638194487c6 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2e1e8c35f3178df95d79da81ac6deec242da74c2 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
04085ec1ac05a362812e9b0c6b5a8713d7dc88ad
 159393 pass 09f983f0c7fc0db79a5f6c883ec3510d424c369c 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
96a9acfc527964dc5ab7298862a0cd8aa5fffc6a 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
452ddbe3592b141b05a7e0676f09c8ae07f98fdd
 159395 fail 5b9a4104c902d7dec14c9e3c5652a638194487c6 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2e1e8c35f3178df95d79da81ac6deec242da74c2 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
04085ec1ac05a362812e9b0c6b5a8713d7dc88ad
 159397 fail 38f35023fd301abeb01cfd81e73caa2e4e7ec0b1 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2d6fc9d36fd5ff15972bedab919f37bb4ee951d0 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
464301737acfa90b46b79659b19d7f456861def3
 159372 fail 5b9a4104c902d7dec14c9e3c5652a638194487c6 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2e1e8c35f3178df95d79da81ac6deec242da74c2 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
04085ec1ac05a362812e9b0c6b5a8713d7dc88ad
 159398 pass d8a487e673abf46c69c901bb25da54e9bc7ba45e 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2d6fc9d36fd5ff15972bedab919f37bb4ee951d0 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
464301737acfa90b46b79659b19d7f456861def3
 159400 pass 5a1d7bb7d333849eb7d3ab5ebfbf9805b2cd46c9 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2d6fc9d36fd5ff15972bedab919f37bb4ee951d0 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
464301737acfa90b46b79659b19d7f456861def3
 159402 fail a09d4e7acdbf276b2096661ee82454ae3dd24d2b 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2d6fc9d36fd5ff15972bedab919f37bb4ee951d0 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
464301737acfa90b46b79659b19d7f456861def3
 159403 pass 9cec63a3aacbcaee8d09aecac2ca2f8820efcc70 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2d6fc9d36fd5ff15972bedab919f37bb4ee951d0 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
464301737acfa90b46b79659b19d7f456861def3
 159404 pass 8ab3478335ad8fc08f14ec73251b084fe02b3ebb 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2d6fc9d36fd5ff15972bedab919f37bb4ee951d0 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
464301737acfa90b46b79659b19d7f456861def3
 159406 pass acc402fa5bf502d471d50e3d495379f093a7f9e4 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2d6fc9d36fd5ff15972bedab919f37bb4ee951d0 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
464301737acfa90b46b79659b19d7f456861def3
 159407 fail a09d4e7acdbf276b2096661ee82454ae3dd24d2b 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2d6fc9d36fd5ff15972bedab919f37bb4ee951d0 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
464301737acfa90b46b79659b19d7f456861def3
 159409 pass acc402fa5bf502d471d50e3d495379f093a7f9e4 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2d6fc9d36fd5ff15972bedab919f37bb4ee951d0 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
464301737acfa90b46b79659b19d7f456861def3
 159410 fail a09d4e7acdbf276b2096661ee82454ae3dd24d2b 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2d6fc9d36fd5ff15972bedab919f37bb4ee951d0 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
464301737acfa90b46b79659b19d7f456861def3
 159411 pass acc402fa5bf502d471d50e3d495379f093a7f9e4 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2d6fc9d36fd5ff15972bedab919f37bb4ee951d0 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
464301737acfa90b46b79659b19d7f456861def3
 159412 fail a09d4e7acdbf276b2096661ee82454ae3dd24d2b 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2d6fc9d36fd5ff15972bedab919f37bb4ee951d0 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
464301737acfa90b46b79659b19d7f456861def3
Searching for interesting versions
 Result found: flight 158624 (pass), for basis pass
 Result found: flight 159339 (fail), for basis failure (at ancestor ~280)
 Repro found: flight 159393 (pass), for basis pass
 Repro found: flight 159395 (fail), for basis failure
 0 revisions at acc402fa5bf502d471d50e3d495379f093a7f9e4 
c530a75c1e6a472b0eb9558310b518f0dfcd8860 
2d6fc9d36fd5ff15972bedab919f37bb4ee951d0 
7ea428895af2840d85c524f0bd11a38aac308308 
ef88eeaf052c8a7d28c5f85e790c5e45bcffa45e 
464301737acfa90b46b79659b19d7f456861def3
No revisions left to test, checking graph state.
 Result found: flight 159406 (pass), for last pass
 Result found: flight 159407 (fail), for first failure
 Repro found: flight 159409 (pass), for last pass
 Repro found: flight 159410 (fail), for first failure
 Repro found: flight 159411 (pass), for last pass
 Repro found: flight 159412 (fail), for first failure

*** Found and reproduced problem changeset ***

  Bug is in tree:  linux 
git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git
  Bug introduced:  a09d4e7acdbf276b2096661ee82454ae3dd24d2b
  Bug not present: acc402fa5bf502d471d50e3d495379f093a7f9e4
  Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/159412/


  commit a09d4e7acdbf276b2096661ee82454ae3dd24d2b
  Author: David Woodhouse <dwmw@xxxxxxxxxxxx>
  Date:   Wed Jan 13 13:26:02 2021 +0000
  
      xen: Fix event channel callback via INTX/GSI
      
      [ Upstream commit 3499ba8198cad47b731792e5e56b9ec2a78a83a2 ]
      
      For a while, event channel notification via the PCI platform device
      has been broken, because we attempt to communicate with xenstore before
      we even have notifications working, with the xs_reset_watches() call
      in xs_init().
      
      We tend to get away with this on Xen versions below 4.0 because we avoid
      calling xs_reset_watches() anyway, because xenstore might not cope with
      reading a non-existent key. And newer Xen *does* have the vector
      callback support, so we rarely fall back to INTX/GSI delivery.
      
      To fix it, clean up a bit of the mess of xs_init() and xenbus_probe()
      startup. Call xs_init() directly from xenbus_init() only in the !XS_HVM
      case, deferring it to be called from xenbus_probe() in the XS_HVM case
      instead.
      
      Then fix up the invocation of xenbus_probe() to happen either from its
      device_initcall if the callback is available early enough, or when the
      callback is finally set up. This means that the hack of calling
      xenbus_probe() from a workqueue after the first interrupt, or directly
      from the PCI platform device setup, is no longer needed.
      
      Signed-off-by: David Woodhouse <dwmw@xxxxxxxxxxxx>
      Reviewed-by: Boris Ostrovsky <boris.ostrovsky@xxxxxxxxxx>
      Link: 
https://lore.kernel.org/r/20210113132606.422794-2-dwmw2@xxxxxxxxxxxxx
      Signed-off-by: Juergen Gross <jgross@xxxxxxxx>
      Signed-off-by: Sasha Levin <sashal@xxxxxxxxxx>

pnmtopng: 118 colors found
Revision graph left in 
/home/logs/results/bisect/linux-5.4/test-arm64-arm64-xl-thunderx.guest-start.{dot,ps,png,html,svg}.
----------------------------------------
159412: tolerable ALL FAIL

flight 159412 linux-5.4 real-bisect [real]
http://logs.test-lab.xenproject.org/osstest/logs/159412/

Failures :-/ but no regressions.

Tests which did not succeed,
including tests which could not be run:
 test-arm64-arm64-xl-thunderx 14 guest-start             fail baseline untested


jobs:
 test-arm64-arm64-xl-thunderx                                 fail    


------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images

Logs, config files, etc. are available at
    http://logs.test-lab.xenproject.org/osstest/logs

Explanation of these reports, and of osstest in general, is at
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master

Test harness code can be found at
    http://xenbits.xen.org/gitweb?p=osstest.git;a=summary