Xen project Mailing List

Re: [xen-unstable test] 169819: regressions - FAIL

From: Roger Pau Monné <roger.pau@xxxxxxxxxx>

Date: Mon, 2 May 2022 13:45:17 +0200

Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=citrix.com; dmarc=pass action=none header.from=citrix.com; dkim=pass header.d=citrix.com; arc=none

Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=HnbsPNuB7Eoa8O7wY1LGJ/wJR9m6qiA5YTokPsC2WC4=; b=lTwLJ1qiMASzRwBnACtrL+DheRE7yPjhEXKZyxq4jpa99kNI1cPhIBY5x5CNLpxi0UigDe92/IvMHxeXG4CPp1hY/PEdInneYetIxDUrjo+Ac/50TUX/j8iY+viBukigXbsDLyvYySAUuntvgG7NdhmPqr4y+LnmOa5b7HjkZriALN9aLAtonRfxx3oxbUeIQ+M+Wc6oGZUntvZje5kPI3tFKdrJaRbKdhAZdzI/58wrBBR9W3tAQeFuOvEqDMsZ7ARyytfHqjSwlPJkz1sySndcNyYWA6jhu7w22ThvNL5ZgTNz65VoJU5LKFwCyE3YQj0sVxdJ5RbuTmowqowESw==

Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=R0NHzMoFKDHqgT6DjCtUoOrHWmdv7BqPTcwMJu35PBPuunn4xKPz6Xf2oBJ/+sMtHXSW2SqPmIq83FFPZNl0OH1G+ebKt72pzSKC/8jTtN8rWM2S3VU0kk/z839hMIZ450XLXZb5YcbqhKyyMsR35hL232SveFFmEQD+zYVJtCBTQv5xRSB5xkSv/QyndXbg73Tzm7DpSLj/QUIuvW9K2dIvOlfHoM7wyJnD4gsp5+596FlKCWeyT+Smdz/3vEwAe331XRJyy+Hi3Q60vPSJ3mB865vGQdl5dleN3niq3MI7YfieSluMDX6JAZd1mCF3tCy89id07EJynBSvvJLZkg==

Authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=citrix.com;

Cc: Jan Beulich <jbeulich@xxxxxxxx>, xen-devel@xxxxxxxxxxxxxxxxxxxx, Andrew Cooper <andrew.cooper3@xxxxxxxxxx>, Boris Ostrovsky <boris.ostrovsky@xxxxxxxxxx>, osstest service owner <osstest-admin@xxxxxxxxxxxxxx>

Delivery-date: Mon, 02 May 2022 11:45:37 +0000

Ironport-data: A9a23:7i+4FKpeTlZUyUJQeuUWJqfwuZleBmItZBIvgKrLsJaIsI4StFCzt garIBmEO/eLNmvxctsnPNuz8hkPuMDdx99nGgRo/C4xECkX85uZCYyVIHmrMnLJJKUvbq7GA +byyDXkBJppJpMJjk71atANlVEliefQAOCU5NfsYkidfyc9IMsaoU8lyrdRbrJA24DjWVvQ4 Yqq+aUzBXf+s9JKGjNMg068gEsHUMTa4Fv0aXRnOJinFHeH/5UkJMp3yZOZdhMUcaENdgKOf M7RzanRw4/s10xF5uVJMFrMWhZirrb6ZWBig5fNMkSoqkAqSicais7XOBeAAKv+Zvrgc91Zk b1wWZKMpQgBLI/oh8sWUUdkOAZzMvdkxfjpCla6mJnGp6HGWyOEL/RGKmgTZNVd1sMpRGZE+ LofNSwHaQ2Fi6Su2rWnR+Jwh8Mlas72IIcYvXImxjbcZRokacmbH+OWupkFjHFp3pwm8fX2P qL1bRJ1axvNeVtXM0o/A5Mihua4wHL4dlW0rXrK//psvTSKkGSd1pDtNpnMdOCBBvl+oU3Ci n/E2mTHPzQzYYn3JT2ttyjEavX0tSH0QoUJD5Wj6+VnxlaUwwQ7ChcbSF+6qvmRkVOlVpRUL El80jojq+0++VKmSvH5XgakuziUsxgEQd1SHuYmrgaXxcL86QGDB3NCSSVdcts4r8wnbTsw3 1SNkpXiAjkHmLqOUm6Q7avRpD+3OC49PWIEfTUDTwYO/5/kuo5bs/7UZtNqEarwgtirHzj1m miOtHJn3+lVitMX3aKm+1yBmyirupXCUg8y4EPQQ36h6QR6IoWiYuRE9GTm0BqJF67BJnHpg ZTOs5H2ADwmZX1VqBGwfQ==

Ironport-hdrordr: A9a23:Nhf8WKjAkgHIPrM+tslBJqE8bnBQX1N13DAbv31ZSRFFG/FwyP rCoB1L73XJYWgqM03I+eruBEBPewK4yXdQ2/hoAV7EZnichILIFvAa0WKG+VHd8kLFltK1uZ 0QEJSWTeeAd2SS7vyKnzVQcexQp+VvmZrA7Ym+854ud3ANV0gJ1XYENu/xKDwTeOApP+taKH LKjfA32gZINE5nJviTNz0gZazuttfLnJXpbVovAAMm0hCHiXeN5KThGxaV8x8CW3cXqI1Su1 Ttokjc3OGOovu7whjT2yv66IlXosLozp9mCNaXgsYYBz3wgkKDZZhnWZeFoDcpydvfo2oCoZ 3pmVMNLs5z43TeciWcpgbs4RDp1HIU53rr2Taj8AzeSWCQfkNIN+NxwaZiNjfJ4Uspu99xlI hR2XiCipZRBRTc2Azg+tnhTXhR5wSJiEtntdRWo21UUIMYZrMUh5cY5llpHJAJGz+/wJw7Ed NpENrX6J9tABynhkjizylSKeGXLzcO9k/seDlBhiXV6UkboJlB9TpY+CRF9U1wsa7USPF/lp D52+pT5fVzp/QtHNNA7dc6MLWK41P2MGLx2UKpUCLa/fI8SjvwQ6Ce2sRG2MiaPLo18bAVpL PtFHtliE9aQTOaNSTJ5uwHzizw

List-id: Xen developer discussion <xen-devel.lists.xenproject.org>

On Mon, May 02, 2022 at 01:16:05PM +0200, Juergen Gross wrote: > On 02.05.22 12:49, Roger Pau Monné wrote: > > On Mon, May 02, 2022 at 08:51:40AM +0200, Juergen Gross wrote: > > > On 29.04.22 13:00, Roger Pau Monné wrote: > > > > On Fri, Apr 29, 2022 at 12:37:13PM +0200, Jan Beulich wrote: > > > > > On 29.04.2022 12:30, Roger Pau Monné wrote: > > > > > > On Fri, Apr 29, 2022 at 07:46:47AM +0000, osstest service owner > > > > > > wrote: > > > > > > > flight 169819 xen-unstable real [real] > > > > > > > flight 169843 xen-unstable real-retest [real] > > > > > > > http://logs.test-lab.xenproject.org/osstest/logs/169819/ > > > > > > > http://logs.test-lab.xenproject.org/osstest/logs/169843/ > > > > > > > > > > > > > > Regressions :-( > > > > > > > > > > > > > > Tests which did not succeed and are blocking, > > > > > > > including tests which could not be run: > > > > > > > test-arm64-arm64-examine 8 reboot fail > > > > > > > REGR. vs. 169775 > > > > > > > test-arm64-arm64-libvirt-xsm 8 xen-boot fail > > > > > > > REGR. vs. 169775 > > > > > > > test-arm64-arm64-libvirt-raw 8 xen-boot fail > > > > > > > REGR. vs. 169775 > > > > > > > test-arm64-arm64-xl-credit1 8 xen-boot fail > > > > > > > REGR. vs. 169775 > > > > > > > test-arm64-arm64-xl-thunderx 8 xen-boot fail > > > > > > > REGR. vs. 169775 > > > > > > > test-arm64-arm64-xl 8 xen-boot fail > > > > > > > REGR. vs. 169775 > > > > > > > > > > > > > > Tests which are failing intermittently (not blocking): > > > > > > > test-amd64-amd64-xl-qemut-debianhvm-i386-xsm 12 > > > > > > > debian-hvm-install fail pass in 169843-retest > > > > > > > > > > > > Looked into this one, and it's slightly concerning, guest seems to > > > > > > be > > > > > > stuck at installation: > > > > > > > > > > > > Select and install software [ 481.093857] watchdog: BUG: soft > > > > > > lockup - CPU#1 stuck for 23s! [ksoftirqd/1:17] > > > > > > [ 509.093865] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 545.093820] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 573.093809] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 609.093855] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 637.093836] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 673.093957] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 701.093854] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 733.093805] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 761.093817] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 797.093898] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 825.093863] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 861.093865] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 889.093945] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 925.093974] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 953.093925] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 985.093832] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1013.093855] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1049.094031] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1077.093860] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1113.093938] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1141.093803] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1177.094051] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1205.093805] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1237.093955] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1265.094004] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1301.093835] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1329.094039] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1365.093883] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1393.094167] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1429.093857] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1457.093900] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1489.094026] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1517.093997] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1553.093996] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1581.094064] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1617.094076] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1645.093882] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1681.093896] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1709.094022] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1741.093870] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1769.093854] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1805.094017] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1833.093837] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1869.094043] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1897.094101] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1933.093879] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1961.093933] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 1997.093952] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2025.093925] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2057.093895] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2085.094172] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2121.094018] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2149.094021] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2185.093931] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2213.093864] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2249.093951] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2277.093899] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2309.094054] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2337.093956] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2373.094111] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2401.094132] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2437.094064] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2465.094003] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2501.093959] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2529.094050] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2561.094027] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2589.094061] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2625.093999] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2653.093956] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2689.094024] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2717.094093] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2753.093913] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2781.094095] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2813.093959] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2841.094117] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2877.094041] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2905.094009] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2941.093893] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 2969.094085] watchdog: BUG: soft lockup - CPU#1 stuck for 23s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 3005.094061] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 3033.093917] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > [ 3065.094060] watchdog: BUG: soft lockup - CPU#1 stuck for 22s! > > > > > > [ksoftirqd/1:17] > > > > > > > > > > > > debina1 is one of the boxes I've put into production recently. > > > > > > > > > > ISTR this issue having surfaced randomly before. With the randomness > > > > > making > > > > > it difficult to investigate. > > > > > > > > Indeed, it seems to happen on other boxes also: > > > > > > > > http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemut-debianhvm-i386-xsm/xen-unstable.html > > > > > > > > At least doesn't seem to be explicitly related to debinas. > > > > > > How valuable is it to test systems using a kernel from 2019? > > > > > > Chances are high that bugs which might trigger are corrected already. > > > IMO trying to find probably known bugs is a waste of time. > > > > This is the kernel from oldstable Debian distribution, which is still > > supported (until June 2024 AFAICT). I think it's not unlikely that > > Yeah, but at least the install kernel doesn't seem to have received any > updates since 2.5 years now (compile date is reported to be 2019-09-20). > And supported doesn't mean that a kernel will run without any further > fixes until then, but that fixes are applied. And this seems not to have > happened here for quite some time. Hm, so it seems the installer Debian CD for HVM guests is not updated as part of the rest of the install media update process. I've now updated those and I'm running some tests to check we don't regress. > > people are running those kernels in guests. I wouldn't mind testing > > newer guest kernels, but someone would have to update osstest to use > > Debian 11 which ships with kernel 5.10. > > I don't mind the base kernel version, just the lack of applied patches. > > And BTW: this install kernel seems to lack any Xen support: Yes, I've also noticed this, it seems like the kernel from the install media doesn't have Xen support. This is official install media, so I think it's also fine to test it works as expected. Thanks, Roger.

©2013 Xen Project, A Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation.
Xen Project is a trademark of The Linux Foundation.