[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-devel] [linux-4.19 test] 132468: regressions - FAIL



On Tue, Jan 29, 2019 at 05:46:55PM +0000, osstest service owner wrote:
> flight 132468 linux-4.19 real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/132468/
> 
> Regressions :-(
> 
> Tests which did not succeed and are blocking,
> including tests which could not be run:
>  test-amd64-amd64-xl-shadow    7 xen-boot                 fail REGR. vs. 
> 129313
>  test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 7 xen-boot fail REGR. 
> vs. 129313
>  test-amd64-amd64-amd64-pvgrub  7 xen-boot                fail REGR. vs. 
> 129313
>  test-amd64-amd64-xl-qemuu-dmrestrict-amd64-dmrestrict 7 xen-boot fail REGR. 
> vs. 129313
>  test-amd64-amd64-i386-pvgrub  7 xen-boot                 fail REGR. vs. 
> 129313
>  test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm 7 xen-boot fail REGR. vs. 
> 129313
>  test-amd64-i386-examine       8 reboot                   fail REGR. vs. 
> 129313
>  test-amd64-amd64-libvirt-pair 10 xen-boot/src_host       fail REGR. vs. 
> 129313
>  test-amd64-amd64-libvirt-pair 11 xen-boot/dst_host       fail REGR. vs. 
> 129313
>  test-amd64-amd64-pair        10 xen-boot/src_host        fail REGR. vs. 
> 129313
>  test-amd64-amd64-pair        11 xen-boot/dst_host        fail REGR. vs. 
> 129313
>  test-amd64-i386-xl-shadow     7 xen-boot                 fail REGR. vs. 
> 129313
>  test-amd64-i386-xl-qemuu-debianhvm-amd64  7 xen-boot     fail REGR. vs. 
> 129313
>  test-amd64-i386-xl            7 xen-boot                 fail REGR. vs. 
> 129313
>  test-amd64-i386-xl-qemut-debianhvm-amd64-xsm  7 xen-boot fail REGR. vs. 
> 129313
>  test-amd64-i386-freebsd10-i386  7 xen-boot               fail REGR. vs. 
> 129313
>  test-amd64-i386-xl-raw        7 xen-boot                 fail REGR. vs. 
> 129313
>  test-amd64-i386-qemut-rhel6hvm-intel  7 xen-boot         fail REGR. vs. 
> 129313
>  test-amd64-i386-pair         10 xen-boot/src_host        fail REGR. vs. 
> 129313
>  test-amd64-i386-pair         11 xen-boot/dst_host        fail REGR. vs. 
> 129313
>  test-amd64-i386-libvirt       7 xen-boot                 fail REGR. vs. 
> 129313
>  test-amd64-i386-libvirt-pair 10 xen-boot/src_host        fail REGR. vs. 
> 129313
>  test-amd64-i386-libvirt-pair 11 xen-boot/dst_host        fail REGR. vs. 
> 129313
>  test-amd64-amd64-examine      8 reboot                   fail REGR. vs. 
> 129313
>  test-amd64-i386-qemut-rhel6hvm-amd 12 guest-start/redhat.repeat fail REGR. 
> vs. 129313
>  test-amd64-amd64-qemuu-nested-intel 17 debian-hvm-install/l1/l2 fail REGR. 
> vs. 129313

Hello,

I've been watching the 4.19 branch for some time since I would like to
switch osstest to use it so we can start testing pvh dom0 in osstest.
The most worrying issue, and that affects quite a lot of the jobs, is
the failure to boot on the chardonnay boxes. The following page fault
is always triggered when booting as dom0 on this specific hardware:

Jan 26 10:54:04.598513 [    2.985424] input: Avocent Keyboard/Mouse Function as 
/devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.1/1-1.1.1/1-1.1.1:1.0/0003:0624:0249.0001/input/input5

Jan 26 10:54:04.610288 [    3.037982] hid-generic 0003:0624:0249.0001: 
input,hidraw0: USB HID v1.00 Keyboard [Avocent Keyboard/Mouse Function] on 
usb-0000:00:1a.0-1.1.1/input0

Jan 26 10:54:04.622578 [    3.039965] input: Avocent Keyboard/Mouse Function as 
/devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.1/1-1.1.1/1-1.1.1:1.1/0003:0624:0249.0002/input/input6

Jan 26 10:54:04.634343 [    3.040639] hid-generic 0003:0624:0249.0002: 
input,hidraw1: USB HID v1.00 Mouse [Avocent Keyboard/Mouse Function] on 
usb-0000:00:1a.0-1.1.1/input1

Jan 26 10:54:04.646335 [    3.042337] input: Avocent Keyboard/Mouse Function as 
/devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.1/1-1.1.1/1-1.1.1:1.2/0003:0624:0249.0003/input/input7

Jan 26 10:54:04.658656 [    3.043023] hid-generic 0003:0624:0249.0003: 
input,hidraw2: USB HID v1.00 Mouse [Avocent Keyboard/Mouse Function] on 
usb-0000:00:1a.0-1.1.1/input2

Jan 26 10:54:04.682582 [    3.248135] ata7.00: ATA-8: WDC WD1003FBYZ-010FB0, 
01.01V03, max UDMA/133

Jan 26 10:54:04.682620 [    3.248404] ata7.00: 1953525168 sectors, multi 0: 
LBA48 NCQ (depth 32)

Jan 26 10:54:04.694636 [    3.250183] ata7.00: configured for UDMA/133

Jan 26 10:54:04.694700 [    3.261071] scsi 6:0:0:0: Direct-Access     ATA      
WDC WD1003FBYZ-0 1V03 PQ: 0 ANSI: 5

Jan 26 10:54:04.706642 [    3.261718] sd 6:0:0:0: [sda] 1953525168 512-byte 
logical blocks: (1.00 TB/932 GiB)

Jan 26 10:54:04.706715 [    3.261725] sd 6:0:0:0: Attached scsi generic sg0 
type 0

Jan 26 10:54:04.718585 [    3.262118] sd 6:0:0:0: [sda] Write Protect is off

Jan 26 10:54:04.718621 [    3.262667] sd 6:0:0:0: [sda] Write cache: enabled, 
read cache: enabled, doesn't support DPO or FUA

Jan 26 10:54:04.730644 [    3.285447]  sda: sda1 sda2 < sda5 >

Jan 26 10:54:04.730705 [    3.286292] sd 6:0:0:0: [sda] Attached SCSI disk

Jan 26 10:54:04.742638 Begin: Loading essential drivers ... done.

Jan 26 10:54:04.742700 Begin: Running /scripts/init-premount ... done.

Jan 26 10:54:04.742751 Begin: Mounting root file system ... Begin: Running 
/scripts/local-top ... [    3.311658] random: lvm: uninitialized urandom read 
(4 bytes read)

Jan 26 10:54:04.754667 [    3.471985] random: lvm: uninitialized urandom read 
(2 bytes read)

Jan 26 10:54:04.766553 [    3.486854] random: crng init done

Jan 26 10:54:04.766588 done.

Jan 26 10:54:05.114592 Begin: Running /scripts/local-premount ... done.

Jan 26 10:54:05.114672 Begin: Will now check root file system ... fsck from 
util-linux 2.25.2

Jan 26 10:54:05.186503 [/sbin/fsck.ext3 (1) -- 
/dev/mapper/chardonnay0--vg-root] fsck.ext3 -a -C0 
/dev/mapper/chardonnay0--vg-root 

Jan 26 10:54:05.210526 /dev/mapper/chardonnay0--vg-root: clean, 44512/1220608 
files, 481824/4882432 blocks

Jan 26 10:54:05.390595 done.

Jan 26 10:54:05.426517 [    4.214321] EXT4-fs (dm-0): mounting ext3 file system 
using the ext4 subsystem

Jan 26 10:54:05.438571 [    4.217480] BUG: unable to handle kernel NULL pointer 
dereference at 0000000c

Jan 26 10:54:05.450578 [    4.217751] *pdpt = 00000000179f3027 *pde = 
0000000000000000 

Jan 26 10:54:05.450614 [    4.218013] Oops: 0000 [#1] SMP NOPTI

Jan 26 10:54:05.462573 [    4.218264] CPU: 0 PID: 1510 Comm: exe Not tainted 
4.19.17 #1

Jan 26 10:54:05.462611 [    4.218520] Hardware name: GIGABYTE 
GS-R12P4S/GA-7PCSL, BIOS R12 05/20/2014

Jan 26 10:54:05.474561 [    4.218792] EIP: blk_mq_complete_request+0x3a/0x100

Jan 26 10:54:05.474598 [    4.219047] Code: b8 01 00 00 00 f0 0f b1 8a 84 00 00 
00 83 f8 01 74 0e 5b 5e 5f 5d c3 89 f6 8d bc 27 00 00 00 00 83 7a 14 ff 89 d3 
8b 02 74 19 <8b> 50 0c 85 d2 74 12 8b 12 8b 52 40 85 d2 74 09 89 d8 e8 5f 83 55

Jan 26 10:54:05.498535 [    4.219587] EAX: 00000000 EBX: c43d3700 ECX: 00000002 
EDX: c43d3700

Jan 26 10:54:05.498572 [    4.219846] ESI: 00000000 EDI: c43d37b8 EBP: db42de58 
ESP: db42de4c

Jan 26 10:54:05.510557 [    4.220134] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 
0069 EFLAGS: 00010013

Jan 26 10:54:05.522562 [    4.220398] CR0: 80050033 CR2: 0000000c CR3: 041b4000 
CR4: 00042660

Jan 26 10:54:05.522600 [    4.220665] Call Trace:

Jan 26 10:54:05.522626 [    4.220909]  <SOFTIRQ>

Jan 26 10:54:05.534598 [    4.221156]  scsi_mq_done+0x17/0x70

Jan 26 10:54:05.534660 [    4.221411]  ? sdev_evt_alloc+0x50/0x50

Jan 26 10:54:05.534711 [    4.221662]  ata_scsi_qc_complete+0x6a/0x410

Jan 26 10:54:05.546558 [    4.221917]  ? xen_unmap_single+0x180/0x180

Jan 26 10:54:05.546593 [    4.222168]  __ata_qc_complete+0xb2/0x190

Jan 26 10:54:05.546621 [    4.222418]  ata_qc_complete+0xb2/0x2d0

Jan 26 10:54:05.558630 [    4.222671]  sas_ata_task_done+0x14b/0x2c0 [libsas]

Jan 26 10:54:05.558696 [    4.222941]  ireq_done+0x97/0xa0 [isci]

Jan 26 10:54:05.558746 [    4.223194]  
sci_request_completed_state_enter+0x15c/0x650 [isci]

Jan 26 10:54:05.570516 [    4.223456]  sci_change_state+0x36/0x40 [isci]

Jan 26 10:54:05.570551 [    4.223712]  sci_io_request_tc_completion+0x3eb/0x770 
[isci]

Jan 26 10:54:05.582578 [    4.223974]  
sci_controller_process_completions+0x1fc/0x360 [isci]

Jan 26 10:54:05.594552 [    4.224270]  isci_host_completion_routine+0xd7/0xf0 
[isci]

Jan 26 10:54:05.594589 [    4.224529]  tasklet_action_common.isra.24+0x126/0x140

Jan 26 10:54:05.594618 [    4.224784]  tasklet_action+0x19/0x20

Jan 26 10:54:05.606567 [    4.225036]  __do_softirq+0xf9/0x27d

Jan 26 10:54:05.606601 [    4.225286]  ? __softirqentry_text_start+0x8/0x8

Jan 26 10:54:05.618338 [    4.225549]  call_on_stack+0x40/0x50

Jan 26 10:54:05.618373 [    4.225797]  </SOFTIRQ>

Jan 26 10:54:05.618514 [    4.226041]  ? irq_exit+0xbd/0xd0

Jan 26 10:54:05.618551 [    4.226291]  ? xen_evtchn_do_upcall+0x27/0x40

Jan 26 10:54:05.630564 [    4.226544]  ? xen_do_upcall+0x7/0x14

Jan 26 10:54:05.630599 [    4.226796]  ? perf_trace_rseq_ip_fixup+0x98/0xd0

Jan 26 10:54:05.642560 [    4.227079]  ? proc_do_large_bitmap+0x40/0x440

Jan 26 10:54:05.642596 [    4.227334]  ? blk_queue_split+0x182/0x740

Jan 26 10:54:05.642628 [    4.227586]  ? __alloc_pages_nodemask+0xdb/0xe60

Jan 26 10:54:05.654563 [    4.227841]  ? 
__send_empty_flush.constprop.44+0x60/0x60

Jan 26 10:54:05.654599 [    4.228096]  ? __split_and_process_bio+0x2e/0x180

Jan 26 10:54:05.666555 [    4.228358]  ? __radix_tree_replace+0x79/0x140

Jan 26 10:54:05.666591 [    4.228612]  ? 
__send_empty_flush.constprop.44+0x60/0x60

Jan 26 10:54:05.678556 [    4.228867]  ? __dm_make_request.isra.40+0x34/0x90

Jan 26 10:54:05.678592 [    4.229121]  ? dm_make_request+0x13/0x20

Jan 26 10:54:05.678620 [    4.229371]  ? generic_make_request+0x189/0x3e0

Jan 26 10:54:05.690558 [    4.229624]  ? mark_page_accessed+0xb7/0x100

Jan 26 10:54:05.690594 [    4.229885]  ? submit_bio+0x5e/0x140

Jan 26 10:54:05.690620 [    4.230135]  ? bio_alloc_bioset+0x1c0/0x240

Jan 26 10:54:05.702572 [    4.230385]  ? guard_bio_eod+0x32/0x130

Jan 26 10:54:05.702606 [    4.230635]  ? submit_bh_wbc.isra.54+0x110/0x160

Jan 26 10:54:05.714562 [    4.230888]  ? ll_rw_block+0x60/0xa0

Jan 26 10:54:05.714596 [    4.231150]  ? __breadahead+0x3b/0x60

Jan 26 10:54:05.714623 [    4.231407]  ? __ext4_get_inode_loc+0x405/0x440 [ext4]

Jan 26 10:54:05.726561 [    4.231670]  ? __ext4_iget+0xba/0xd70 [ext4]

Jan 26 10:54:05.726596 [    4.231924]  ? _cond_resched+0x12/0x30

Jan 26 10:54:05.726624 [    4.232174]  ? down_write+0xb/0x30

Jan 26 10:54:05.738556 [    4.232429]  ? ext4_get_journal_inode+0x1b/0xb0 [ext4]

Jan 26 10:54:05.738592 [    4.232714]  ? ext4_get_journal_inode+0x1b/0xb0 [ext4]

Jan 26 10:54:05.750558 [    4.232976]  ? ext4_fill_super+0x2e05/0x35f0 [ext4]

Jan 26 10:54:05.750595 [    4.233233]  ? vsnprintf+0x20f/0x3a0

Jan 26 10:54:05.750622 [    4.233489]  ? ext4_calculate_overhead+0x480/0x480 
[ext4]

Jan 26 10:54:05.762572 [    4.233745]  ? mount_bdev+0x14a/0x170

Jan 26 10:54:05.762606 [    4.234024]  ? mount_bdev+0x14a/0x170

Jan 26 10:54:05.774562 [    4.234285]  ? ext4_nfs_get_inode+0x40/0x40 [ext4]

Jan 26 10:54:05.774598 [    4.234547]  ? ext4_mount+0x10/0x20 [ext4]

Jan 26 10:54:05.774625 [    4.234804]  ? ext4_calculate_overhead+0x480/0x480 
[ext4]

Jan 26 10:54:05.786563 [    4.235061]  ? mount_fs+0x2f/0x140

Jan 26 10:54:05.786599 [    4.235329]  ? __alloc_percpu+0xf/0x20

Jan 26 10:54:05.798559 [    4.235579]  ? vfs_kern_mount+0x40/0x110

Jan 26 10:54:05.798595 [    4.235829]  ? do_mount+0x1a6/0xbc0

Jan 26 10:54:05.798622 [    4.236079]  ? memdup_user+0x28/0x50

Jan 26 10:54:05.810556 [    4.236328]  ? ksys_mount+0x61/0xc0

Jan 26 10:54:05.810591 [    4.236578]  ? sys_mount+0x17/0x20

Jan 26 10:54:05.810618 [    4.236859]  ? do_int80_syscall_32+0x60/0x140

Jan 26 10:54:05.822624 [    4.237113]  ? entry_INT80_32+0xca/0xca

Jan 26 10:54:05.822659 [    4.237362] Modules linked in: ext4 mbcache jbd2 isci 
libsas e1000e scsi_transport_sas

Jan 26 10:54:05.834565 [    4.237749] CR2: 000000000000000c

Jan 26 10:54:05.834598 [    4.238006] ---[ end trace 4d32457c74e795d3 ]---

Jan 26 10:54:05.834626 [    4.238261] EIP: blk_mq_complete_request+0x3a/0x100

Jan 26 10:54:05.846628 [    4.238514] Code: b8 01 00 00 00 f0 0f b1 8a 84 00 00 
00 83 f8 01 74 0e 5b 5e 5f 5d c3 89 f6 8d bc 27 00 00 00 00 83 7a 14 ff 89 d3 
8b 02 74 19 <8b> 50 0c 85 d2 74 12 8b 12 8b 52 40 85 d2 74 09 89 d8 e8 5f 83 55

Jan 26 10:54:05.858577 [    4.239055] EAX: 00000000 EBX: c43d3700 ECX: 00000002 
EDX: c43d3700

Jan 26 10:54:05.870563 [    4.239314] ESI: 00000000 EDI: c43d37b8 EBP: db42de58 
ESP: c1cfc5fc

Jan 26 10:54:05.882634 [    4.239582] DS: 007b ES: 007b FS: 00d8 GS: 00e0 SS: 
0069 EFLAGS: 00010013

Jan 26 10:54:05.882744 [    4.239845] CR0: 80050033 CR2: 0000000c CR3: 041b4000 
CR4: 00042660

Jan 26 10:54:05.894337 [    4.240113] Kernel panic - not syncing: Fatal 
exception in interrupt

Jan 26 10:54:05.894374 [    4.240387] Kernel Offset: disabled

Jan 26 10:54:05.906592 (XEN) Hardware Dom0 crashed: 'noreboot' set - not 
rebooting.

Should this be reported to some specific mailing list?

AFAICT this issue is only triggered when booting as a PV dom0, and
likely related to the xen swiotlb (or the driver making wrong usage of
the dma ops)?

Thanks, Roger.

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxxx
https://lists.xenproject.org/mailman/listinfo/xen-devel

 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.