Re: [Xen-devel] kernel BUG at block/bio.c:1786 -- (xen_blkif_schedule on the stack)

[Wei Liu <wei.liu2@xxxxxxxxxx>]

CC Roger and Konrad

On Mon, Feb 06, 2017 at 12:31:20AM +0100, Håkon Alstadheim wrote:
> I get the BUG below in dom0 when trying to start a windows 10 domu (hvm,
> with some pv-drivers installed ) . Below is "xl info", then comes dmesg
> output, and finally domu config attached at end.
> 
> This domain is started very rarely, so may have been broken for some
> time. All my other domains ar linux. This message is just a data-point
> for whoever is interested, with possibly more data if anybody wants to
> ask me anything. NOT expecting quick resolution of this :-/ .
> 
> The domain boots part of the way, screen resolution gets changed and
> then it keeps spinning for ~ 5 seconds before stopping.
> 
> -----
> # xl info
> host                   : gentoo
> release                : 4.9.8-gentoo
> version                : #1 SMP Sun Feb 5 04:25:10 CET 2017
> machine                : x86_64
> nr_cpus                : 24
> max_cpu_id             : 23
> nr_nodes               : 2
> cores_per_socket       : 6
> threads_per_core       : 2
> cpu_mhz                : 2394
> hw_caps                :
> b7ebfbff:77fef3ff:2c100800:00000021:00000001:000037ab:00000000:00000100
> virt_caps              : hvm hvm_directio
> total_memory           : 65376
> free_memory            : 20811
> sharing_freed_memory   : 0
> sharing_used_memory    : 0
> outstanding_claims     : 0
> free_cpus              : 0
> xen_major              : 4
> xen_minor              : 8
> xen_extra              : .0
> xen_version            : 4.8.0
> xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32
> hvm-3.0-x86_32p hvm-3.0-x86_64
> xen_scheduler          : credit
> xen_pagesize           : 4096
> platform_params        : virt_start=0xffff800000000000
> xen_changeset          :
> xen_commandline        : ssd-xen-noidle-autogen-marker
> console_timestamps=date loglvl=warn/warn guest_loglvl=warn/warn
> iommu=1,verbose,debug iommu_inclusive_mapping=1 com1=115200,8n1
> com2=115200,8n1 console=com2 dom0_max_vcpus=4 dom0_vcpus_pin=1
> dom0_mem=7G,max:7G cpufreq=xen,performance,verbose
> sched_smt_power_savings=1 apic_verbosity=debug e820-verbose=1
> core_parking=power cpuidle=0 nmi=dom0 tmem=1 tmem_compress=0 tmem_dedup=0
> cc_compiler            : x86_64-pc-linux-gnu-gcc (Gentoo 5.4.0 p1.0,
> pie-0.6.5) 5.4.0
> cc_compile_by          :
> cc_compile_domain      : alstadheim.priv.no
> cc_compile_date        : Thu Dec 22 01:53:23 CET 2016
> build_id               : 14ea86d056798436b26a27b06046797e
> xend_config_format     : 4
> 
> ----------
> [339809.663061] br0: port 12(vif7.0) entered blocking state
> [339809.663063] br0: port 12(vif7.0) entered disabled state
> [339809.663123] device vif7.0 entered promiscuous mode
> [339809.664885] IPv6: ADDRCONF(NETDEV_UP): vif7.0: link is not ready
> [339809.742522] br0: port 13(vif7.0-emu) entered blocking state
> [339809.742523] br0: port 13(vif7.0-emu) entered disabled state
> [339809.742573] device vif7.0-emu entered promiscuous mode
> [339809.744386] br0: port 13(vif7.0-emu) entered blocking state
> [339809.744388] br0: port 13(vif7.0-emu) entered forwarding state
> [339864.059095] xen-blkback: backend/vbd/7/768: prepare for reconnect
> [339864.138002] xen-blkback: backend/vbd/7/768: using 1 queues, protocol
> 1 (x86_64-abi)
> [339864.241039] xen-blkback: backend/vbd/7/832: prepare for reconnect
> [339864.337997] xen-blkback: backend/vbd/7/832: using 1 queues, protocol
> 1 (x86_64-abi)
> [339875.245306] vif vif-7-0 vif7.0: Guest Rx ready
> [339875.245345] IPv6: ADDRCONF(NETDEV_CHANGE): vif7.0: link becomes ready
> [339875.245391] br0: port 12(vif7.0) entered blocking state
> [339875.245395] br0: port 12(vif7.0) entered forwarding state
> [339894.122151] ------------[ cut here ]------------
> [339894.122169] kernel BUG at block/bio.c:1786!
> [339894.122173] invalid opcode: 0000 [#1] SMP
> [339894.122176] Modules linked in: xt_physdev iptable_filter ip_tables
> x_tables nfsd auth_rpcgss oid_registry nfsv4 dns_resolver nfsv3 nfs_acl
> binfmt_misc intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp
> crc32c_intel pcspkr serio_raw i2c_i801 i2c_smbus iTCO_wdt
> iTCO_vendor_support amdgpu drm_kms_helper syscopyarea bcache input_leds
> sysfillrect sysimgblt fb_sys_fops ttm drm uas shpchp ipmi_ssif rtc_cmos
> acpi_power_meter wmi tun snd_hda_codec_realtek snd_hda_codec_generic
> snd_hda_intel snd_hda_codec snd_hwdep snd_hda_core snd_pcm snd_timer snd
> usbip_host usbip_core pktcdvd tmem lpc_ich xen_wdt nct6775 hwmon_vid
> dm_zero dm_thin_pool dm_persistent_data dm_bio_prison dm_service_time
> dm_round_robin dm_queue_length dm_multipath dm_log_userspace cn
> virtio_pci virtio_scsi virtio_blk virtio_console virtio_balloon
> [339894.122233]  xts gf128mul aes_x86_64 cbc sha512_generic
> sha256_generic sha1_generic libiscsi scsi_transport_iscsi virtio_net
> virtio_ring virtio tg3 libphy e1000 fuse overlay nfs lockd grace sunrpc
> jfs multipath linear raid10 raid1 raid0 dm_raid raid456
> async_raid6_recov async_memcpy async_pq async_xor xor async_tx raid6_pq
> dm_snapshot dm_bufio dm_crypt dm_mirror dm_region_hash dm_log dm_mod
> hid_sunplus hid_sony hid_samsung hid_pl hid_petalynx hid_monterey
> hid_microsoft hid_logitech ff_memless hid_gyration hid_ezkey hid_cypress
> hid_chicony hid_cherry hid_a4tech sl811_hcd xhci_plat_hcd ohci_pci
> ohci_hcd uhci_hcd aic94xx lpfc qla2xxx aacraid sx8 DAC960 hpsa cciss
> 3w_9xxx 3w_xxxx mptsas mptfc scsi_transport_fc mptspi mptscsih mptbase
> atp870u dc395x qla1280 imm parport dmx3191d sym53c8xx gdth initio BusLogic
> [339894.122325]  arcmsr aic7xxx aic79xx sg pdc_adma sata_inic162x
> sata_mv sata_qstor sata_vsc sata_uli sata_sis sata_sx4 sata_nv sata_via
> sata_svw sata_sil24 sata_sil sata_promise pata_sis usbhid led_class igb
> ptp dca i2c_algo_bit ehci_pci ehci_hcd xhci_pci megaraid_sas xhci_hcd
> [339894.122350] CPU: 3 PID: 23514 Comm: 7.hda-0 Tainted: G        W
>  4.9.8-gentoo #1
> [339894.122353] Hardware name: ASUSTeK COMPUTER INC. Z10PE-D8
> WS/Z10PE-D8 WS, BIOS 3304 06/22/2016
> [339894.122358] task: ffff880244b55b00 task.stack: ffffc90042fcc000
> [339894.122361] RIP: e030:[<ffffffff813c6af7>]  [<ffffffff813c6af7>]
> bio_split+0x9/0x89
> [339894.122370] RSP: e02b:ffffc90042fcfb18  EFLAGS: 00010246
> [339894.122373] RAX: 00000000000000a8 RBX: ffff8802433ee900 RCX:
> ffff88023f537080
> [339894.122377] RDX: 0000000002400000 RSI: 0000000000000000 RDI:
> ffff8801fc8b7890
> [339894.122380] RBP: ffffc90042fcfba8 R08: 0000000000000000 R09:
> 00000000000052da
> [339894.122383] R10: 0000000000000002 R11: 0005803fffffffff R12:
> ffff8801fc8b7890
> [339894.122387] R13: 00000000000000a8 R14: ffffc90042fcfbb8 R15:
> 0000000000000000
> [339894.122394] FS:  0000000000000000(0000) GS:ffff8802498c0000(0000)
> knlGS:ffff8802498c0000
> [339894.122398] CS:  e033 DS: 0000 ES: 0000 CR0: 0000000080050033
> [339894.122401] CR2: 00007f99b78e3349 CR3: 0000000216d43000 CR4:
> 0000000000042660
> [339894.122405] Stack:
> [339894.122407]  ffffffff813d1bce 0000000000000002 ffffc90042fcfb50
> ffff88023f537080
> [339894.122413]  0000000000000002 0000000100000000 0000000000000000
> 0000000100000000
> [339894.122419]  0000000000000000 000000000d2ee022 0000000200006fec
> 0000000000000000
> [339894.122424] Call Trace:
> [339894.122429]  [<ffffffff813d1bce>] ? blk_queue_split+0x448/0x48b
> [339894.122435]  [<ffffffff813cd7f3>] blk_queue_bio+0x44/0x289
> [339894.122439]  [<ffffffff813cc226>] generic_make_request+0xbd/0x160
> [339894.122443]  [<ffffffff813cc3c9>] submit_bio+0x100/0x11d
> [339894.122446]  [<ffffffff813d2b8a>] ? next_bio+0x1d/0x40
> [339894.122450]  [<ffffffff813c4d10>] submit_bio_wait+0x4e/0x62
> [339894.122454]  [<ffffffff813d2df3>] blkdev_issue_discard+0x71/0xa9
> [339894.122459]  [<ffffffff81534fd4>] __do_block_io_op+0x4f0/0x579
> [339894.122463]  [<ffffffff81534fd4>] ? __do_block_io_op+0x4f0/0x579
> [339894.122469]  [<ffffffff81770005>] ? sha_transform+0xf47/0x1069
> [339894.122474]  [<ffffffff81535544>] xen_blkif_schedule+0x318/0x63c
> [339894.122478]  [<ffffffff81777498>] ? __schedule+0x32e/0x4e8
> [339894.122484]  [<ffffffff81088f9b>] ? wake_up_atomic_t+0x2c/0x2c
> [339894.122488]  [<ffffffff8153522c>] ? xen_blkif_be_int+0x2c/0x2c
> [339894.122492]  [<ffffffff810742aa>] kthread+0xa6/0xae
> [339894.122496]  [<ffffffff81074204>] ? init_completion+0x24/0x24
> [339894.122501]  [<ffffffff8177a335>] ret_from_fork+0x25/0x30
> [339894.122504] Code: ff 31 c0 eb 0e 48 89 de 4c 89 e7 e8 81 fd ff ff 4c
> 89 e0 48 83 c4 18 5b 41 5a 41 5c 41 5d 41 5e 5d c3 0f 1f 44 00 00 85 f6
> 7f 02 <0f> 0b 55 89 d0 48 89 e5 41 55 41 89 f5 41 54 53 8b 57 28 c1 ea
> [339894.122543] RIP  [<ffffffff813c6af7>] bio_split+0x9/0x89
> [339894.122547]  RSP <ffffc90042fcfb18>
> [339894.132772] ---[ end trace 36cf8d8b83453b4f ]---
> [340083.587187] BUG: unable to handle kernel NULL pointer dereference at
>           (null)
> [340083.587207] IP: [<ffffffff81075f6d>] put_cred+0x0/0x11
> [340083.587215] PGD 22e200067
> [340083.587217] PUD 22e201067
> [340083.587219] PMD 0
> 
> [340083.587223] Oops: 0002 [#2] SMP
> [340083.587226] Modules linked in: xt_physdev iptable_filter ip_tables
> x_tables nfsd auth_rpcgss oid_registry nfsv4 dns_resolver nfsv3 nfs_acl
> binfmt_misc intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp
> crc32c_intel pcspkr serio_raw i2c_i801 i2c_smbus iTCO_wdt
> iTCO_vendor_support amdgpu drm_kms_helper syscopyarea bcache input_leds
> sysfillrect sysimgblt fb_sys_fops ttm drm uas shpchp ipmi_ssif rtc_cmos
> acpi_power_meter wmi tun snd_hda_codec_realtek snd_hda_codec_generic
> snd_hda_intel snd_hda_codec snd_hwdep snd_hda_core snd_pcm snd_timer snd
> usbip_host usbip_core pktcdvd tmem lpc_ich xen_wdt nct6775 hwmon_vid
> dm_zero dm_thin_pool dm_persistent_data dm_bio_prison dm_service_time
> dm_round_robin dm_queue_length dm_multipath dm_log_userspace cn
> virtio_pci virtio_scsi virtio_blk virtio_console virtio_balloon
> [340083.587289]  xts gf128mul aes_x86_64 cbc sha512_generic
> sha256_generic sha1_generic libiscsi scsi_transport_iscsi virtio_net
> virtio_ring virtio tg3 libphy e1000 fuse overlay nfs lockd grace sunrpc
> jfs multipath linear raid10 raid1 raid0 dm_raid raid456
> async_raid6_recov async_memcpy async_pq async_xor xor async_tx raid6_pq
> dm_snapshot dm_bufio dm_crypt dm_mirror dm_region_hash dm_log dm_mod
> hid_sunplus hid_sony hid_samsung hid_pl hid_petalynx hid_monterey
> hid_microsoft hid_logitech ff_memless hid_gyration hid_ezkey hid_cypress
> hid_chicony hid_cherry hid_a4tech sl811_hcd xhci_plat_hcd ohci_pci
> ohci_hcd uhci_hcd aic94xx lpfc qla2xxx aacraid sx8 DAC960 hpsa cciss
> 3w_9xxx 3w_xxxx mptsas mptfc scsi_transport_fc mptspi mptscsih mptbase
> atp870u dc395x qla1280 imm parport dmx3191d sym53c8xx gdth initio BusLogic
> [340083.587391]  arcmsr aic7xxx aic79xx sg pdc_adma sata_inic162x
> sata_mv sata_qstor sata_vsc sata_uli sata_sis sata_sx4 sata_nv sata_via
> sata_svw sata_sil24 sata_sil sata_promise pata_sis usbhid led_class igb
> ptp dca i2c_algo_bit ehci_pci ehci_hcd xhci_pci megaraid_sas xhci_hcd
> [340083.587418] CPU: 1 PID: 33 Comm: xenwatch Tainted: G      D W
> 4.9.8-gentoo #1
> [340083.587424] Hardware name: ASUSTeK COMPUTER INC. Z10PE-D8
> WS/Z10PE-D8 WS, BIOS 3304 06/22/2016
> [340083.587428] task: ffff8802440b8d00 task.stack: ffffc90040174000
> [340083.587431] RIP: e030:[<ffffffff81075f6d>]  [<ffffffff81075f6d>]
> put_cred+0x0/0x11
> [340083.587436] RSP: e02b:ffffc90040177d10  EFLAGS: 00010246
> [340083.587439] RAX: 0000000000000000 RBX: ffff880244b55b00 RCX:
> 0000000000000035
> [340083.587443] RDX: 0000000000000036 RSI: 0000000000000008 RDI:
> 0000000000000000
> [340083.587448] RBP: ffffc90040177d20 R08: 0000000000000000 R09:
> ffffffff814e38e9
> [340083.587452] R10: ffffc900400b7dd0 R11: ffffc90040177c90 R12:
> 0000000000000000
> [340083.587456] R13: 0000000000000000 R14: ffff8802246fc800 R15:
> ffff880218255600
> [340083.587465] FS:  0000000000000000(0000) GS:ffff880249840000(0000)
> knlGS:ffff880249840000
> [340083.587469] CS:  e033 DS: 0000 ES: 0000 CR0: 0000000080050033
> [340083.587472] CR2: 0000000000000000 CR3: 00000002291a2000 CR4:
> 0000000000042660
> [340083.587476] Stack:
> [340083.587478]  ffffffff81076203 ffff880244b55b00 ffffc90040177d38
> ffffffff810587c0
> [340083.587485]  ffff880244b55b00 ffffc90040177d58 ffffffff8107488b
> ffff8802125d4d20
> [340083.587492]  ffff880214c9d740 ffffc90040177db0 ffffffff81535bfb
> ffffc90040177e3c
> [340083.587498] Call Trace:
> [340083.587504]  [<ffffffff81076203>] ? exit_creds+0x24/0x3e
> [340083.587510]  [<ffffffff810587c0>] __put_task_struct+0x6e/0xbd
> [340083.587514]  [<ffffffff8107488b>] kthread_stop+0xaa/0xed
> [340083.587519]  [<ffffffff81535bfb>] xen_blkif_disconnect+0x54/0x235
> [340083.587525]  [<ffffffff8115bbbe>] ? kfree+0xd6/0x10e
> [340083.587530]  [<ffffffff8115bbbe>] ? kfree+0xd6/0x10e
> [340083.587533]  [<ffffffff8153706a>] frontend_changed+0x3a5/0x4e7
> [340083.587538]  [<ffffffff81078173>] ? arch_local_irq_enable+0xb/0xd
> [340083.587545]  [<ffffffff814e48c6>] xenbus_otherend_changed+0x84/0x8d
> [340083.587549]  [<ffffffff814e3913>] ? xenbus_gather+0x123/0x123
> [340083.587553]  [<ffffffff814e552f>] frontend_changed+0x10/0x12
> [340083.587557]  [<ffffffff814e39db>] xenwatch_thread+0xc8/0xf3
> [340083.587564]  [<ffffffff81088f9b>] ? wake_up_atomic_t+0x2c/0x2c
> [340083.587569]  [<ffffffff810742aa>] kthread+0xa6/0xae
> [340083.587573]  [<ffffffff81074204>] ? init_completion+0x24/0x24
> [340083.587581]  [<ffffffff8177a335>] ret_from_fork+0x25/0x30
> [340083.587584] Code: 05 00 00 75 02 0f 0b 48 3b b8 b0 05 00 00 75 02 0f
> 0b 55 48 81 c7 90 00 00 00 48 c7 c6 80 5e 07 81 48 89 e5 e8 a8 01 03 00
> 5d c3 <f0> ff 0f 74 01 c3 55 48 89 e5 e8 ac ff ff ff 5d c3 0f 1f 44 00
> [340083.587628] RIP  [<ffffffff81075f6d>] put_cred+0x0/0x11
> [340083.587634]  RSP <ffffc90040177d10>
> [340083.587637] CR2: 0000000000000000
> [340083.587640] ---[ end trace 36cf8d8b83453b50 ]---
> 
> ------------ domu.cfg: (sorry for the line-wraps)---
> name = "windows.hvm"
> builder = "hvm"
> vcpus = 8
> pvh=0
> memory = 8192
> mmio_hole=3072
> localtime = 1
> no_migrate = 1
> nestedhvm = 1
> timer_mode = "one_missed_tick_pending"
> device_model_version="qemu-xen"
> disk = [ 'format=raw, vdev=hda, access=rw,
> target=/dev/bcache/by-label/winsys-b'
> ,'format=raw, vdev=hdb, access=rw, target=/dev/bcache/by-label/windata-b'
> ,'file:/usr/local/share/xen/cd-images/virtio-win.iso,hdc:cdrom,r'
> ]
> vif = [ 'mac=02:16:3e:00:00:05,model=e1000']
> on_poweroff = 'destroy'
> on_reboot = 'destroy'
> on_crash = 'destroy'
> boot = 'cd'
> acpi = '1'
> viridian = '1'
> sdl = '0'
> vnc = '0'
> videoram=1024
> vga="qxl"
> spice= '1'
> spicehost='0.0.0.0'
> spiceport=6000
> spicepasswd
> spicedisable_ticketing=1
> spicevdagent=1
> spice_clipboard_sharing=1
> client to domUs
> spiceusbredirection=4
> soundhw="hda"
> keymap="en-us"
> 
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@xxxxxxxxxxxxx
> https://lists.xen.org/xen-devel

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
https://lists.xen.org/xen-devel