[Xen-devel] Re: Warn/panics booting Konrad's master tree under xen 4.1.1

[Sander Eikelenboom <linux@xxxxxxxxxxxxxx>]

Monday, July 25, 2011, 4:44:38 PM, you wrote:

> On Sat, Jul 23, 2011 at 09:40:10PM +0200, Sander Eikelenboom wrote:
>> Hi Konrad,

> Hey Sander,
>> 
>> I have tried your current master tree (commit 
>> 602d7a606974c54dc8bd61527c051d7d697a5f86) as domU (under xen 4.1.1 and a 
>> 2.6.32.35 dom0), that seems to work fine.
>> 

> Great..

Yes, and i hope your 3 times retry with swiotbl will also help for the observed 
problems with allocating dma mem after some time.

>> I have tried to use the same kernel as dom0 as well, but i get the 
>> warns/panic below, when i boot the kernel bare metal it works ok.

> OK, so only as Dom0 you get this.

Yes.

>> Complete serial log is attached, i have re-compiled with and without 
>> pv-spinlocks but there is no difference.
>> 
>> Also xen-pciback compiled in, with xen-pciback.hide as kernel boot parameter 
>> doesn't seem to seize the devices.

> Can you attach the .config file please? And the lspci/lsusb for your Pinnacle 
> capture thingy.
> You have been doing the USB passthrough for some time right - is this a new 
> piece of hardware
> or was it the one you used for some time?

.config of the 3.0+ kernel attached
lspci and lsusb attached (from booting with 2.6.32.35 kernel, (since the 3.0+ 
kernel panics on boot), so you don't see the usb devices in the lsusb, since 
pass through of the usb cards works in this case)

The pinnacle and kworld usb video capture devices (both em28xx based) should 
have been passedthrough, and i'm using them for quite some time, so no they are 
not new.
I do have the xen-pciback lines in grub (exactly the same as for the 2.6.32.35 
kernel, except for the xen-pciback.passthrough=passthrough parameter because 
with 2.6.32.35 you specify it at compile time ), but it seems no device gets 
seized by pciback some how.

grub lines:

menuentry ' XEN 4.1.1 Debian GNU/Linux, with Linux 
3.0.0-xen-3.1-konrad-master-20110722+' --class debian --class gnu-linux --class 
gnu --class os --class xen {
        insmod part_msdos
        insmod ext2
        set root='(hd0,msdos1)'
        search --no-floppy --fs-uuid --set b45b2279-dbde-4808-b9ec-4745e598c8d2
        echo           'Loading Linux 3.0.0-xen-3.1-konrad-master-20110722+ ...'
        multiboot      /xen-4.1.1.gz dom0_mem=768M loglvl=all loglvl_guest=all 
console_timestamps vga=gfx-1280x1024x32 cpuidle cpufreq=xen noreboot debug 
lapic=debug apic_verbosity=debug apic=debug acpi_enforce_resources=lax 
iommu=on,amd-iommu-debug amd_iommu=on amd-iommu-debug com1=115200,8n1 
console=vga,com1
        module         /vmlinuz-3.0.0-xen-3.1-konrad-master-20110722+ 
root=/dev/mapper/serveerstertje-root ro console=hvc0 console=tty console=vga 
nomodeset vga=794 video=vesafb earlyprintk=xen max_loop=255 loop_max_part=63  
acpi_enforce_resources=lax xen-pciback.passthrough=passthrough 
xen-pciback.hide=(03:06.0)(04:00.0)(04:00.1)(04:00.2)(04:00.3)(04:00.4)(04:00.5)(04:00.6)(04:00.7)(0a:00.0)(0a:00.1)(0a:00.2)(0a:00.3)(0a:00.4)(0a:00.5)(0a:00.6)(0a:00.7)(05:00.0)(05:00.1)(07:01.0)(07:01.1)(07:01.2)
 pci=resource_alignment=07:01.0\;07:01.1\;07:01.2
        echo           'Loading initial ramdisk ...'
        module         /initrd.img-3.0.0-xen-3.1-konrad-master-20110722+
}

menuentry ' XEN 4.1.1 Debian GNU/Linux, with Linux 
2.6.32.35-xen-next-2.6.32.x-20110325' --class debian --class gnu-linux --class 
gnu --class os --class xen {
        insmod part_msdos
        insmod ext2
        set root='(hd0,msdos1)'
        search --no-floppy --fs-uuid --set b45b2279-dbde-4808-b9ec-4745e598c8d2
        echo            'Loading Linux 2.6.32.35-xen-next-2.6.32.x-20110325 ...'
        multiboot       /xen-4.1.1.gz dom0_mem=768M loglvl=all loglvl_guest=all 
console_timestamps vga=gfx-1280x1024x32 cpuidle cpufreq=xen noreboot debug 
lapic=debug apic_verbosity=debug apic=debug acpi_enforce_resources=lax 
iommu=on,amd-iommu-debug amd_iommu=on amd-iommu-debug com1=115200,8n1 
console=vga,com1
        module          /vmlinuz-2.6.32.35-xen-next-2.6.32.x-20110325 
root=/dev/mapper/serveerstertje-root ro nomodeset vga=794 video=vesafb 
earlyprintk=xen max_loop=255 loop_max_part=63  acpi_enforce_resources=lax 
xen-pciback.hide=(03:06.0)(04:00.0)(04:00.1)(04:00.2)(04:00.3)(04:00.4)(04:00.5)(04:00.6)(04:00.7)(0a:00.0)(0a:00.1)(0a:00.2)(0a:00.3)(0a:00.4)(0a:00.5)(0a:00.6)(0a:00.7)(05:00.0)(05:00.1)(07:01.0)(07:01.1)(07:01.2)
 pci=resource_alignment=07:01.0\;07:01.1\;07:01.2
        echo            'Loading initial ramdisk ...'
        module          /initrd.img-2.6.32.35-xen-next-2.6.32.x-20110325
}


>> [    5.139589] Call Trace:
>> [    5.139592]  [<ffffffff811006c8>] unmap_vmas+0x468/0x9f0
>> [    5.139596]  [<ffffffff81103a84>] exit_mmap+0xa4/0x150
>> [    5.139600]  [<ffffffff81007fa0>] ? xen_clocksource_read+0x20/0x30
>> [    5.139603]  [<ffffffff8104f41f>] mmput+0x4f/0xe0
>> [    5.139607]  [<ffffffff81053e01>] exit_mm+0x131/0x170
>> [    5.139610]  [<ffffffff81055c04>] do_exit+0x174/0x860
>> [    5.139613]  [<ffffffff81765eb0>] ? _raw_spin_unlock_irqrestore+0x40/0x80
>> [    5.139617]  [<ffffffff81051dda>] ? kmsg_dump+0x4a/0x100
>> [    5.139620]  [<ffffffff810080f2>] ? check_events+0x12/0x20
>> [    5.139623]  [<ffffffff8100f62d>] oops_end+0x9d/0xd0
>> [    5.139627]  [<ffffffff8103323b>] no_context+0xfb/0x260
>> [    5.139630]  [<ffffffff81004651>] ? pte_mfn_to_pfn+0x91/0xf0
>> [    5.139633]  [<ffffffff810334c5>] __bad_area_nosemaphore+0x125/0x1f0
>> [    5.139638]  [<ffffffff81004169>] ? 
>> __raw_callee_save_xen_pmd_val+0x11/0x1e
>> [    5.139641]  [<ffffffff810335a3>] bad_area_nosemaphore+0x13/0x20
>> [    5.139644]  [<ffffffff81033ad5>] do_page_fault+0x2f5/0x490
>> [    5.139648]  [<ffffffff810080df>] ? xen_restore_fl_direct_reloc+0x4/0x4
>> [    5.139652]  [<ffffffff810e2173>] ? __alloc_pages_nodemask+0x113/0x720
>> [    5.139657]  [<ffffffff8133e1aa>] ? trace_hardirqs_off_thunk+0x3a/0x6c
>> [    5.139663]  [<ffffffff817665c5>] page_fault+0x25/0x30
>> [    5.139666]  [<ffffffff8110016e>] ? __tlb_remove_page+0x9e/0xc0
>> [    5.139670]  [<ffffffff81100164>] ? __tlb_remove_page+0x94/0xc0
>> [    5.139673]  [<ffffffff8110086d>] unmap_vmas+0x60d/0x9f0
>> [    5.139677]  [<ffffffff81103a84>] exit_mmap+0xa4/0x150
>> [    5.139680]  [<ffffffff8104f41f>] mmput+0x4f/0xe0
>> [    5.139683]  [<ffffffff811271b6>] flush_old_exec+0x556/0x800
>> [    5.139686]  [<ffffffff8116f4a3>] load_elf_binary+0x323/0x1c60

> .. snip.. Hm, that is definitly bad.

>> [    6.455861] udlfb: Reallocating framebuffer. Addresses will change!
>> [    6.531120] ------------[ cut here ]------------
>> [    6.532810] WARNING: at lib/dma-debug.c:875 check_for_stack+0xad/0xf0()
>> [    6.532810] Hardware name: MS-7640
>> [    6.532810] ehci_hcd 0000:07:01.2: DMA-API: device driver maps memory 
>> fromstack [addr=ffff880023321960]

> Ah, that one reminds of the USB floppy bug. Not a big problem but annoying.

>> [    6.532810] Modules linked in:
>> [    6.532810] Pid: 563, comm: khubd Tainted: G      D     
>> 3.0.0-xen-3.1-konrad-master-20110722+ #1
>> [    6.532810] Call Trace:
>> [    6.532810]  [<ffffffff8105180f>] warn_slowpath_common+0x7f/0xc0
>> [    6.532810]  [<ffffffff81051906>] warn_slowpath_fmt+0x46/0x50
>> [    6.532810]  [<ffffffff813517dd>] check_for_stack+0xad/0xf0
>> [    6.532810]  [<ffffffff81353389>] debug_dma_map_page+0x179/0x1e0
>> [    6.532810]  [<ffffffff814e9a0c>] usb_hcd_map_urb_for_dma+0x5ec/0x6a0
>> [    6.532810]  [<ffffffff814e9c6e>] usb_hcd_submit_urb+0x14e/0x780
>> [    6.532810]  [<ffffffff8110d360>] ? __vmalloc_node_range+0x140/0x1e0
>> [    6.532810]  [<ffffffff813a5e02>] ? dlfb_setup_modes+0x512/0x580
>> [    6.532810]  [<ffffffff814eb365>] usb_submit_urb+0xe5/0x2b0
>> [    6.532810]  [<ffffffff814ecae3>] usb_start_wait_urb+0x63/0x100
>> [    6.532810]  [<ffffffff814eba18>] ? usb_init_urb+0x28/0x40
>> [    6.532810]  [<ffffffff814ecdc8>] usb_control_msg+0xe8/0x120
>> [    6.532810]  [<ffffffff813a7b11>] dlfb_usb_probe+0x441/0x850
>> [    6.532810]  [<ffffffff81765ed9>] ? _raw_spin_unlock_irqrestore+0x69/0x80
>> [    6.532810]  [<ffffffff814eee66>] usb_probe_interface+0x106/0x1c0
>> [    6.532810]  [<ffffffff81426256>] driver_probe_device+0x96/0x1c0
>> [    6.532810]  [<ffffffff81426420>] ? __driver_attach+0xa0/0xa0
>> [    6.532810]  [<ffffffff81426473>] __device_attach+0x53/0x60
>> [    6.532810]  [<ffffffff81425538>] bus_for_each_drv+0x68/0x90
>> [    6.532810]  [<ffffffff81426557>] device_attach+0xa7/0xc0
>> [    6.532810]  [<ffffffff8142530d>] bus_probe_device+0x2d/0x50
>> [    6.532810]  [<ffffffff81423f19>] device_add+0x5f9/0x6d0
>> [    6.532810]  [<ffffffff814edd4e>] usb_set_configuration+0x45e/0x690
>> [    6.532810]  [<ffffffff811917ea>] ? sysfs_do_create_link+0xfa/0x220
>> [    6.532810]  [<ffffffff814f6914>] generic_probe+0x44/0xa0
>> [    6.532810]  [<ffffffff814ee1da>] usb_probe_device+0x1a/0x20
>> [    6.532810]  [<ffffffff81426256>] driver_probe_device+0x96/0x1c0
>> [    6.532810]  [<ffffffff81426420>] ? __driver_attach+0xa0/0xa0
>> [    6.532810]  [<ffffffff81426473>] __device_attach+0x53/0x60
>> [    6.532810]  [<ffffffff81425538>] bus_for_each_drv+0x68/0x90
>> [    6.532810]  [<ffffffff81426557>] device_attach+0xa7/0xc0
>> [    6.532810]  [<ffffffff8142530d>] bus_probe_device+0x2d/0x50
>> [    6.532810]  [<ffffffff81423f19>] device_add+0x5f9/0x6d0
>> [    6.532810]  [<ffffffff814ed8d9>] ? usb_cache_string+0x99/0xb0
>> [    6.532810]  [<ffffffff814e5a27>] usb_new_device+0x167/0x1f0
>> [    6.532810]  [<ffffffff814e72f8>] hub_thread+0xba8/0x1330
>> [    6.532810]  [<ffffffff8176331f>] ? schedule+0x42f/0xa70
>> [    6.532810]  [<ffffffff81074e20>] ? wake_up_bit+0x40/0x40
>> [    6.532810]  [<ffffffff81765ed9>] ? _raw_spin_unlock_irqrestore+0x69/0x80
>> [    6.532810]  [<ffffffff814e6750>] ? hub_probe+0x850/0x850
>> [    6.532810]  [<ffffffff814e6750>] ? hub_probe+0x850/0x850
>> [    6.532810]  [<ffffffff810748d6>] kthread+0x96/0xa0
>> [    6.532810]  [<ffffffff81767a64>] kernel_thread_helper+0x4/0x10
>> [    6.532810]  [<ffffffff81766341>] ? retint_restore_args+0x13/0x13
>> [    6.532810]  [<ffffffff81767a60>] ? gs_change+0x13/0x13
>> [    6.532810] ---[ end trace 09caa95ef959351a ]---
>> 
>> 
>> 
>> 
>> [   29.224385] em28xx #0: Identified as Pinnacle PCTV USB 2 (card=3)
>> [   29.233168] BUG: unable to handle kernel paging request at 
>> ffff880020221000
>> [   29.236056] IP: [<ffffffff8110016e>] __tlb_remove_page+0x9e/0xc0

> And this is even worst..

>> [   29.244097] PGD 1a4e067 PUD 1a52067 PMD 2ff67067 PTE 8010000020221064
>> [   29.244097] Oops: 0002 [#3] SMP DEBUG_PAGEALLOC
>> [   29.256140] CPU 5 
>> [   29.256140] Modules linked in:
>> [   29.256140] 
>> [   29.256140] Pid: 1785, comm: modprobe Tainted: G      D W   
>> 3.0.0-xen-3.1-konrad-master-20110722+ #1 MSI MS-7640/890F
>> XA-GD70 (MS-7640)  
>> [   29.256140] RIP: e030:[<ffffffff8110016e>]  [<ffffffff8110016e>] 
>> __tlb_remove_page+0x9e/0xc0
>> [   29.256140] RSP: e02b:ffff88002024fc38  EFLAGS: 00010286
>> [   29.256140] RAX: 0000000000000000 RBX: ffff88002024fd98 RCX: 
>> ffff880020221000
>> [   29.256140] RDX: ffff880020221000 RSI: ffff88002f0f8000 RDI: 
>> 0000000000000000
>> [   29.256140] RBP: ffff88002024fc48 R08: 00003ffffffff000 R09: 
>> ffff880000000000
>> [   29.256140] R10: 0000000000000000 R11: ffffffff81af32d0 R12: 
>> 0000000000407000
>> [   29.256140] R13: ffff88002876c3c8 R14: ffff88002024fd48 R15: 
>> ffff8800200c4680
>> [   29.256140] FS:  00007f3469119700(0000) GS:ffff88002f0a8000(0000) 
>> knlGS:0000000000000000
>> [   29.256140] CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
>> [   29.256140] CR2: ffff880020221000 CR3: 0000000001a4d000 CR4: 
>> 0000000000000660
>> [   29.256140] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 
>> 0000000000000000
>> [   29.256140] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 
>> 0000000000000400
>> [   29.256140] Process modprobe (pid: 1785, threadinfo ffff88002024e000, 
>> task ffff880023318000)
>> [   29.256140] Stack:
>> [   29.256140]  0000000000000006 ffff8800201c7038 ffff88002024fd88 
>> ffffffff8110086d
>> [   29.256140]  ffffffff810080f2 0000000000000246 0000000000000000 
>> 0000000000000000
>> [   29.256140]  ffffffff81afcce8 ffff88002024fe00 0000000000000000 
>> ffff8800200c4680
>> [   29.256140] Call Trace:
>> [   29.256140]  [<ffffffff8110086d>] unmap_vmas+0x60d/0x9f0
>> [   29.256140]  [<ffffffff810080f2>] ? check_events+0x12/0x20
>> [   29.256140]  [<ffffffff81103a84>] exit_mmap+0xa4/0x150
>> [   29.256140]  [<ffffffff8104f41f>] mmput+0x4f/0xe0
>> [   29.256140]  [<ffffffff81053e01>] exit_mm+0x131/0x170
>> [   29.256140]  [<ffffffff81055c04>] do_exit+0x174/0x860
>> [   29.256140]  [<ffffffff8111ba30>] ? kmem_cache_free+0x20/0x130
>> [   29.256140]  [<ffffffff81056345>] do_group_exit+0x55/0xf0
>> [   29.256140]  [<ffffffff810563f7>] sys_exit_group+0x17/0x20
>> [   29.256140]  [<ffffffff81766c42>] system_call_fastpath+0x16/0x1b
>> [   29.256140] Code: e8 68 f2 00 00 48 83 c4 08 b8 01 00 00 00 5b c9 c3 0f 
>> 1f 40 00 31 f6 bf 00 02 00 00 e8 cc 26 fe ff 
>> 48 89 c1 31 c0 48 85 c9 74 a2 
>> [   29.256140]  c7 01 00 00 00 00 c7 41 08 00 00 00 00 c7 41 0c fe 01 00 00 
>> [   29.256140] RIP  [<ffffffff8110016e>] __tlb_remove_page+0x9e/0xc0
>> [   29.256140]  RSP <ffff88002024fc38>
>> [   29.256140] CR2: ffff880020221000
>> [   29.256140] ---[ end trace 09caa95ef959351b ]---
>> [   29.256140] Fixing recursive fault but reboot is needed!

>> 
>> \  // _ \ '_ \  || |_ | | | |
>>    \  __/ | | | |   _|| |_| |
>>  /\_\___|_| |_|   _|(_)_(_)_|
>>                              
>> (XENXen version 4.1.(root@xxxxxxxxxx(gcc version 4.4 (Debian 4.4.5-8) Thu 
>> Jun 16 11::46 CEST 2011
>> (N) Latest Changet: Tue Jun 14 142:48 2011 +0100 079:73a8061b01f1(XEN) 
>> BootloaderGRUB 1.98+201008-14
>> (XEN) Comma line: dom0_mem=8M loglvl=all lovl_guest=all conle_timestamps 
>> vga=gfx-1280x1024x3cpuidle cpufreq=n noreboot d
>> ebugapic=debug apic_rbosity=debug ap=debug acpi_enfoe_resources=lax 
>> mmu=on,amd-iommuebug amd_iommu=oamd-iommu-debug m1=1
>> 15200,8n1 coole=vga,com1

> <blinks>

> dom0_mem=8M? Ah looks like your serial console is being eaten up. N/m then.

yes unfortunately that happens, haven't figured out why ...

Attachment: dotconfig
Description: Binary data

Attachment: lspci.txt
Description: Text document

Attachment: lsusb.txt
Description: Text document

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel