[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [Xen-devel] Xen with dom0 pvops on ultra-recent "git tip" kernel on x86_64
Hi everyone, I am very excited to see that dom0 pvops is finally coming close to working, so I wanted to give it a try. >From the description it was not clear to me which kernel to chose as base for the patches.hg, so I took the latest (that was ~ 2 weeks ago) kernel on git.kernel.org I could find (post-2.6.28 git tip at that point). I managed to more or less apply all of the patches in the patches.hg series file (some where already applied upstream). It also needed some minor fixes (for instance arch/x86/pci/pci.h got moved to arch/x86/include/asm/pci_x86.h, so rather trivial things). However, I got none of the kernels to boot. Every time it dies in what looks like the first context switch (I guess), every time somewhere in the scheduler shortly after doing the low-level switching stuff. This happens for both SMP and UP kernels (however, in different places). For the SMP kernel I saw a crash in "task_tick_fair", on the UP kernel in the arch code __switch_to somewhere around the unlazy_fpu() call (a bit confusing due to the heavy inlining). In yet another version I have "preempt_schedule" directly on the stack, it's not clear where it crashes, since I don't even get a kernel trace. Sometimes the crash would be due to a memory access into Nirvana land (while trying to get a per_cpu variable) and another time jumping to the null pointer. I have to say that except for looking a bit at it I have no clue what might be going wrong. It seems like the context switch is messed up and therefore things go wonky quickly after. The same kernel works fine with KVM paravirt or on bare metal. It always crashes directly after "ACPI: Core revision 20080926" (sometimes with a Bug beforehand, sometimes with a few Kernel oopses before XEN declares the dom0 as dead). It doesn't seem to have anything to do with ACPI however. I have my kernel in a local git area (all patches.hg patches as individual git commits, as well as my personal fixes), in case someone is interested. So my question: Am I missing something here? Or is this known to now work or has not yet been looked at? Any idea what is happening? Thank you, Christophe kvm -hda /data/store/tmp -no-kvm -nographic (yes, I am playing with Qemu, but it gives the same effect when booting it natively) __ __ _____ _ _ _ _ _ \ \/ /___ _ __ |___ /| || | _ _ _ __ ___| |_ __ _| |__ | | ___ \ // _ \ '_ \ |_ \| || |_ __| | | | '_ \/ __| __/ _` | '_ \| |/ _ \ / \ __/ | | | ___) |__ _|__| |_| | | | \__ \ || (_| | |_) | | __/ /_/\_\___|_| |_| |____(_) |_| \__,_|_| |_|___/\__\__,_|_.__/|_|\___| (XEN) Xen version 3.4-unstable (chtephan@xxxxxxxxxxxxxxx) (gcc-Treiberversion 4.3.2 (Gentoo 4.3.2 p0.2, pie-8.7.9) fÃhrt GCC-Version 4.4.0-alpha20090109 aus) Sat Jan 10 18:05:59 CET 2009 (XEN) Latest ChangeSet: Fri Jan 09 16:56:54 2009 +0000 19024:b999142bca8c (XEN) Command line: console=com1,vga com1=9600,8n1 (XEN) Video information: (XEN) VGA is text mode 80x25, font 8x16 (XEN) Disc information: (XEN) Found 1 MBR signatures (XEN) Found 1 EDD information structures (XEN) Xen-e820 RAM map: (XEN) 0000000000000000 - 000000000009fc00 (usable) (XEN) 000000000009fc00 - 00000000000a0000 (reserved) (XEN) 00000000000e8000 - 0000000000100000 (reserved) (XEN) 0000000000100000 - 0000000007ff0000 (usable) (XEN) 0000000007ff0000 - 0000000008000000 (ACPI data) (XEN) 00000000fffbd000 - 0000000100000000 (reserved) (XEN) System RAM: 127MB (130620kB) (XEN) ACPI: RSDP 000FBC80, 0014 (r0 QEMU ) (XEN) ACPI: RSDT 07FF0000, 002C (r1 QEMU QEMURSDT 1 QEMU 1) (XEN) ACPI: FACP 07FF002C, 0074 (r1 QEMU QEMUFACP 1 QEMU 1) (XEN) ACPI: DSDT 07FF0100, 24A4 (r1 BXPC BXDSDT 1 INTL 20061109) (XEN) ACPI: FACS 07FF00C0, 0040 (XEN) ACPI: APIC 07FF25A8, 00E0 (r1 QEMU QEMUAPIC 1 QEMU 1) (XEN) Xen heap: 14MB (14676kB) (XEN) Domain heap initialised (XEN) Processor #0 6:2 APIC version 17 (XEN) IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23 (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) Detected 1996.258 MHz processor. (XEN) AMD SVM: ASIDs disabled. (XEN) HVM: SVM enabled (XEN) CPU0: AMD QEMU Virtual CPU version 0.9.1 stepping 03 (XEN) Total of 1 processors activated. (XEN) ENABLING IO-APIC IRQs (XEN) -> Using new ACK method (XEN) Platform timer is 3.579MHz ACPI PM Timer (XEN) Brought up 1 CPUs (XEN) I/O virtualisation disabled (XEN) *** LOADING DOMAIN 0 *** (XEN) Xen kernel: 64-bit, lsb, compat32 (XEN) Dom0 kernel: 64-bit, PAE, lsb, paddr 0x200000 -> 0xadb3d4 (XEN) PHYSICAL MEMORY ARRANGEMENT: (XEN) Dom0 alloc.: 0000000004000000->0000000005000000 (21254 pages to be allocated) (XEN) VIRTUAL MEMORY ARRANGEMENT: (XEN) Loaded kernel: ffffffff80200000->ffffffff80adb3d4 (XEN) Init. ramdisk: ffffffff80adc000->ffffffff80adc000 (XEN) Phys-Mach map: ffffffff80adc000->ffffffff80b0d830 (XEN) Start info: ffffffff80b0e000->ffffffff80b0e4b4 (XEN) Page tables: ffffffff80b0f000->ffffffff80b18000 (XEN) Boot stack: ffffffff80b18000->ffffffff80b19000 (XEN) TOTAL: ffffffff80000000->ffffffff80c00000 (XEN) ENTRY ADDRESS: ffffffff8086f200 (XEN) Dom0 has maximum 1 VCPUs (XEN) Scrubbing Free RAM: done. (XEN) Xen trace buffers: disabled (XEN) Std. Loglevel: Errors and warnings (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings) (XEN) Xen is relinquishing VGA console. (XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen) (XEN) Freed 116kB init memory. mapping kernel into physical memory Xen: setup ISA identity maps about to get started... PAT disabled on Xen Linux version 2.6.29-rc0-xen-cs1-dirty (chtephan@leto) (gcc driver version 4.3.2 (Gentoo 4.3.2 p0.2, pie-8.7.9) executing gcc version 4.4.0-alpha20090109) #1 PREEMPT Sat Jan 10 17:44:29 CET 2009 Command line: console=tty0 xencons=ttyS0,115200 console=hvc0 earlyprintk=xen root=/dev/vg/root ro nopat noacpi KERNEL supported cpus: Intel GenuineIntel AMD AuthenticAMD Centaur CentaurHauls BIOS-provided physical RAM map: Xen: 0000000000000000 - 000000000009fc00 (usable) Xen: 000000000009fc00 - 0000000000100000 (reserved) Xen: 0000000000100000 - 0000000000adc000 (usable) Xen: 0000000000adc000 - 0000000000b0f000 (reserved) Xen: 0000000000b0f000 - 0000000006306000 (usable) Xen: 0000000007ff0000 - 0000000008000000 (ACPI data) Xen: 00000000fffbd000 - 0000000100000000 (reserved) console [xenboot0] enabled PAT support disabled. DMI 2.4 present. last_pfn = 0x6306 max_arch_pfn = 0x100000000 init_memory_mapping: 0000000000000000-0000000006306000 last_map_addr: 6306000 end: 6306000 ACPI: RSDP 000FBC80, 0014 (r0 QEMU ) ACPI: RSDT 07FF0000, 002C (r1 QEMU QEMURSDT 1 QEMU 1) ACPI: FACP 07FF002C, 0074 (r1 QEMU QEMUFACP 1 QEMU 1) ACPI: DSDT 07FF0100, 24A4 (r1 BXPC BXDSDT 1 INTL 20061109) ACPI: FACS 07FF00C0, 0040 ACPI: APIC 07FF25A8, 00E0 (r1 QEMU QEMUAPIC 1 QEMU 1) (5 early reservations) ==> bootmem [0000000000 - 0006306000] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000] #1 [0000b0f000 - 0000b18000] XEN PAGETABLES ==> [0000b0f000 - 0000b18000] #2 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000] #3 [0000200000 - 0000adb3d4] TEXT DATA BSS ==> [0000200000 - 0000adb3d4] #4 [0000008000 - 0000030000] PGTABLE ==> [0000008000 - 0000030000] found SMP MP-table at [ffff8800000fbb60] 000fbb60 Zone PFN ranges: DMA 0x00000000 -> 0x00001000 DMA32 0x00001000 -> 0x00100000 Normal 0x00100000 -> 0x00100000 Movable zone start PFN for each node early_node_map[3] active PFN ranges 0: 0x00000000 -> 0x0000009f 0: 0x00000100 -> 0x00000adc 0: 0x00000b0f -> 0x00006306 ACPI: PM-Timer IO Port: 0xb008 ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] disabled) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] disabled) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] disabled) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] disabled) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] disabled) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] disabled) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] disabled) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x08] disabled) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x09] disabled) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x0a] disabled) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x0b] disabled) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x0c] disabled) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x0d] disabled) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x0e] disabled) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x0f] disabled) ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0]) IOAPIC[0]: apic_id 1, version 0, address 0xfec00000, GSI 0-23 ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) Using ACPI (MADT) for SMP configuration information (XEN) ioapic_guest_write: apic=0, pin=0, old_irq=0, new_irq=-1 (XEN) ioapic_guest_write: old_entry=000009f0, new_entry=00010900 (XEN) ioapic_guest_write: Attempt to remove IO-APIC pin of in-use IRQ! (XEN) ioapic_guest_write: apic=0, pin=4, old_irq=4, new_irq=-1 (XEN) ioapic_guest_write: old_entry=000009f1, new_entry=00010900 (XEN) ioapic_guest_write: Attempt to remove IO-APIC pin of in-use IRQ! PM: Registered nosave memory: 000000000009f000 - 00000000000a0000 PM: Registered nosave memory: 00000000000a0000 - 0000000000100000 PM: Registered nosave memory: 0000000000adc000 - 0000000000b0f000 Allocating PCI resources starting at 10000000 (gap: 8000000:f7fbd000) Built 1 zonelists in Zone order, mobility grouping on. Total pages: 22534 Kernel command line: console=tty0 xencons=ttyS0,115200 console=hvc0 earlyprintk=xen root=/dev/vg/root ro nopat noacpi Initializing CPU#0 xen: allocated irq 9 for acpi 9 PID hash table entries: 512 (order: 9, 4096 bytes) Detected 1996.258 MHz processor. Console: colour VGA+ 80x25 console [tty0] enabled PAT disabled on Xen Linux version 2.6.29-rc0-xen-cs1-dirty (chtephan@leto) (gcc driver version 4.3.2 (Gentoo 4.3.2 p0.2, pie-8.7.9) executing gcc version 4.4.0-alpha20090109) #1 PREEMPT Sat Jan 10 17:44:29 CET 2009 Command line: console=tty0 xencons=ttyS0,115200 console=hvc0 earlyprintk=xen root=/dev/vg/root ro nopat noacpi KERNEL supported cpus: Intel GenuineIntel AMD AuthenticAMD Centaur CentaurHauls BIOS-provided physical RAM map: Xen: 0000000000000000 - 000000000009fc00 (usable) Xen: 000000000009fc00 - 0000000000100000 (reserved) Xen: 0000000000100000 - 0000000000adc000 (usable) Xen: 0000000000adc000 - 0000000000b0f000 (reserved) Xen: 0000000000b0f000 - 0000000006306000 (usable) Xen: 0000000007ff0000 - 0000000008000000 (ACPI data) Xen: 00000000fffbd000 - 0000000100000000 (reserved) console [xenboot0] enabled PAT support disabled. DMI 2.4 present. last_pfn = 0x6306 max_arch_pfn = 0x100000000 init_memory_mapping: 0000000000000000-0000000006306000 last_map_addr: 6306000 end: 6306000 ACPI: RSDP 000FBC80, 0014 (r0 QEMU ) ACPI: RSDT 07FF0000, 002C (r1 QEMU QEMURSDT 1 QEMU 1) ACPI: FACP 07FF002C, 0074 (r1 QEMU QEMUFACP 1 QEMU 1) ACPI: DSDT 07FF0100, 24A4 (r1 BXPC BXDSDT 1 INTL 20061109) ACPI: FACS 07FF00C0, 0040 ACPI: APIC 07FF25A8, 00E0 (r1 QEMU QEMUAPIC 1 QEMU 1) (5 early reservations) ==> bootmem [0000000000 - 0006306000] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000] #1 [0000b0f000 - 0000b18000] XEN PAGETABLES ==> [0000b0f000 - 0000b18000] #2 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000] #3 [0000200000 - 0000adb3d4] TEXT DATA BSS ==> [0000200000 - 0000adb3d4] #4 [0000008000 - 0000030000] PGTABLE ==> [0000008000 - 0000030000] found SMP MP-table at [ffff8800000fbb60] 000fbb60 Zone PFN ranges: DMA 0x00000000 -> 0x00001000 DMA32 0x00001000 -> 0x00100000 Normal 0x00100000 -> 0x00100000 Movable zone start PFN for each node early_node_map[3] active PFN ranges 0: 0x00000000 -> 0x0000009f 0: 0x00000100 -> 0x00000adc 0: 0x00000b0f -> 0x00006306 ACPI: PM-Timer IO Port: 0xb008 ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] disabled) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] disabled) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] disabled) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] disabled) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] disabled) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] disabled) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] disabled) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x08] disabled) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x09] disabled) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x0a] disabled) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x0b] disabled) ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x0c] disabled) ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x0d] disabled) ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x0e] disabled) ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x0f] disabled) ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0]) IOAPIC[0]: apic_id 1, version 0, address 0xfec00000, GSI 0-23 ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) Using ACPI (MADT) for SMP configuration information PM: Registered nosave memory: 000000000009f000 - 00000000000a0000 PM: Registered nosave memory: 00000000000a0000 - 0000000000100000 PM: Registered nosave memory: 0000000000adc000 - 0000000000b0f000 Allocating PCI resources starting at 10000000 (gap: 8000000:f7fbd000) Built 1 zonelists in Zone order, mobility grouping on. Total pages: 22534 Kernel command line: console=tty0 xencons=ttyS0,115200 console=hvc0 earlyprintk=xen root=/dev/vg/root ro nopat noacpi Initializing CPU#0 xen: allocated irq 9 for acpi 9 PID hash table entries: 512 (order: 9, 4096 bytes) Detected 1996.258 MHz processor. Console: colour VGA+ 80x25 console [tty0] enabled console handover: boot [xenboot0] -> real [hvc0] Dentry cache hash table entries: 16384 (order: 5, 131072 bytes) Inode-cache hash table entries: 8192 (order: 4, 65536 bytes) Checking aperture... No AGP bridge found PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Placing 64MB software IO TLB between ffff8800012c5000 - ffff8800052c5000 software IO TLB at phys 0x12c5000 - 0x52c5000 Memory: 23464k/101400k available (4673k kernel code, 592k absent, 77280k reserved, 1715k data, 1592k init) SLUB: Genslabs=12, HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1 installing Xen timer for CPU 0 Calibrating delay loop (skipped), value calculated using timer frequency.. 3994.87 BogoMIPS (lpj=6654193) Mount-cache hash table entries: 256 CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line) CPU: L2 Cache: 512K (64 bytes/line) CPU: AMD QEMU Virtual CPU version 0.9.1 stepping 03 (XEN) domain.c:493:d0 Attempt to change CR4 flags 00000660 -> 00000620 ACPI: Core revision 20080926 BUG: scheduling while atomic: kthreadd/2/0x00000000 (XEN) domain_crash_sync called from entry.S (XEN) Domain 0 (vcpu#0) crashed on cpu#0: (XEN) ----[ Xen-3.4-unstable x86_64 debug=n Not tainted ]---- (XEN) CPU: 0 (XEN) RIP: e033:[<ffffffff806868bd>] (XEN) RFLAGS: 0000000000000246 EM: 0 CONTEXT: pv guest (XEN) rax: ffff880005c39fd8 rbx: ffffffffff517000 rcx: 00000000ffffffff (XEN) rdx: 00000000ffffffff rsi: 00000000000017dd rdi: 0000000000000000 (XEN) rbp: 0000000000000000 rsp: ffff880005c23ee0 r8: 0000000000000000 (XEN) r9: 0000000000000001 r10: 0000000000000000 r11: ffffffff8041f5b0 (XEN) r12: ffffffff80a8aa77 r13: 0000000000000037 r14: 0000000000000800 (XEN) r15: ffff880005c37e90 cr0: 000000008005003b cr4: 00000000000006f0 (XEN) cr3: 0000000004201000 cr2: 0000000000000000 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e02b cs: e033 (XEN) Guest stack trace from rsp=ffff880005c23ee0: (XEN) 0000000000000000 0000000000000000 ffffffff8020fb30 ffffffffff517000 (XEN) ffffffff806868c7 0000000000000000 0000000000000000 ffffffff8020fb30 (XEN) ffffffffff517000 ffffffff806868c7 0000000000000000 0000000000000000 (XEN) ffffffff8020fb30 ffffffffff517000 ffffffff806868c7 0000000000000000 (XEN) 0000000000000000 ffffffff8020fb30 ffffffffff517000 ffffffff806868c7 (XEN) 0000000000000000 0000000000000000 ffffffff8020fb30 ffffffffff517000 (XEN) ffffffff806868c7 0000000000000000 0000000000000000 ffffffff8020fb30 (XEN) ffffffffff517000 ffffffff806868c7 0000000000000000 0000000000000000 (XEN) ffffffff8020fb30 ffffffffff517000 ffffffff806868c7 0000000000000000 (XEN) ffff880005c24030 ffffffff8020fb30 ffffffffff517000 ffffffff806868c3 (XEN) 0000000000000000 0000000000000000 ffffffff8020fb30 ffffffffff517000 (XEN) ffffffff806868c3 0000000000000000 0000000000000001 ffffffff8020fb30 (XEN) ffffffffff517000 ffffffff806868c3 0000000000000000 0000000000000000 (XEN) ffffffff8020fb30 ffffffffff517000 ffffffff806868c3 0000000000000000 (XEN) 0000000000000000 ffffffff8020fb30 ffffffffff517000 ffffffff806868c3 (XEN) 0000000000000000 6c754e0068737570 ffffffff8020fb30 ffffffffff517000 (XEN) ffffffff806868c3 0000000000000000 ffff880005c24120 ffffffff8020fb30 (XEN) ffffffffff517000 ffffffff806868c3 0000000000000000 20726f6620657461 (XEN) ffffffff8020fb30 ffffffffff517000 ffffffff806868c3 0000000000000000 (XEN) 7461745320217974 ffffffff8020fb30 ffffffffff517000 ffffffff806868c3 (XEN) Domain 0 crashed: rebooting machine in 5 seconds. _______________________________________________ Xen-devel mailing list Xen-devel@xxxxxxxxxxxxxxxxxxx http://lists.xensource.com/xen-devel
|
Lists.xenproject.org is hosted with RackSpace, monitoring our |