[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-devel] domU boot time Oops: 0000 [#1] SMP with backtrace

To: Konrad Rzeszutek Wilk <konrad.wilk@xxxxxxxxxx>
From: Bruce Edge <bruce.edge@xxxxxxxxx>
Date: Mon, 21 Jun 2010 09:50:30 -0700
Cc: xen-devel@xxxxxxxxxxxxxxxxxxx, stefano.stabellini@xxxxxxxxxxxxx
Delivery-date: Mon, 21 Jun 2010 09:51:39 -0700
Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=fXfXSOcv/JH9tbZyj48CxDFeexfNEQLc/E6H35EVktvN0MZCv09S5pbgdyNIyKcmN+ L5DjLuufSqf16SO+EYXsUNaAYFfVK2go/Boyr3NRIYzFLgL3DOQUnhFpx/WlYPDqlWYI b7f5uFjOgqe5IWQqpz6yJLZ6Drm0jPYS6VBDM=
List-id: Xen developer discussion <xen-devel.lists.xensource.com>

On Mon, Jun 21, 2010 at 7:44 AM, Konrad Rzeszutek Wilk <konrad.wilk@xxxxxxxxxx> wrote:

On Sat, Jun 19, 2010 at 06:37:41PM +0300, Pasi Kärkkäinen wrote:
> On Sat, Jun 19, 2010 at 07:19:32AM -0700, Bruce Edge wrote:
> > This is a 2.6.32x pv-ops with essentially pasi's config, modified enough
> > to get past the
> > [1]http://old.nabble.com/Re:--Xen-users--xen-stable-2.6.32.x-compilation-failure-in-do_hvm_suspend()-td28550826.html
> > problem
> >
>
> The latest example .config should work without modifications:
> http://pasik.reaktio.net/xen/pv_ops-dom0-debug/config-2.6.32.15-pvops-dom0-xen-stable-x86_64

Just to make sure this is not Stefano's code.. can you turn
CONFIG_XEN_PLATFORM_PCI=y to
# CONFIG_XEN_PLATFORM_PCI is not set

Essentially the same thing. Here's the domU console log. I've attached the .config. Both dom0 and domU are running this kernel.

Started domain dpm (id=3)

Initializing cgroup subsys cpuset

Initializing cgroup subsys cpu

Linux version 2.6.32.15 (root@kaan) (gcc version 4.3.3 (Ubuntu 4.3.3-5ubuntu4) ) #1 SMP Mon Jun 21 08:52:17 PDT 2010

Command line: BOOT_IMAGE=/boot/vmlinuz-2.6.32.15 root=/dev/sda1 ro bigphysarea=128000 kdb=on nmi_watchdog=1 init_cpus=0 console=ttyS0,115200n8 selinux=0 cgroup_disable=memory

KERNEL supported cpus:

Intel GenuineIntel

AMD AuthenticAMD

Centaur CentaurHauls

BIOS-provided physical RAM map:

BIOS-e820: 0000000000000000 - 000000000009fc00 (usable)

BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved)

BIOS-e820: 00000000000e0000 - 0000000000100000 (reserved)

BIOS-e820: 0000000000100000 - 00000000c0000000 (usable)

BIOS-e820: 00000000fc000000 - 0000000100000000 (reserved)

DMI 2.4 present.

last_pfn = 0xc0000 max_arch_pfn = 0x400000000

x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106

init_memory_mapping: 0000000000000000-00000000c0000000

RAMDISK: 346ec000 - 37fef22c

ACPI: RSDP 00000000000ea020 00024 (v02 Xen)

ACPI: XSDT 00000000fc012cb0 00034 (v01 Xen HVM 00000000 HVML 00000000)

ACPI: FACP 00000000fc012ad0 000F4 (v04 Xen HVM 00000000 HVML 00000000)

ACPI: DSDT 00000000fc002c40 0FE0B (v02 Xen HVM 00000000 INTL 20081204)

ACPI: FACS 00000000fc002c00 00040

ACPI: APIC 00000000fc012bd0 000D8 (v02 Xen HVM 00000000 HVML 00000000)

No NUMA configuration found

Faking a node at 0000000000000000-00000000c0000000

Bootmem setup node 0 0000000000000000-00000000c0000000

NODE_DATA [000000000000a000 - 0000000000021fff]

bootmap [0000000000022000 - 0000000000039fff] pages 18

(7 early reservations) ==> bootmem [0000000000 - 00c0000000]

#0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000]

#1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000]

#2 [0001000000 - 00026b58b8] TEXT DATA BSS ==> [0001000000 - 00026b58b8]

#3 [00346ec000 - 0037fef22c] RAMDISK ==> [00346ec000 - 0037fef22c]

#4 [000009fc00 - 0000100000] BIOS reserved ==> [000009fc00 - 0000100000]

#5 [00026b6000 - 00026b60a1] BRK ==> [00026b6000 - 00026b60a1]

#6 [0000008000 - 000000a000] PGTABLE ==> [0000008000 - 000000a000]

found SMP MP-table at [ffff8800000fbd60] fbd60

Zone PFN ranges:

DMA 0x00000000 -> 0x00001000

DMA32 0x00001000 -> 0x00100000

Normal 0x00100000 -> 0x00100000

Movable zone start PFN for each node

early_node_map[2] active PFN ranges

0: 0x00000000 -> 0x0000009f

0: 0x00000100 -> 0x000c0000

ACPI: PM-Timer IO Port: 0x1f48

ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)

ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)

ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)

ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)

ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)

ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)

ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)

ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)

ACPI: LAPIC (acpi_id[0x08] lapic_id[0x10] enabled)

ACPI: LAPIC (acpi_id[0x09] lapic_id[0x12] enabled)

ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x14] enabled)

ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x16] enabled)

ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x18] enabled)

ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x1a] enabled)

ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x1c] enabled)

ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])

IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-47

ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)

ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level)

ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level)

ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level)

Using ACPI (MADT) for SMP configuration information

SMP: Allowing 15 CPUs, 0 hotplug CPUs

Xen version 4.0.

PM: Registered nosave memory: 000000000009f000 - 00000000000a0000

PM: Registered nosave memory: 00000000000a0000 - 00000000000e0000

PM: Registered nosave memory: 00000000000e0000 - 0000000000100000

Allocating PCI resources starting at c0000000 (gap: c0000000:3c000000)

Booting paravirtualized kernel on Xen

NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:15 nr_node_ids:1

PERCPU: Embedded 478 pages/cpu @ffff880007a00000 s1927128 r8192 d22568 u2097152

pcpu-alloc: s1927128 r8192 d22568 u2097152 alloc=1*2097152

pcpu-alloc: [0] 00 [0] 01 [0] 02 [0] 03 [0] 04 [0] 05 [0] 06 [0] 07

pcpu-alloc: [0] 08 [0] 09 [0] 10 [0] 11 [0] 12 [0] 13 [0] 14

Built 1 zonelists in Node order, mobility grouping on. Total pages: 766266

Policy zone: DMA32

Kernel command line: BOOT_IMAGE=/boot/vmlinuz-2.6.32.15 root=/dev/sda1 ro bigphysarea=128000 kdb=on nmi_watchdog=1 init_cpus=0 console=ttyS0,115200n8 selinux=0 cgroup_disable=memory

init_cpus[0]=1

setting init process cpumask to 81759470

Disabling memory control group subsystem

PID hash table entries: 4096 (order: 3, 32768 bytes)

Initializing CPU#0

Checking aperture...

No AGP bridge found

Memory: 2954612k/3145728k available (4742k kernel code, 388k absent, 190728k reserved, 3548k data, 3380k init)

SLUB: Genslabs=14, HWalign=64, Order=0-3, MinObjects=0, CPUs=15, Nodes=1

Hierarchical RCU implementation.

NR_IRQS:4352 nr_irqs:936

xen map irq failed -38

ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)

ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level)

ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level)

ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level)

Console: colour VGA+ 80x25

console [ttyS0] enabled

... MAX_LOCKDEP_SUBCLASSES: 8

... MAX_LOCK_DEPTH: 48

... MAX_LOCKDEP_KEYS: 8191

... CLASSHASH_SIZE: 4096

... MAX_LOCKDEP_ENTRIES: 16384

... MAX_LOCKDEP_CHAINS: 32768

... CHAINHASH_SIZE: 16384

memory used by lock dependency info: 6367 kB

per task-struct memory footprint: 2688 bytes

Fast TSC calibration using PIT

Detected 2533.498 MHz processor.

Calibrating delay loop (skipped), value calculated using timer frequency.. 5066.99 BogoMIPS (lpj=2533498)

Security Framework initialized

SELinux: Disabled at boot.

Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)

Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)

Mount-cache hash table entries: 256

Initializing cgroup subsys ns

Initializing cgroup subsys cpuacct

Initializing cgroup subsys memory

Initializing cgroup subsys devices

Initializing cgroup subsys freezer

Initializing cgroup subsys net_cls

CPU: L1 I cache: 32K, L1 D cache: 32K

CPU: L2 cache: 256K

CPU: L3 cache: 8192K

CPU 0/0x0 -> Node 0

CPU: Unsupported number of siblings 32

mce: CPU supports 9 MCE banks

Performance Events: unsupported p6 CPU model 26 no PMU driver, software events only.

ACPI: Core revision 20090903

ftrace: converting mcount calls to 0f 1f 44 00 00

ftrace: allocating 24134 entries in 95 pages

Setting APIC routing to physical flat

BUG: unable to handle kernel NULL pointer dereference at (null)

IP: [<ffffffff8102b8e2>] add_pin_to_irq_node_nopanic+0x10/0x81

PGD 0

Oops: 0000 [#1] SMP

last sysfs file:

CPU 0

Modules linked in:

Pid: 1, comm: swapper Not tainted 2.6.32.15 #1 HVM domU

RIP: 0010:[<ffffffff8102b8e2>] [<ffffffff8102b8e2>] add_pin_to_irq_node_nopanic+0x10/0x81

RSP: 0018:ffff8800bfbc9de0 EFLAGS: 00010282

RAX: ffffffff81737480 RBX: 0000000000000005 RCX: 0000000000000001

RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000

RBP: ffff8800bfbc9e00 R08: ffff8800bfbc9e00 R09: 0000000000000046

R10: ffff8800bfbc0000 R11: ffff8800bfbc9e00 R12: ffffffff81737480

R13: 0000000000000001 R14: 0000000000000001 R15: 0000000000000000

FS: 0000000000000000(0000) GS:ffff880007a00000(0000) knlGS:0000000000000000

CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b

CR2: 0000000000000000 CR3: 0000000001001000 CR4: 00000000000006f0

DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000

DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400

Process swapper (pid: 1, threadinfo ffff8800bfbc8000, task ffff8800bfbc0000)

Stack:

0000000000000005 ffffffff81737480 0000000000000001 0000000000000001

<0> ffff8800bfbc9e10 ffffffff8102c855 ffff8800bfbc9e60 ffffffff81a0322b

<0> 0000000000000000 000000000000002f 0000000000000000 0000000000000000

Call Trace:

[<ffffffff8102c855>] add_pin_to_irq_node+0xe/0x22

[<ffffffff81a0322b>] setup_IO_APIC_irqs+0x1a4/0x22d

[<ffffffff81a032f7>] setup_IO_APIC+0x43/0xc5

[<ffffffff819fe9a4>] native_smp_prepare_cpus+0x1d7/0x233

[<ffffffff819f1772>] kernel_init+0x75/0x194

[<ffffffff81013faa>] child_rip+0xa/0x20

[<ffffffff81013910>] ? restore_args+0x0/0x30

[<ffffffff819f16fd>] ? kernel_init+0x0/0x194

[<ffffffff81013fa0>] ? child_rip+0x0/0x20

Code: 41 5b 5b c9 c3 55 48 89 e5 0f 1f 44 00 00 81 ce 00 80 00 00 e8 ea 61 0f 00 c9 c3 55 48 89 e5 41 56 41 55 41 54 53 0f 1f 44 00 00 <48> 8b 07 41 89 f6 41 89 d5 41 89 cc 48 89 fb eb 13 44 39 28 75

RIP [<ffffffff8102b8e2>] add_pin_to_irq_node_nopanic+0x10/0x81

RSP <ffff8800bfbc9de0>

CR2: 0000000000000000

---[ end trace a7919e7f17c0a725 ]---

swapper used greatest stack depth: 4744 bytes left

Kernel panic - not syncing: Attempted to kill init!

Pid: 1, comm: swapper Tainted: G D 2.6.32.15 #1

Call Trace:

[<ffffffff81497e39>] panic+0xa5/0x167

[<ffffffff8106056c>] ? forget_original_parent+0x8f/0x2b4

[<ffffffff81060513>] ? forget_original_parent+0x36/0x2b4

[<ffffffff8106056c>] ? forget_original_parent+0x8f/0x2b4

[<ffffffff8108e9e5>] ? trace_hardirqs_on+0xd/0xf

[<ffffffff8149a483>] ? _write_unlock_irq+0x30/0x3c

[<ffffffff81060583>] forget_original_parent+0xa6/0x2b4

[<ffffffff810607a7>] exit_notify+0x16/0x140

[<ffffffff81060bf0>] do_exit+0x31f/0x39d

[<ffffffff8149bdcc>] oops_end+0xbf/0xc7

[<ffffffff81038bc7>] no_context+0x13a/0x146

[<ffffffff81038d9f>] __bad_area_nosemaphore+0x1cc/0x1f2

[<ffffffff8108d045>] ? trace_hardirqs_off+0xd/0xf

[<ffffffff81304d84>] ? serial8250_console_write+0x125/0x145

[<ffffffff8108d045>] ? trace_hardirqs_off+0xd/0xf

[<ffffffff8101917a>] ? native_sched_clock+0x32/0x6b

[<ffffffff8149d3a9>] ? do_page_fault+0x13b/0x334

[<ffffffff81038dd8>] bad_area_nosemaphore+0x13/0x15

[<ffffffff8149d433>] do_page_fault+0x1c5/0x334

[<ffffffff8149b125>] page_fault+0x25/0x30

[<ffffffff8102b8e2>] ? add_pin_to_irq_node_nopanic+0x10/0x81