Re: [Xen-devel] Crash on boot with 2.6.37-rc8-git3

[Konrad Rzeszutek Wilk <konrad.wilk@xxxxxxxxxx>]

On Tue, Jan 04, 2011 at 10:01:56PM +0000, M A Young wrote:
> The latest Fedora based 2.6.37 kernels have stopped booting for me
> under xen. They stopped working around -rc7 but I think the trigger
> is that various debug options were turned off. My hardware won't let
> me get serial output, so I have tried booting it within kvm, and got
> the attached output - the behaviour was similar to bare metal,
> though I don't see enough to know if it is exactly the same crash.
> The kernel used has no additional xen patches, though I am seeing
> similar behaviour for kernels with patches from xen-next-2.6.37. The
> crash looks like it is something to do with irq.

Ahh, I hit this. Can you try 'stable/bug-fixes' branch of mine?
It has "xen/irq: Don't fall over when nr_irqs_gsi > nr_irqs." patch
which will fix the below problem you are seeing.

But I am not sure if it fixes the problem you are having with hardware?

(git://git.kernel.org/pub/scm/linux/kernel/git/konrad/xen.git)

..
> [    0.008220] ------------[ cut here ]------------
> [    0.008999] WARNING: at drivers/xen/events.c:432 
> find_unbound_irq+0x88/0x9f()
> [    0.008999] Hardware name: Bochs
> [    0.008999] Modules linked in:
> [    0.008999] Pid: 1, comm: swapper Not tainted 
> 2.6.37-0.rc8.git3.1.fc15.x86_64 #1
> [    0.008999] Call Trace:
> [    0.008999]  [<ffffffff810505d7>] warn_slowpath_common+0x85/0x9d
> [    0.008999]  [<ffffffff81050609>] warn_slowpath_null+0x1a/0x1c
> [    0.008999]  [<ffffffff812abfea>] find_unbound_irq+0x88/0x9f
> [    0.008999]  [<ffffffff812ac90e>] bind_ipi_to_irqhandler+0x64/0x153
> [    0.008999]  [<ffffffff81007979>] ? xen_reschedule_interrupt+0x0/0x18
> [    0.008999]  [<ffffffff81234511>] ? kasprintf+0x38/0x3b
> [    0.008999]  [<ffffffff81007b92>] xen_smp_intr_init+0x46/0x1f3
> [    0.008999]  [<ffffffff81b5839a>] xen_smp_prepare_cpus+0x3d/0x107
> [    0.008999]  [<ffffffff81b53cf3>] kernel_init+0x92/0x2b6
> [    0.008999]  [<ffffffff8100bae4>] kernel_thread_helper+0x4/0x10
> [    0.008999]  [<ffffffff8100aee3>] ? int_ret_from_sys_call+0x7/0x1b
> [    0.008999]  [<ffffffff81477edd>] ? retint_restore_args+0x5/0x6
> [    0.008999]  [<ffffffff8100bae0>] ? kernel_thread_helper+0x0/0x10
> [    0.008999] ---[ end trace a7919e7f17c0a725 ]---
> [    0.008999] ------------[ cut here ]------------
> [    0.008999] WARNING: at kernel/irq/manage.c:904 __free_irq+0xa3/0x1ab()
> [    0.008999] Hardware name: Bochs
> [    0.008999] Trying to free already-free IRQ 0
> [    0.008999] Modules linked in:
> [    0.008999] Pid: 1, comm: swapper Tainted: G        W   
> 2.6.37-0.rc8.git3.1.fc15.x86_64 #1
> [    0.008999] Call Trace:
> [    0.008999]  [<ffffffff810505d7>] warn_slowpath_common+0x85/0x9d
> [    0.008999]  [<ffffffff81050692>] warn_slowpath_fmt+0x46/0x48
> [    0.008999]  [<ffffffff8107d246>] ? arch_local_irq_save+0x18/0x1e
> [    0.008999]  [<ffffffff810ac901>] __free_irq+0xa3/0x1ab
> [    0.008999]  [<ffffffff810aca41>] free_irq+0x38/0x50
> [    0.008999]  [<ffffffff812abead>] unbind_from_irqhandler+0x15/0x20
> [    0.008999]  [<ffffffff81007cce>] xen_smp_intr_init+0x182/0x1f3
> [    0.008999]  [<ffffffff81b5839a>] xen_smp_prepare_cpus+0x3d/0x107
> [    0.008999]  [<ffffffff81b53cf3>] kernel_init+0x92/0x2b6
> [    0.008999]  [<ffffffff8100bae4>] kernel_thread_helper+0x4/0x10
> [    0.008999]  [<ffffffff8100aee3>] ? int_ret_from_sys_call+0x7/0x1b
> [    0.008999]  [<ffffffff81477edd>] ? retint_restore_args+0x5/0x6
> [    0.008999]  [<ffffffff8100bae0>] ? kernel_thread_helper+0x0/0x10
> [    0.008999] ---[ end trace a7919e7f17c0a726 ]---
> [    0.008999] ------------[ cut here ]------------
> [    0.008999] WARNING: at kernel/irq/manage.c:904 __free_irq+0xa3/0x1ab()
> [    0.008999] Hardware name: Bochs
> [    0.008999] Trying to free already-free IRQ 0
> [    0.008999] Modules linked in:
> [    0.008999] Pid: 1, comm: swapper Tainted: G        W   
> 2.6.37-0.rc8.git3.1.fc15.x86_64 #1
> [    0.008999] Call Trace:
> [    0.008999]  [<ffffffff810505d7>] warn_slowpath_common+0x85/0x9d
> [    0.008999]  [<ffffffff81050692>] warn_slowpath_fmt+0x46/0x48
> [    0.008999]  [<ffffffff8107d246>] ? arch_local_irq_save+0x18/0x1e
> [    0.008999]  [<ffffffff810ac901>] __free_irq+0xa3/0x1ab
> [    0.008999]  [<ffffffff810aca41>] free_irq+0x38/0x50
> [    0.008999]  [<ffffffff812abead>] unbind_from_irqhandler+0x15/0x20
> [    0.008999]  [<ffffffff81007cf0>] xen_smp_intr_init+0x1a4/0x1f3
> [    0.008999]  [<ffffffff81b5839a>] xen_smp_prepare_cpus+0x3d/0x107
> [    0.008999]  [<ffffffff81b53cf3>] kernel_init+0x92/0x2b6
> [    0.008999]  [<ffffffff8100bae4>] kernel_thread_helper+0x4/0x10
> [    0.008999]  [<ffffffff8100aee3>] ? int_ret_from_sys_call+0x7/0x1b
> [    0.008999]  [<ffffffff81477edd>] ? retint_restore_args+0x5/0x6
> [    0.008999]  [<ffffffff8100bae0>] ? kernel_thread_helper+0x0/0x10
> [    0.008999] ---[ end trace a7919e7f17c0a727 ]---
> [    0.008999] ------------[ cut here ]------------
> [    0.008999] WARNING: at kernel/irq/manage.c:904 __free_irq+0xa3/0x1ab()
> [    0.008999] Hardware name: Bochs
> [    0.008999] Trying to free already-free IRQ 0
> [    0.008999] Modules linked in:
> [    0.008999] Pid: 1, comm: swapper Tainted: G        W   
> 2.6.37-0.rc8.git3.1.fc15.x86_64 #1
> [    0.008999] Call Trace:
> [    0.008999]  [<ffffffff810505d7>] warn_slowpath_common+0x85/0x9d
> [    0.008999]  [<ffffffff81050692>] warn_slowpath_fmt+0x46/0x48
> [    0.008999]  [<ffffffff8107d246>] ? arch_local_irq_save+0x18/0x1e
> [    0.008999]  [<ffffffff810ac901>] __free_irq+0xa3/0x1ab
> [    0.008999]  [<ffffffff810aca41>] free_irq+0x38/0x50
> [    0.008999]  [<ffffffff812abead>] unbind_from_irqhandler+0x15/0x20
> [    0.008999]  [<ffffffff81007d34>] xen_smp_intr_init+0x1e8/0x1f3
> [    0.008999]  [<ffffffff81b5839a>] xen_smp_prepare_cpus+0x3d/0x107
> [    0.008999]  [<ffffffff81b53cf3>] kernel_init+0x92/0x2b6
> [    0.008999]  [<ffffffff8100bae4>] kernel_thread_helper+0x4/0x10
> [    0.008999]  [<ffffffff8100aee3>] ? int_ret_from_sys_call+0x7/0x1b
> [    0.008999]  [<ffffffff81477edd>] ? retint_restore_args+0x5/0x6
> [    0.008999]  [<ffffffff8100bae0>] ? kernel_thread_helper+0x0/0x10
> [    0.008999] ---[ end trace a7919e7f17c0a728 ]---
> [    0.009018] ------------[ cut here ]------------
> [    0.009999] kernel BUG at arch/x86/xen/smp.c:217!
> [    0.009999] invalid opcode: 0000 [#1] SMP 
> [    0.009999] last sysfs file: 
> [    0.009999] CPU 0 
> [    0.009999] Modules linked in:
> [    0.009999] 
> [    0.009999] Pid: 1, comm: swapper Tainted: G        W   
> 2.6.37-0.rc8.git3.1.fc15.x86_64 #1 /Bochs
> [    0.009999] RIP: e030:[<ffffffff81b5839e>]  [<ffffffff81b5839e>] 
> xen_smp_prepare_cpus+0x41/0x107
> [    0.009999] RSP: e02b:ffff880033841eb0  EFLAGS: 00010286
> [    0.009999] RAX: 00000000ffffffff RBX: ffffffff81c1c7b0 RCX: 
> 0000000000000100
> [    0.009999] RDX: ffff88003a410000 RSI: 0000000000000000 RDI: 
> ffffffff81d64d50
> [    0.009999] RBP: ffff880033841ed0 R08: 0000000000000002 R09: 
> 00000000fffffffe
> [    0.009999] R10: ffff880033841e50 R11: 0000000000000000 R12: 
> 0000000000000100
> [    0.009999] R13: 0000000000000000 R14: 0000000000000000 R15: 
> 0000000000000000
> [    0.009999] FS:  0000000000000000(0000) GS:ffff88003b063000(0000) 
> knlGS:0000000000000000
> [    0.009999] CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
> [    0.009999] CR2: 0000000000000000 CR3: 0000000001a03000 CR4: 
> 0000000000000660
> [    0.009999] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 
> 0000000000000000
> [    0.009999] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 
> 0000000000000400
> [    0.009999] Process swapper (pid: 1, threadinfo ffff880033840000, task 
> ffff880033838000)
> [    0.009999] Stack:
> [    0.009999]  ffff880033838000 ffffffff81c1c7b0 0000000000000000 
> 0000000000000000
> [    0.009999]  ffff880033841f40 ffffffff81b53cf3 0000000000000001 
> 0000000000000000
> [    0.009999]  0000000000000000 0000000000000000 0000000000000000 
> 0000000000000000
> [    0.009999] Call Trace:
> [    0.009999]  [<ffffffff81b53cf3>] kernel_init+0x92/0x2b6
> [    0.009999]  [<ffffffff8100bae4>] kernel_thread_helper+0x4/0x10
> [    0.009999]  [<ffffffff8100aee3>] ? int_ret_from_sys_call+0x7/0x1b
> [    0.009999]  [<ffffffff81477edd>] ? retint_restore_args+0x5/0x6
> [    0.009999]  [<ffffffff8100bae0>] ? kernel_thread_helper+0x0/0x10
> [    0.009999] Code: ff 48 8b 15 25 b9 fd ff 31 ff 48 c7 c0 00 36 01 00 66 c7 
> 84 10 c0 00 00 00 01 00 e8 3c 76 91 ff 31 ff e8 b2 f7 4a ff 85 c0 74 02 <0f> 
> 0b 31 ff e8 a9 f5 4a ff 48 c7 c2 00 20 c3 81 b9 08 00 00 00 
> [    0.009999] RIP  [<ffffffff81b5839e>] xen_smp_prepare_cpus+0x41/0x107
> [    0.009999]  RSP <ffff880033841eb0>
> [    0.009999] ---[ end trace a7919e7f17c0a729 ]---
> [    0.010021] Kernel panic - not syncing: Attempted to kill init!
> [    0.010999] Pid: 1, comm: swapper Tainted: G      D W   
> 2.6.37-0.rc8.git3.1.fc15.x86_64 #1
> [    0.010999] Call Trace:
> [    0.010999]  [<ffffffff814759d5>] panic+0x91/0x1a4
> [    0.010999]  [<ffffffff810d6093>] ? perf_event_exit_task+0xb8/0x1c7
> [    0.010999]  [<ffffffff81053b89>] do_exit+0x7c/0x75d
> [    0.010999]  [<ffffffff8107d21f>] ? arch_local_irq_restore+0xb/0xd
> [    0.010999]  [<ffffffff8147795f>] ? _raw_spin_unlock_irqrestore+0x17/0x19
> [    0.010999]  [<ffffffff8100022a>] ? _stext+0x9a/0xe70
> [    0.010999]  [<ffffffff81478c8b>] oops_end+0xbf/0xc7
> [    0.010999]  [<ffffffff8100022a>] ? _stext+0x9a/0xe70
> [    0.010999]  [<ffffffff8100022a>] ? _stext+0x9a/0xe70
> [    0.010999]  [<ffffffff8100e6ec>] die+0x5a/0x66
> [    0.010999]  [<ffffffff81478518>] do_trap+0x121/0x130
> [    0.010999]  [<ffffffff8100c06d>] do_invalid_op+0x98/0xa1
> [    0.010999]  [<ffffffff81b5839e>] ? xen_smp_prepare_cpus+0x41/0x107
> [    0.010999]  [<ffffffff8107d246>] ? arch_local_irq_save+0x18/0x1e
> [    0.010999]  [<ffffffff8107d21f>] ? arch_local_irq_restore+0xb/0xd
> [    0.010999]  [<ffffffff8147795f>] ? _raw_spin_unlock_irqrestore+0x17/0x19
> [    0.010999]  [<ffffffff810ac90d>] ? __free_irq+0xaf/0x1ab
> [    0.010999]  [<ffffffff8100b95b>] invalid_op+0x1b/0x20
> [    0.010999]  [<ffffffff81b5839e>] ? xen_smp_prepare_cpus+0x41/0x107
> [    0.010999]  [<ffffffff81b53cf3>] kernel_init+0x92/0x2b6
> [    0.010999]  [<ffffffff8100bae4>] kernel_thread_helper+0x4/0x10
> [    0.010999]  [<ffffffff8100aee3>] ? int_ret_from_sys_call+0x7/0x1b
> [    0.010999]  [<ffffffff81477edd>] ? retint_restore_args+0x5/0x6
> [    0.010999]  [<ffffffff8100bae0>] ? kernel_thread_helper+0x0/0x10
> (XEN) Domain 0 crashed: rebooting machine in 5 seconds.

> _______________________________________________
> Xen-devel mailing list
> Xen-devel@xxxxxxxxxxxxxxxxxxx
> http://lists.xensource.com/xen-devel


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel