|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] Re: [Xen-devel] Regression, host crash with 4.5rc1
Hi Jan, Thanks for all your help so far! Here's my latest update. On 11/17/2014 23:54, Jan Beulich wrote: Running with mwait-idle=0 solves (hides?) the problem. Next step is to fiddle with the C states? On 11/19/2014 23:59, Jan Beulich wrote: Also, for double checking purposes, could you make the xen-syms of a build you observed the problem with available somewhere? The xen-syms (from my build of 9a727a81) can be found here: http://steve.freitas.org/xen-syms-4.5-unstable.gz Interesting - all CPUs are executing stuff from Dom1, which be itself is not indicating a problem, but may (considering the host hang) hint at guest vCPU-s not getting de-scheduled anymore on one or more of the CPUs. The 'a' debug key output would hopefully give us enough information to know whether that's the case. Ideally do 'd' and 'a' a couple of times each (alternating, and with a few seconds in between). Here ya go (as before, from 9a727a81). I had to pick and choose what parts to pull from the log because it was getting spammed with kernel complaints about the disk subsystem being locked up, so the hypervisor debugging info was hard to read amidst the kernel errors. As ever, let me know if you need more. Thanks again! Steve (XEN) CPU00:(XEN) ex= 1445us timer=ffff8300bf526060 cb=vcpu_singleshot_timer_fn(ffff8300bf526000) (XEN) ex= 9918us timer=ffff830c3dc4b1e0 cb=csched_acct(ffff830c3dc4b1c0) (XEN) ex= 8390us timer=ffff830c3dcc2d08 cb=csched_tick(0000000000000000) (XEN) ex= 70409499us timer=ffff82d08031d1e0 cb=plt_overflow(0000000000000000) (XEN) ex= 12265483us timer=ffff82d08031f4e0 cb=mce_work_fn(0000000000000000) (XEN) ex= 94364us timer=ffff82d08031d280 cb=time_calibration(0000000000000000) (XEN) ex= 18390us timer=ffff82d080321560 cb=do_dbs_timer(ffff82d0803215a0) (XEN) CPU01:(XEN) ex= 390us timer=ffff830c17ceb460 cb=pt_timer_fn(ffff830c17ceb420) (XEN) ex= 14101194us timer=ffff830c17ceb4e0 cb=pt_timer_fn(ffff830c17ceb4a0) (XEN) ex= 153445us timer=ffff8300bf524060 cb=vcpu_singleshot_timer_fn(ffff8300bf524000) (XEN) ex= 44171681527us timer=ffff830c17ceb290 cb=rtc_alarm_cb(ffff830c17ceb1f0) (XEN) CPU02:(XEN) ex= 1445us timer=ffff8300bf798060 cb=vcpu_singleshot_timer_fn(ffff8300bf798000) (XEN) ex= 8390us timer=ffff830c3dc797c8 cb=csched_tick(0000000000000002) (XEN) ex= 18390us timer=ffff830c3dcb8360 cb=do_dbs_timer(ffff830c3dcb83a0) (XEN) ex= 29570us timer=ffff830c3dcb80a0 cb=s_timer_fn(0000000000000000) (XEN) CPU03:(XEN) ex= 25445us timer=ffff8300bf2fb060 cb=vcpu_singleshot_timer_fn(ffff8300bf2fb000) (XEN) CPU04:(XEN) ex= 634us timer=ffff8300bf525060 cb=vcpu_singleshot_timer_fn(ffff8300bf525000) (XEN) CPU05:(XEN) ex= 1445us timer=ffff8300bf527060 cb=vcpu_singleshot_timer_fn(ffff8300bf527000) (XEN) ex= 388096702us timer=ffff830c17ceb5d0 cb=pmt_timer_callback(ffff830c17ceb5a8) (XEN) 'd' pressed -> dumping registers (XEN) (XEN) *** Dumping CPU0 guest state (d1v4): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 0 (XEN) RIP: 0010:[<fffff8000298a20e>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002fa2180 rcx: fffff88002fa21c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002faceb0 (XEN) rbp: 000000000000000f rsp: fffff88002facc20 r8: fffff88002fa22a0 (XEN) r9: 000003295cdc3c57 r10: fffff88002fa22a0 r11: fffff88002facd70 (XEN) r12: fffff88002facd70 r13: 000003940027203c r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 0000000001cb8300 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU1 guest state (d1v1): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 1 (XEN) RIP: 0010:[<fffff8000298a20e>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002e40180 rcx: fffff88002e401c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002e4aeb0 (XEN) rbp: 000000000000000f rsp: fffff88002e4ac20 r8: fffff88002e402a0 (XEN) r9: 00000256dc1c8f33 r10: fffff88002e402a0 r11: fffff88002e4ad70 (XEN) r12: fffff88002e4ad70 r13: 00000394002722bb r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 00000000002f7d38 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU2 guest state (d1v0): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 2 (XEN) RIP: 0010:[<fffff800028232c1>] (XEN) RFLAGS: 0000000000000002 CONTEXT: hvm guest (XEN) rax: 0000039c01e4b276 rbx: 0000039c01e4ddc3 rcx: 000000000000ffff (XEN) rdx: 0000039c00000000 rsi: 0000000000000000 rdi: 0000000000000038 (XEN) rbp: 00000000000024b3 rsp: fffff880048d04c0 r8: fffff880048d0520 (XEN) r9: 0000000000000000 r10: fffff880048d0570 r11: 00000003428f7600 (XEN) r12: fffff880048d08f8 r13: 0000000000001000 r14: 0000000000000000 (XEN) r15: 0000000000000058 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000000000148f940 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU3 guest state (d1v2): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 3 (XEN) RIP: 0010:[<fffff8000298a20c>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002eb6180 rcx: fffff88002eb61c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002ec0eb0 (XEN) rbp: 000000000000000f rsp: fffff88002ec0c20 r8: fffff88002eb62a0 (XEN) r9: 00000353a8bde5bd r10: fffff88002eb62a0 r11: fffff88002ec0d70 (XEN) r12: fffff88002ec0d70 r13: 0000039400271946 r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000007fef88138c8 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU4 guest state (d1v5): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 4 (XEN) RIP: 0010:[<fffff8000298a20c>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002fd8180 rcx: fffff88002fd81c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002fe2eb0 (XEN) rbp: 000000000000000f rsp: fffff88002fe2c20 r8: fffff88002fd82a0 (XEN) r9: 000003071d1e7b55 r10: fffff88002fd82a0 r11: fffff88002fe2d70 (XEN) r12: fffff88002fe2d70 r13: 00000394002e01ea r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000000000043fd28 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU5 host state: *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 5 (XEN) RIP: e008:[<ffff82d08012a9a1>] _spin_unlock_irq+0x30/0x31 (XEN) RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) rax: 0000000000000000 rbx: ffff8300a9784000 rcx: 0000000000000005 (XEN) rdx: ffff830c3dc80000 rsi: 0000000000000003 rdi: ffff830c3dc8e088 (XEN) rbp: ffff830c3dc87ec8 rsp: ffff830c3dc87e40 r8: ffff830c3dc8e0a0 (XEN) r9: 000001de682f4faa r10: fffff88002f2c2a0 r11: fffff88002f36d70 (XEN) r12: 000001de682108bd r13: ffff8300a9784000 r14: ffff830c3dc8e088 (XEN) r15: 00000000000f4240 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 0000000c185e7000 cr2: 000000000031f268 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=ffff830c3dc87e40: (XEN) ffff82d080126ec5 ffff82d080321280 ffff830c3dc8e0a0 0000000500c87e78 (XEN) ffff830c3dc8e080 ffff82d0801b5277 ffff8300a9784000 fffff88002f36d70 (XEN) ffff8300a9784000 00000000000f4240 ffff82d0801e0f00 ffff830c3dc87f08 (XEN) ffff82d0802f8280 ffff82d0802f8000 ffffffffffffffff ffff830c3dc80000 (XEN) 0000000000000001 ffff830c3dc87ef8 ffff82d08012a1b3 ffff8300a9784000 (XEN) fffff88002f36d70 000003940051e450 000000000000000f ffff830c3dc87f08 (XEN) ffff82d08012a20b 000000000000000f ffff82d0801e3d2a 0000000000000001 (XEN) 000000000000000f 000003940051e450 fffff88002f36d70 000000000000000f (XEN) fffff88002f2c180 fffff88002f36d70 fffff88002f2c2a0 0000034bbd959ead (XEN) fffff88002f2c2a0 0000000000000002 fffff88002f2c1c0 0000000000000400 (XEN) 0000000000000000 fffff88002f36eb0 0000beef0000beef fffff8000298a20c (XEN) 000000bf0000beef 0000000000000046 fffff88002f36c20 000000000000beef (XEN) 000000000000beef 000000000000beef 000000000000beef 000000000000beef (XEN) 0000000000000005 ffff8300a9784000 0000003bbd96ce00 0000000000000000 (XEN) Xen call trace: (XEN) [<ffff82d08012a9a1>] _spin_unlock_irq+0x30/0x31 (XEN) [<ffff82d08012a1b3>] __do_softirq+0x81/0x8c (XEN) [<ffff82d08012a20b>] do_softirq+0x13/0x15 (XEN) [<ffff82d0801e3d2a>] vmx_asm_do_vmentry+0x2a/0x45 (XEN) (XEN) *** Dumping CPU5 guest state (d1v3): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 5 (XEN) RIP: 0010:[<fffff8000298a20c>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002f2c180 rcx: fffff88002f2c1c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002f36eb0 (XEN) rbp: 000000000000000f rsp: fffff88002f36c20 r8: fffff88002f2c2a0 (XEN) r9: 0000034bbd959ead r10: fffff88002f2c2a0 r11: fffff88002f36d70 (XEN) r12: fffff88002f36d70 r13: 000003940051e450 r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000000000031f268 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) Dumping timer queues: (XEN) CPU00:(XEN) ex= 282us timer=ffff8300bf524060 cb=vcpu_singleshot_timer_fn(ffff8300bf524000) (XEN) ex= 17360us timer=ffff830c3dc4b1e0 cb=csched_acct(ffff830c3dc4b1c0) (XEN) ex= 1690us timer=ffff830c3dcc2d08 cb=csched_tick(0000000000000000) (XEN) ex= 2536293us timer=ffff82d08031f4e0 cb=mce_work_fn(0000000000000000) (XEN) ex= 44362799us timer=ffff82d08031d1e0 cb=plt_overflow(0000000000000000) (XEN) ex= 957308us timer=ffff82d08031d280 cb=time_calibration(0000000000000000) (XEN) ex= 11690us timer=ffff82d080321560 cb=do_dbs_timer(ffff82d0803215a0) (XEN) CPU01:(XEN) ex= 659us timer=ffff830c3dc55f28 cb=csched_tick(0000000000000001) (XEN) ex= 54745us timer=ffff8300bf527060 cb=vcpu_singleshot_timer_fn(ffff8300bf527000) (XEN) ex= 1025us timer=ffff830c3dc7a0a0 cb=s_timer_fn(0000000000000000) (XEN) ex= 150745us timer=ffff8300bf2fb060 cb=vcpu_singleshot_timer_fn(ffff8300bf2fb000) (XEN) ex= 128408us timer=ffff8300bf525060 cb=vcpu_singleshot_timer_fn(ffff8300bf525000) (XEN) ex= 26745us timer=ffff8300bf526060 cb=vcpu_singleshot_timer_fn(ffff8300bf526000) (XEN) ex= 11690us timer=ffff830c3dc7a360 cb=do_dbs_timer(ffff830c3dc7a3a0) (XEN) CPU02:(XEN) ex= 1943us timer=ffff830c3dc797c8 cb=csched_tick(0000000000000002) (XEN) ex= 11690us timer=ffff830c3dcb8360 cb=do_dbs_timer(ffff830c3dcb83a0) (XEN) ex= 30041us timer=ffff830c3dcb80a0 cb=s_timer_fn(0000000000000000) (XEN) CPU03:(XEN) ex= 1937us timer=ffff830c3dcac088 cb=csched_tick(0000000000000003) (XEN) ex= 11690us timer=ffff830c3dcaa360 cb=do_dbs_timer(ffff830c3dcaa3a0) (XEN) ex= 44145634827us timer=ffff830c17ceb290 cb=rtc_alarm_cb(ffff830c17ceb1f0) (XEN) ex= 30048us timer=ffff830c3dcaa0a0 cb=s_timer_fn(0000000000000000) (XEN) CPU04:(XEN) ex= 1827us timer=ffff830c3dcac8d8 cb=csched_tick(0000000000000004) (XEN) ex= 11690us timer=ffff830c3dc9c360 cb=do_dbs_timer(ffff830c3dc9c3a0) (XEN) ex= 806745us timer=ffff8300bf798060 cb=vcpu_singleshot_timer_fn(ffff8300bf798000) (XEN) ex= 30058us timer=ffff830c3dc9c0a0 cb=s_timer_fn(0000000000000000) (XEN) CPU05:(XEN) ex= 1928us timer=ffff830c3dc8d178 cb=csched_tick(0000000000000005) (XEN) ex= 11690us timer=ffff830c3dc8e360 cb=do_dbs_timer(ffff830c3dc8e3a0) (XEN) ex= 362050002us timer=ffff830c17ceb5d0 cb=pmt_timer_callback(ffff830c17ceb5a8) (XEN) 'd' pressed -> dumping registers (XEN) (XEN) *** Dumping CPU0 guest state (d1v3): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 0 (XEN) RIP: 0010:[<fffff8000298a20c>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002f2c180 rcx: fffff88002f2c1c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002f36eb0 (XEN) rbp: 000000000000000f rsp: fffff88002f36c20 r8: fffff88002f2c2a0 (XEN) r9: 0000034bbd959ead r10: fffff88002f2c2a0 r11: fffff88002f36d70 (XEN) r12: fffff88002f36d70 r13: 000003940051e450 r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000000000031f268 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU1 guest state (d1v2): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 1 (XEN) RIP: 0010:[<fffff8000298a20e>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002eb6180 rcx: fffff88002eb61c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002ec0eb0 (XEN) rbp: 000000000000000f rsp: fffff88002ec0c20 r8: fffff88002eb62a0 (XEN) r9: 00000353a8bde5bd r10: fffff88002eb62a0 r11: fffff88002ec0d70 (XEN) r12: fffff88002ec0d70 r13: 0000039400271946 r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000007fef88138c8 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU2 guest state (d1v4): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 2 (XEN) RIP: 0010:[<fffff8000298a20e>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002fa2180 rcx: fffff88002fa21c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002faceb0 (XEN) rbp: 000000000000000f rsp: fffff88002facc20 r8: fffff88002fa22a0 (XEN) r9: 000003295cdc3c57 r10: fffff88002fa22a0 r11: fffff88002facd70 (XEN) r12: fffff88002facd70 r13: 000003940027203c r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 0000000001cb8300 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU3 host state: *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 3 (XEN) RIP: e008:[<ffff82d08012a132>] __do_softirq+0/0x8c (XEN) RFLAGS: 0000000000000202 CONTEXT: hypervisor (XEN) rax: 0000000000000246 rbx: ffff8300a9786000 rcx: 0000000000000000 (XEN) rdx: ffff82d0802f8000 rsi: ffff8300a9786000 rdi: 0000000000000000 (XEN) rbp: ffff830c3dca7f08 rsp: ffff830c3dca7f00 r8: fffff88002e402a0 (XEN) r9: 00000256dc1c8f33 r10: fffff88002e402a0 r11: fffff88002e4ad70 (XEN) r12: fffff88002e4ad70 r13: 00000394002722bb r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 0000000c17ec0000 cr2: 00000000002f7d38 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=ffff830c3dca7f00: (XEN) ffff82d08012a20b 000000000000000f ffff82d0801e3d2a 0000000000000001 (XEN) 000000000000000f 00000394002722bb fffff88002e4ad70 000000000000000f (XEN) fffff88002e40180 fffff88002e4ad70 fffff88002e402a0 00000256dc1c8f33 (XEN) fffff88002e402a0 0000000000000002 fffff88002e401c0 0000000000000400 (XEN) 0000000000000000 fffff88002e4aeb0 0000beef0000beef fffff8000298a20c (XEN) 000000bf0000beef 0000000000000046 fffff88002e4ac20 000000000000beef (XEN) 000000000000beef 000000000000beef 000000000000beef 000000000000beef (XEN) 0000000000000003 ffff8300a9786000 0000003bbd988e00 0000000000000000 (XEN) Xen call trace: (XEN) [<ffff82d08012a132>] __do_softirq+0/0x8c (XEN) [<ffff82d0801e3d2a>] vmx_asm_do_vmentry+0x2a/0x45 (XEN) (XEN) *** Dumping CPU3 guest state (d1v1): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 3 (XEN) RIP: 0010:[<fffff8000298a20c>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002e40180 rcx: fffff88002e401c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002e4aeb0 (XEN) rbp: 000000000000000f rsp: fffff88002e4ac20 r8: fffff88002e402a0 (XEN) r9: 00000256dc1c8f33 r10: fffff88002e402a0 r11: fffff88002e4ad70 (XEN) r12: fffff88002e4ad70 r13: 00000394002722bb r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 00000000002f7d38 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU4 guest state (d1v0): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 4 (XEN) RIP: 0010:[<fffff800028232c3>] (XEN) RFLAGS: 0000000000000006 CONTEXT: hvm guest (XEN) rax: 00000000336e527f rbx: 000003a26d8bfe95 rcx: 000000000000ffff (XEN) rdx: 00000000000003a1 rsi: 0000000000000000 rdi: 0000000002c0c9a9 (XEN) rbp: 0000000000000000 rsp: fffff880048d0490 r8: fffff880048d0520 (XEN) r9: 0000000000000000 r10: fffff880048d0570 r11: 0027cb813b6e0000 (XEN) r12: fffff880048d08f8 r13: 0000000000001000 r14: 0000000000000000 (XEN) r15: 0000000000000058 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000000000148f940 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU5 guest state (d1v5): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 5 (XEN) RIP: 0010:[<fffff8000298a20e>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002fd8180 rcx: fffff88002fd81c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002fe2eb0 (XEN) rbp: 000000000000000f rsp: fffff88002fe2c20 r8: fffff88002fd82a0 (XEN) r9: 000003071d1e7b55 r10: fffff88002fd82a0 r11: fffff88002fe2d70 (XEN) r12: fffff88002fe2d70 r13: 00000394002e01ea r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000000000043fd28 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) Dumping timer queues: (XEN) CPU00:(XEN) ex= 119us timer=ffff8300bf525060 cb=vcpu_singleshot_timer_fn(ffff8300bf525000) (XEN) ex= 11733us timer=ffff82d080321560 cb=do_dbs_timer(ffff82d0803215a0) (XEN) ex= 1733us timer=ffff830c3dcc2d08 cb=csched_tick(0000000000000000) (XEN) ex= 28524us timer=ffff830c3dc4b1e0 cb=csched_acct(ffff830c3dc4b1c0) (XEN) ex= 77612us timer=ffff82d08031d280 cb=time_calibration(0000000000000000) (XEN) ex= 35482842us timer=ffff82d08031d1e0 cb=plt_overflow(0000000000000000) (XEN) ex= 9656339us timer=ffff82d08031f4e0 cb=mce_work_fn(0000000000000000) (XEN) ex= 44136754870us timer=ffff830c17ceb290 cb=rtc_alarm_cb(ffff830c17ceb1f0) (XEN) CPU01:(XEN) ex= 2406us timer=ffff830c3dc55f28 cb=csched_tick(0000000000000001) (XEN) ex= 11733us timer=ffff830c3dc7a360 cb=do_dbs_timer(ffff830c3dc7a3a0) (XEN) ex= 74788us timer=ffff8300bf798060 cb=vcpu_singleshot_timer_fn(ffff8300bf798000) (XEN) ex= 270788us timer=ffff8300bf2fb060 cb=vcpu_singleshot_timer_fn(ffff8300bf2fb000) (XEN) ex= 30027us timer=ffff830c3dc7a0a0 cb=s_timer_fn(0000000000000000) (XEN) CPU02:(XEN) ex= 1952us timer=ffff830c3dc797c8 cb=csched_tick(0000000000000002) (XEN) ex= 78788us timer=ffff8300bf527060 cb=vcpu_singleshot_timer_fn(ffff8300bf527000) (XEN) ex= 11733us timer=ffff830c3dcb8360 cb=do_dbs_timer(ffff830c3dcb83a0) (XEN) ex= 1066788us timer=ffff8300bf524060 cb=vcpu_singleshot_timer_fn(ffff8300bf524000) (XEN) ex= 118766us timer=ffff8300bf526060 cb=vcpu_singleshot_timer_fn(ffff8300bf526000) (XEN) ex= 30038us timer=ffff830c3dcb80a0 cb=s_timer_fn(0000000000000000) (XEN) CPU03:(XEN) ex= 1926us timer=ffff830c3dcac088 cb=csched_tick(0000000000000003) (XEN) ex= 11733us timer=ffff830c3dcaa360 cb=do_dbs_timer(ffff830c3dcaa3a0) (XEN) CPU04:(XEN) ex= 1963us timer=ffff830c3dcac8d8 cb=csched_tick(0000000000000004) (XEN) ex= 11733us timer=ffff830c3dc9c360 cb=do_dbs_timer(ffff830c3dc9c3a0) (XEN) ex= 30059us timer=ffff830c3dc9c0a0 cb=s_timer_fn(0000000000000000) (XEN) CPU05:(XEN) ex= 1978us timer=ffff830c3dc8d178 cb=csched_tick(0000000000000005) (XEN) ex= 11733us timer=ffff830c3dc8e360 cb=do_dbs_timer(ffff830c3dc8e3a0) (XEN) ex= 353170045us timer=ffff830c17ceb5d0 cb=pmt_timer_callback(ffff830c17ceb5a8) (XEN) ex= 30065us timer=ffff830c3dc8e0a0 cb=s_timer_fn(0000000000000000) (XEN) 'd' pressed -> dumping registers (XEN) (XEN) *** Dumping CPU0 guest state (d1v5): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 0 (XEN) RIP: 0010:[<fffff8000298a217>] (XEN) RFLAGS: 0000000000000002 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002fd8180 rcx: fffff88002fd81c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002fe2eb0 (XEN) rbp: 000000000000000f rsp: fffff88002fe2c20 r8: fffff88002fd82a0 (XEN) r9: 000003071d1e7b55 r10: fffff88002fd82a0 r11: fffff88002fe2d70 (XEN) r12: fffff88002fe2d70 r13: 00000394002e01ea r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000000000043fd28 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU1 guest state (d1v1): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 1 (XEN) RIP: 0010:[<fffff8000298a20e>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002e40180 rcx: fffff88002e401c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002e4aeb0 (XEN) rbp: 000000000000000f rsp: fffff88002e4ac20 r8: fffff88002e402a0 (XEN) r9: 00000256dc1c8f33 r10: fffff88002e402a0 r11: fffff88002e4ad70 (XEN) r12: fffff88002e4ad70 r13: 00000394002722bb r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 00000000002f7d38 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU2 guest state (d1v0): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 2 (XEN) RIP: 0010:[<fffff800028232c3>] (XEN) RFLAGS: 0000000000000002 CONTEXT: hvm guest (XEN) rax: 0000000010984f60 rbx: 000003a710988443 rcx: 000000000000ffff (XEN) rdx: 00000000000003a7 rsi: 0000000000000000 rdi: 0000000000000007 (XEN) rbp: 000000000000af00 rsp: fffff880048d04c0 r8: fffff880048d0520 (XEN) r9: 0000000000000000 r10: fffff880048d0570 r11: 00000003428f7600 (XEN) r12: fffff880048d08f8 r13: 0000000000001000 r14: 0000000000000000 (XEN) r15: 0000000000000058 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000000000148f940 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU3 host state: *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 3 (XEN) RIP: e008:[<ffff82d08011cc9d>] ASSERT_NOT_IN_ATOMIC+0x37/0x52 (XEN) RFLAGS: 0000000000000202 CONTEXT: hypervisor (XEN) rax: 0000000000000180 rbx: ffff8300a9784000 rcx: 0000000000000001 (XEN) rdx: 0000003bbd988e00 rsi: ffff830c3dcaad20 rdi: 000000005c723445 (XEN) rbp: ffff830c3dca7e38 rsp: ffff830c3dca7e38 r8: 000001e23194cc09 (XEN) r9: 0000034bbd959ead r10: fffff88002f2c2a0 r11: fffff88002f36d70 (XEN) r12: 000001e25298787d r13: ffff830c3dcaa130 r14: ffff830c3dca0000 (XEN) r15: 0000000000000001 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 0000000c185e7000 cr2: 000000000031f268 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=ffff830c3dca7e38: (XEN) ffff830c3dca7ec8 ffff82d080126d91 ffff830c3dca7e58 ffff82d0801c89a3 (XEN) 000000033dca7e78 ffff830c3dca7e88 ffff82d0801b5277 ffff8300a9784000 (XEN) fffff88002f36d70 000003940051e450 ffff830c3dca7f08 ffff82d0801e0f69 (XEN) ffff830c3dca7f08 ffff82d0802f8180 ffff82d0802f8000 ffffffffffffffff (XEN) ffff830c3dca0000 0000000000000001 ffff830c3dca7ef8 ffff82d08012a1b3 (XEN) ffff8300a9784000 fffff88002f36d70 000003940051e450 000000000000000f (XEN) ffff830c3dca7f08 ffff82d08012a20b 000000000000000f ffff82d0801e3d2a (XEN) 0000000000000001 000000000000000f 000003940051e450 fffff88002f36d70 (XEN) 000000000000000f fffff88002f2c180 fffff88002f36d70 fffff88002f2c2a0 (XEN) 0000034bbd959ead fffff88002f2c2a0 0000000000000002 fffff88002f2c1c0 (XEN) 0000000000000400 0000000000000000 fffff88002f36eb0 0000beef0000beef (XEN) fffff8000298a20c 000000bf0000beef 0000000000000046 fffff88002f36c20 (XEN) 000000000000beef 000000000000beef 000000000000beef 000000000000beef (XEN) 000000000000beef 0000000000000003 ffff8300a9784000 0000003bbd988e00 (XEN) 0000000000000000 (XEN) Xen call trace: (XEN) [<ffff82d08011cc9d>] ASSERT_NOT_IN_ATOMIC+0x37/0x52 (XEN) [<ffff82d080126d91>] schedule+0x47/0x612 (XEN) [<ffff82d08012a1b3>] __do_softirq+0x81/0x8c (XEN) [<ffff82d08012a20b>] do_softirq+0x13/0x15 (XEN) [<ffff82d0801e3d2a>] vmx_asm_do_vmentry+0x2a/0x45 (XEN) (XEN) *** Dumping CPU3 guest state (d1v3): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 3 (XEN) RIP: 0010:[<fffff8000298a20c>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002f2c180 rcx: fffff88002f2c1c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002f36eb0 (XEN) rbp: 000000000000000f rsp: fffff88002f36c20 r8: fffff88002f2c2a0 (XEN) r9: 0000034bbd959ead r10: fffff88002f2c2a0 r11: fffff88002f36d70 (XEN) r12: fffff88002f36d70 r13: 000003940051e450 r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000000000031f268 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU4 host state: *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 4 (XEN) RIP: e008:[<ffff82d0801a8461>] mwait_idle+0x2ab/0x2ff (XEN) RFLAGS: 0000000000000202 CONTEXT: hypervisor (XEN) rax: 0000000000000000 rbx: 000001e262c8819c rcx: 20c49ba5e353f7cf (XEN) rdx: ffff830c3dc90000 rsi: 000001e262c8819c rdi: ffff830c3dcacba8 (XEN) rbp: ffff830c3dc97ef0 rsp: ffff830c3dc97e80 r8: 000001e23194cc09 (XEN) r9: 0000000000000000 r10: fffff88002fa22a0 r11: fffff88002facd70 (XEN) r12: ffff830c3dcacb80 r13: 0000000000000003 r14: 0000000000000004 (XEN) r15: ffff830c3dcacc10 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 0000000c18947000 cr2: 0000000001cb8300 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=ffff830c3dc97e80: (XEN) 00000010bf79b000 000001e25ccbd093 ffff82d0801e0f00 ffff830c3dc97f08 (XEN) ffff82d0802f8200 0000000000000000 0000000000000000 000002e800000115 (XEN) 0000000000000001 ffff830c3dc90000 ffff8300a978f000 00000000ffffff01 (XEN) ffff830c3dc9c088 0000000000000003 ffff830c3dc97f10 ffff82d08015ee06 (XEN) ffff82d08012a20b ffff8300bf79b000 ffff830c3dc97de8 0000000000000001 (XEN) 000000000000000f 000003940027203c fffff88002facd70 000000000000000f (XEN) fffff88002fa2180 fffff88002facd70 fffff88002fa22a0 000003295cdc3c57 (XEN) fffff88002fa22a0 0000000000000002 fffff88002fa21c0 0000000000000400 (XEN) 0000000000000000 fffff88002faceb0 0000beef0000beef fffff8000298a20c (XEN) 000000bf0000beef 0000000000000046 fffff88002facc20 000000000000beef (XEN) 000000000000beef 000000000000beef 000000000000beef 000000000000beef (XEN) 0000000000000004 ffff8300bf79b000 0000003bbd97ae00 0000000000000000 (XEN) Xen call trace: (XEN) [<ffff82d0801a8461>] mwait_idle+0x2ab/0x2ff (XEN) [<ffff82d08015ee06>] idle_loop+0x51/0x6b (XEN) (XEN) *** Dumping CPU5 host state: *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 5 (XEN) RIP: e008:[<ffff82d0801a8461>] mwait_idle+0x2ab/0x2ff (XEN) RFLAGS: 0000000000000202 CONTEXT: hypervisor (XEN) rax: 0000000000000000 rbx: 000001e26cdd6ba0 rcx: 20c49ba5e353f7cf (XEN) rdx: ffff830c3dc80000 rsi: 000001e26cdd6ba0 rdi: ffff830c3dc8d448 (XEN) rbp: ffff830c3dc87ef0 rsp: ffff830c3dc87e80 r8: 000001e23194cc09 (XEN) r9: ffff830c17ceb5d0 r10: 0000000000000000 r11: 000000000000000a (XEN) r12: ffff830c3dc8d420 r13: 0000000000000004 r14: 0000000000000008 (XEN) r15: ffff830c3dc8d4d0 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 00000000bf48b000 cr2: 000007fef88138c8 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=ffff830c3dc87e80: (XEN) 00000020bf79a000 000001e263681669 ffff82d0802f8000 ffffffffffffffff (XEN) ffff830c3dc80000 0000000000000000 0000000000000000 00001f3e0000130a (XEN) ffff830c3dc80000 ffff830c3dc80000 000001e263680d45 ffff8300bf79a000 (XEN) ffff830c3dc8e088 ffffffffffffffff ffff830c3dc87f10 ffff82d08015ee06 (XEN) ffff82d08012a20b ffff8300bf79a000 ffff830c3dc87e10 0000000000000001 (XEN) 000000000000000f 00000394002722bb fffff88002e4ad70 000000000000000f (XEN) fffff88002e40180 fffff88002e4ad70 fffff88002e402a0 00000256dc1c8f33 (XEN) fffff88002e402a0 0000000000000002 fffff88002e401c0 0000000000000400 (XEN) 0000000000000000 fffff88002e4aeb0 0000beef0000beef fffff8000298a20c (XEN) 000000bf0000beef 0000000000000046 fffff88002e4ac20 000000000000beef (XEN) 000000000000beef 000000000000beef 000000000000beef 000000000000beef (XEN) 0000000000000005 ffff8300bf79a000 0000003bbd96ce00 0000000000000000 (XEN) Xen call trace: (XEN) [<ffff82d0801a8461>] mwait_idle+0x2ab/0x2ff (XEN) [<ffff82d08015ee06>] idle_loop+0x51/0x6b (XEN) (XEN) Dumping timer queues: (XEN) CPU00:(XEN) ex= 597us timer=ffff830c3dcc2d08 cb=csched_tick(0000000000000000) (XEN) ex= 597us timer=ffff82d080321560 cb=do_dbs_timer(ffff82d0803215a0) (XEN) ex= 15145207us timer=ffff82d08031f4e0 cb=mce_work_fn(0000000000000000) (XEN) ex= 10541us timer=ffff830c3dc4b1e0 cb=csched_acct(ffff830c3dc4b1c0) (XEN) ex= 155653us timer=ffff8300bf524060 cb=vcpu_singleshot_timer_fn(ffff8300bf524000) (XEN) ex= 24971706us timer=ffff82d08031d1e0 cb=plt_overflow(0000000000000000) (XEN) ex= 44126243734us timer=ffff830c17ceb290 cb=rtc_alarm_cb(ffff830c17ceb1f0) (XEN) ex= 730445us timer=ffff82d08031d280 cb=time_calibration(0000000000000000) (XEN) ex= 107653us timer=ffff8300bf525060 cb=vcpu_singleshot_timer_fn(ffff8300bf525000) (XEN) CPU01:(XEN) ex= 597us timer=ffff830c3dc7a360 cb=do_dbs_timer(ffff830c3dc7a3a0) (XEN) ex= 1023us timer=ffff830c3dc55f28 cb=csched_tick(0000000000000001) (XEN) ex= 259653us timer=ffff8300bf526060 cb=vcpu_singleshot_timer_fn(ffff8300bf526000) (XEN) ex= 30029us timer=ffff830c3dc7a0a0 cb=s_timer_fn(0000000000000000) (XEN) CPU02:(XEN) ex= 597us timer=ffff830c3dcb8360 cb=do_dbs_timer(ffff830c3dcb83a0) (XEN) ex= 1074us timer=ffff830c3dc797c8 cb=csched_tick(0000000000000002) (XEN) ex= 30039us timer=ffff830c3dcb80a0 cb=s_timer_fn(0000000000000000) (XEN) CPU03:(XEN) ex= 597us timer=ffff830c3dcaa360 cb=do_dbs_timer(ffff830c3dcaa3a0) (XEN) ex= 947us timer=ffff830c3dcac088 cb=csched_tick(0000000000000003) (XEN) ex= 563653us timer=ffff8300bf798060 cb=vcpu_singleshot_timer_fn(ffff8300bf798000) (XEN) ex= 30047us timer=ffff830c3dcaa0a0 cb=s_timer_fn(0000000000000000) (XEN) CPU04:(XEN) ex= 597us timer=ffff830c3dc9c360 cb=do_dbs_timer(ffff830c3dc9c3a0) (XEN) ex= 996us timer=ffff830c3dcac8d8 cb=csched_tick(0000000000000004) (XEN) ex= 30055us timer=ffff830c3dc9c0a0 cb=s_timer_fn(0000000000000000) (XEN) CPU05:(XEN) ex= 155us timer=ffff8300bf2fb060 cb=vcpu_singleshot_timer_fn(ffff8300bf2fb000) (XEN) ex= 981us timer=ffff830c3dc8d178 cb=csched_tick(0000000000000005) (XEN) ex= 597us timer=ffff830c3dc8e360 cb=do_dbs_timer(ffff830c3dc8e3a0) (XEN) ex= 342658909us timer=ffff830c17ceb5d0 cb=pmt_timer_callback(ffff830c17ceb5a8) (XEN) ex= 91653us timer=ffff8300bf527060 cb=vcpu_singleshot_timer_fn(ffff8300bf527000) (XEN) ex= 1062us timer=ffff830c3dc8e0a0 cb=s_timer_fn(0000000000000000) (XEN) 'd' pressed -> dumping registers (XEN) (XEN) *** Dumping CPU0 guest state (d1v3): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 0 (XEN) RIP: 0010:[<fffff8000298a20e>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002f2c180 rcx: fffff88002f2c1c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002f36eb0 (XEN) rbp: 000000000000000f rsp: fffff88002f36c20 r8: fffff88002f2c2a0 (XEN) r9: 0000034bbd959ead r10: fffff88002f2c2a0 r11: fffff88002f36d70 (XEN) r12: fffff88002f36d70 r13: 000003940051e450 r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000000000031f268 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU1 guest state (d1v4): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 1 (XEN) RIP: 0010:[<fffff8000298a20e>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002fa2180 rcx: fffff88002fa21c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002faceb0 (XEN) rbp: 000000000000000f rsp: fffff88002facc20 r8: fffff88002fa22a0 (XEN) r9: 000003295cdc3c57 r10: fffff88002fa22a0 r11: fffff88002facd70 (XEN) r12: fffff88002facd70 r13: 000003940027203c r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 0000000001cb8300 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU2 guest state (d1v2): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 2 (XEN) RIP: 0010:[<fffff8000298a20e>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002eb6180 rcx: fffff88002eb61c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002ec0eb0 (XEN) rbp: 000000000000000f rsp: fffff88002ec0c20 r8: fffff88002eb62a0 (XEN) r9: 00000353a8bde5bd r10: fffff88002eb62a0 r11: fffff88002ec0d70 (XEN) r12: fffff88002ec0d70 r13: 0000039400271946 r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000007fef88138c8 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU3 guest state (d1v5): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 3 (XEN) RIP: 0010:[<fffff8000298a20e>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002fd8180 rcx: fffff88002fd81c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002fe2eb0 (XEN) rbp: 000000000000000f rsp: fffff88002fe2c20 r8: fffff88002fd82a0 (XEN) r9: 000003071d1e7b55 r10: fffff88002fd82a0 r11: fffff88002fe2d70 (XEN) r12: fffff88002fe2d70 r13: 00000394002e01ea r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000000000043fd28 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU4 host state: *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 4 (XEN) RIP: e008:[<ffff82d0801dc4fe>] vmx_vmexit_handler+0x311/0x195e (XEN) RFLAGS: 0000000000000297 CONTEXT: hypervisor (XEN) rax: 0000000000187000 rbx: ffff830c3dc97f18 rcx: fffff88002e401c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: ffff830c3dc97f18 (XEN) rbp: ffff830c3dc97f08 rsp: ffff830c3dc97d98 r8: fffff88002e402a0 (XEN) r9: 00000256dc1c8f33 r10: fffff88002e402a0 r11: fffff88002e4ad70 (XEN) r12: ffff8300a9786000 r13: 0000000000000028 r14: 0000000000000000 (XEN) r15: 0000000000000001 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 0000000c17ec0000 cr2: 00000000002f7d38 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=ffff830c3dc97d98: (XEN) ffff8300a9786000 ffff8300a9786000 ffff8300a9786000 ffff830c3dc9c088 (XEN) ffff830c3dc97e08 0000000000000000 ffff830c3dc97de8 ffff830c3dc90000 (XEN) ffff830c3dc9c0a0 ffff8300a9786000 000001e512e27b8b ffff8300a9786000 (XEN) ffff830c3dc9c088 0000000001c9c380 0000000000000292 ffff830c3dc97e28 (XEN) ffff82d08012a80f ffff8300a9786000 ffff830c3dc97e98 ffff82d0801caea5 (XEN) ffff830c3dc97ec8 ffff8300a9786508 ffff82d080321280 ffff830c3dc9c0a0 (XEN) ffff830c3dc97e78 ffff830c3dc97e88 ffff82d0801b5277 ffff8300a9786000 (XEN) 000001e512e27b8b ffff8300a9786000 ffff830c3dc97f08 ffff82d0801e0f69 (XEN) ffff830c3dc97f18 ffff8300a9786000 ffff830c3dc97f08 ffff82d0801ddba6 (XEN) ffff830c3dc90000 0000000000000001 ffff830c3dc97ef8 ffff82d08012a1b3 (XEN) ffff8300a9786000 ffff8300a9786000 fffff88002e4ad70 00000394002722bb (XEN) 000000000000000f 0000000000000001 000000000000000f ffff82d0801e3c81 (XEN) 0000000000000001 000000000000000f 00000394002722bb fffff88002e4ad70 (XEN) 000000000000000f fffff88002e40180 fffff88002e4ad70 fffff88002e402a0 (XEN) 00000256dc1c8f33 fffff88002e402a0 0000000000000002 fffff88002e401c0 (XEN) 0000000000000400 0000000000000000 fffff88002e4aeb0 0000beef0000beef (XEN) fffff8000298a20c 000000bf0000beef 0000000000000046 fffff88002e4ac20 (XEN) 000000000000beef 000000000000beef 000000000000beef 000000000000beef (XEN) 000000000000beef 0000000000000004 ffff8300a9786000 0000003bbd97ae00 (XEN) 0000000000000000 (XEN) Xen call trace: (XEN) [<ffff82d0801dc4fe>] vmx_vmexit_handler+0x311/0x195e (XEN) [<ffff82d0801e3c81>] vmx_asm_vmexit_handler+0x41/0xc0 (XEN) (XEN) *** Dumping CPU4 guest state (d1v1): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 4 (XEN) RIP: 0010:[<fffff8000298a20c>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002e40180 rcx: fffff88002e401c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002e4aeb0 (XEN) rbp: 000000000000000f rsp: fffff88002e4ac20 r8: fffff88002e402a0 (XEN) r9: 00000256dc1c8f33 r10: fffff88002e402a0 r11: fffff88002e4ad70 (XEN) r12: fffff88002e4ad70 r13: 00000394002722bb r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 00000000002f7d38 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU5 host state: *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 5 (XEN) RIP: e008:[<ffff82d08012a825>] _spin_lock+0x27/0x54 (XEN) RFLAGS: 0000000000000246 CONTEXT: hypervisor (XEN) rax: 0000000000000001 rbx: ffff830c17ceb628 rcx: 0000000000000000 (XEN) rdx: 0000000000000000 rsi: 0000000000000008 rdi: ffff830c17ceb62c (XEN) rbp: ffff830c3dc87df8 rsp: ffff830c3dc87df0 r8: fffff880048d0520 (XEN) r9: 0000000000000000 r10: fffff880048d0570 r11: 00000003428f7600 (XEN) r12: 0000000000000008 r13: 0000000000000008 r14: ffff830c17ceb628 (XEN) r15: ffff8300a9787000 cr0: 000000008005003b cr4: 00000000000026f0 (XEN) cr3: 0000000c180ec000 cr2: 000000000148f940 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008 (XEN) Xen stack trace from rsp=ffff830c3dc87df0: (XEN) ffff830c17ceb000 ffff830c3dc87e28 ffff82d0801c08e6 0000000000000008 (XEN) 0000000000000008 0000000000000001 ffff8300a9787000 ffff830c3dc87e98 (XEN) ffff82d0801caef7 ffff830c3dc87ec8 ffff8300a9787508 000000023dc87e58 (XEN) ffff830c17ceb4a0 00000143f866c070 ffff8300a9787510 ffff82d0801b5277 (XEN) ffff8300a9787000 fffff880048d08f8 0000000000001000 0000000000000000 (XEN) 0000000000000058 ffff830c3dc87f08 ffff82d0801d4c75 ffff830c3dc87f08 (XEN) ffffffff801ddba6 ffff830c3dc80000 0000000000000058 ffff830c3dc87ef8 (XEN) ffff82d08012a1b3 ffff8300a9787000 ffff8300a9787000 fffff880048d08f8 (XEN) 0000000000001000 0000000000000000 0000000000000058 000000000000897d (XEN) ffff82d0801e3c86 0000000000000058 0000000000000000 0000000000001000 (XEN) fffff880048d08f8 000000000000897d 000003af014f24a8 00000003428f7600 (XEN) fffff880048d0570 0000000000000000 fffff880048d0520 000003af014efe7d (XEN) 000000000000ffff 000003af00000000 0000000000000000 0000000000000052 (XEN) 0000beef0000beef fffff800028232bf 000000bf0000beef 0000000000000002 (XEN) fffff880048d04c0 000000000000beef 000000000000beef 000000000000beef (XEN) 000000000000beef 000000000000beef 0000000000000005 ffff8300a9787000 (XEN) 0000003bbd96ce00 0000000000000000 (XEN) Xen call trace: (XEN) [<ffff82d08012a825>] _spin_lock+0x27/0x54 (XEN) [<ffff82d0801c08e6>] hvm_isa_irq_deassert+0x34/0x77 (XEN) [<ffff82d0801caef7>] pt_update_irq+0x1b8/0x230 (XEN) [<ffff82d0801d4c75>] vmx_intr_assist+0x5d/0x51c (XEN) [<ffff82d0801e3c86>] vmx_asm_vmexit_handler+0x46/0xc0 (XEN) (XEN) *** Dumping CPU5 guest state (d1v0): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 5 (XEN) RIP: 0010:[<fffff800028232bf>] (XEN) RFLAGS: 0000000000000002 CONTEXT: hvm guest (XEN) rax: 000003af014efe7d rbx: 000003af014f24a8 rcx: 000000000000ffff (XEN) rdx: 000003af00000000 rsi: 0000000000000000 rdi: 0000000000000052 (XEN) rbp: 000000000000897d rsp: fffff880048d04c0 r8: fffff880048d0520 (XEN) r9: 0000000000000000 r10: fffff880048d0570 r11: 00000003428f7600 (XEN) r12: fffff880048d08f8 r13: 0000000000001000 r14: 0000000000000000 (XEN) r15: 0000000000000058 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000000000148f940 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) Dumping timer queues: (XEN) CPU00:(XEN) ex= 1796us timer=ffff830c3dc4b1e0 cb=csched_acct(ffff830c3dc4b1c0) (XEN) ex= 6341us timer=ffff830c3dcc2d08 cb=csched_tick(0000000000000000) (XEN) ex= 16341us timer=ffff82d080321560 cb=do_dbs_timer(ffff82d0803215a0) (XEN) ex= 4520950us timer=ffff82d08031f4e0 cb=mce_work_fn(0000000000000000) (XEN) ex= 891686us timer=ffff82d08031d280 cb=time_calibration(0000000000000000) (XEN) ex= 14347450us timer=ffff82d08031d1e0 cb=plt_overflow(0000000000000000) (XEN) CPU01:(XEN) ex= 6500us timer=ffff830c3dc55f28 cb=csched_tick(0000000000000001) (XEN) ex= 16341us timer=ffff830c3dc7a360 cb=do_dbs_timer(ffff830c3dc7a3a0) (XEN) ex= 939396us timer=ffff8300bf798060 cb=vcpu_singleshot_timer_fn(ffff8300bf798000) (XEN) ex= 67396us timer=ffff8300bf527060 cb=vcpu_singleshot_timer_fn(ffff8300bf527000) (XEN) ex= 30022us timer=ffff830c3dc7a0a0 cb=s_timer_fn(0000000000000000) (XEN) CPU02:(XEN) ex= 6493us timer=ffff830c3dc797c8 cb=csched_tick(0000000000000002) (XEN) ex= 16341us timer=ffff830c3dcb8360 cb=do_dbs_timer(ffff830c3dcb83a0) (XEN) ex= 135396us timer=ffff8300bf2fb060 cb=vcpu_singleshot_timer_fn(ffff8300bf2fb000) (XEN) ex= 30035us timer=ffff830c3dcb80a0 cb=s_timer_fn(0000000000000000) (XEN) CPU03:(XEN) ex= 753us timer=ffff8300bf525060 cb=vcpu_singleshot_timer_fn(ffff8300bf525000) (XEN) ex= 1042us timer=ffff830c3dcaa0a0 cb=s_timer_fn(0000000000000000) (XEN) ex= 44115619478us timer=ffff830c17ceb290 cb=rtc_alarm_cb(ffff830c17ceb1f0) (XEN) ex= 16341us timer=ffff830c3dcaa360 cb=do_dbs_timer(ffff830c3dcaa3a0) (XEN) ex= 6535us timer=ffff830c3dcac088 cb=csched_tick(0000000000000003) (XEN) CPU04:(XEN) ex= 4039us timer=ffff8300bf524060 cb=vcpu_singleshot_timer_fn(ffff8300bf524000) (XEN) ex= 6506us timer=ffff830c3dcac8d8 cb=csched_tick(0000000000000004) (XEN) ex= 16341us timer=ffff830c3dc9c360 cb=do_dbs_timer(ffff830c3dc9c3a0) (XEN) ex= 30055us timer=ffff830c3dc9c0a0 cb=s_timer_fn(0000000000000000) (XEN) CPU05:(XEN) ex= 6536us timer=ffff830c3dc8d178 cb=csched_tick(0000000000000005) (XEN) ex= 16341us timer=ffff830c3dc8e360 cb=do_dbs_timer(ffff830c3dc8e3a0) (XEN) ex= 755722us timer=ffff8300bf526060 cb=vcpu_singleshot_timer_fn(ffff8300bf526000) (XEN) ex= 332034653us timer=ffff830c17ceb5d0 cb=pmt_timer_callback(ffff830c17ceb5a8) (XEN) ex= 30066us timer=ffff830c3dc8e0a0 cb=s_timer_fn(0000000000000000) (XEN) 'd' pressed -> dumping registers (XEN) (XEN) *** Dumping CPU0 guest state (d1v2): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 0 (XEN) RIP: 0010:[<fffff8000298a20c>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002eb6180 rcx: fffff88002eb61c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002ec0eb0 (XEN) rbp: 000000000000000f rsp: fffff88002ec0c20 r8: fffff88002eb62a0 (XEN) r9: 00000353a8bde5bd r10: fffff88002eb62a0 r11: fffff88002ec0d70 (XEN) r12: fffff88002ec0d70 r13: 0000039400271946 r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000007fef88138c8 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU1 guest state (d1v0): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 1 (XEN) RIP: 0010:[<fffff800028232c1>] (XEN) RFLAGS: 0000000000000002 CONTEXT: hvm guest (XEN) rax: 000003b6a07ae098 rbx: 000003b6a07b06ed rcx: 000000000000ffff (XEN) rdx: 000003b600000000 rsi: 0000000000000000 rdi: 0000000000000051 (XEN) rbp: 0000000000006ed0 rsp: fffff880048d04c0 r8: fffff880048d0520 (XEN) r9: 0000000000000000 r10: fffff880048d0570 r11: 00000003428f7600 (XEN) r12: fffff880048d08f8 r13: 0000000000001000 r14: 0000000000000000 (XEN) r15: 0000000000000058 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000000000148f940 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU2 guest state (d1v3): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 2 (XEN) RIP: 0010:[<fffff8000298a20e>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002f2c180 rcx: fffff88002f2c1c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002f36eb0 (XEN) rbp: 000000000000000f rsp: fffff88002f36c20 r8: fffff88002f2c2a0 (XEN) r9: 0000034bbd959ead r10: fffff88002f2c2a0 r11: fffff88002f36d70 (XEN) r12: fffff88002f36d70 r13: 000003940051e450 r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000000000031f268 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU3 guest state (d1v4): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 3 (XEN) RIP: 0010:[<fffff8000298a20e>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002fa2180 rcx: fffff88002fa21c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002faceb0 (XEN) rbp: 000000000000000f rsp: fffff88002facc20 r8: fffff88002fa22a0 (XEN) r9: 000003295cdc3c57 r10: fffff88002fa22a0 r11: fffff88002facd70 (XEN) r12: fffff88002facd70 r13: 000003940027203c r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 0000000001cb8300 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU4 guest state (d1v1): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 4 (XEN) RIP: 0010:[<fffff8000298a20c>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002e40180 rcx: fffff88002e401c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002e4aeb0 (XEN) rbp: 000000000000000f rsp: fffff88002e4ac20 r8: fffff88002e402a0 (XEN) r9: 00000256dc1c8f33 r10: fffff88002e402a0 r11: fffff88002e4ad70 (XEN) r12: fffff88002e4ad70 r13: 00000394002722bb r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 00000000002f7d38 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) *** Dumping CPU5 guest state (d1v5): *** (XEN) ----[ Xen-4.5-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 5 (XEN) RIP: 0010:[<fffff8000298a20c>] (XEN) RFLAGS: 0000000000000046 CONTEXT: hvm guest (XEN) rax: 0000000000000002 rbx: fffff88002fd8180 rcx: fffff88002fd81c0 (XEN) rdx: 0000000000000400 rsi: 0000000000000000 rdi: fffff88002fe2eb0 (XEN) rbp: 000000000000000f rsp: fffff88002fe2c20 r8: fffff88002fd82a0 (XEN) r9: 000003071d1e7b55 r10: fffff88002fd82a0 r11: fffff88002fe2d70 (XEN) r12: fffff88002fe2d70 r13: 00000394002e01ea r14: 000000000000000f (XEN) r15: 0000000000000001 cr0: 0000000080050031 cr4: 00000000000006f8 (XEN) cr3: 0000000000187000 cr2: 000000000043fd28 (XEN) ds: 002b es: 002b fs: 0053 gs: 002b ss: 0018 cs: 0010 (XEN) (XEN) 'R' pressed -> rebooting machine (XEN) Resetting with ACPI MEMORY or I/O RESET_REG. _______________________________________________ Xen-devel mailing list Xen-devel@xxxxxxxxxxxxx http://lists.xen.org/xen-devel
|
 |
Lists.xenproject.org is hosted with RackSpace, monitoring our |