Re: [Xen-devel] [xen-4.7-testing test] 105948: regressions - FAIL

["Jan Beulich" <JBeulich@xxxxxxxx>]

>>> On 22.02.17 at 01:02, <andrew.cooper3@xxxxxxxxxx> wrote:
> On 21/02/2017 23:45, osstest service owner wrote:
>> flight 105948 xen-4.7-testing real [real]
>> http://logs.test-lab.xenproject.org/osstest/logs/105948/ 
>>
>> Regressions :-(
>>
>> Tests which did not succeed and are blocking,
>> including tests which could not be run:
>>  test-amd64-amd64-xl-credit2  17 guest-localmigrate/x10   fail REGR. vs. 
>> 105855
> 
> From
> http://logs.test-lab.xenproject.org/osstest/logs/105948/test-amd64-amd64-xl- 
> credit2/serial-nobling0.log
> around Feb 21 20:32:01.481626
> 
> (XEN) csched2_vcpu_insert: Inserting d5v0
> (XEN) csched2_vcpu_insert: Inserting d5v1
> (XEN) csched2_vcpu_insert: Inserting d5v2
> (XEN) csched2_vcpu_insert: Inserting d5v3
> (XEN) Assertion 'd->cpupool != NULL' failed at
> ...5948.build-amd64/xen/xen/include/xen/sched-if.h:200
> (XEN) ----[ Xen-4.7.2-pre  x86_64  debug=y  Not tainted ]----
> (XEN) CPU:    14
> (XEN) RIP:    e008:[<ffff82d080126e70>]
> sched_credit2.c#vcpu_is_migrateable+0x22/0x9a
> (XEN) RFLAGS: 0000000000010046   CONTEXT: hypervisor
> (XEN) rax: ffff8304573bc000   rbx: ffff83047f114f10   rcx: ffff83007baca000
> (XEN) rdx: 0000000000000000   rsi: ffff83023fed0458   rdi: ffff83047f114f10
> (XEN) rbp: ffff830473fffd60   rsp: ffff830473fffd40   r8:  0000000014a138bf
> (XEN) r9:  0000000014a538bf   r10: 0000000000021e54   r11: 0f0f0f0f0f0f0f0f
> (XEN) r12: ffff83047f114190   r13: 000000000000000e   r14: ffff82d0802e66c0
> (XEN) r15: ffff83023fed0000   cr0: 0000000080050033   cr4: 00000000003526e4
> (XEN) cr3: 0000000457499000   cr2: ffff880002810288
> (XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: e010   cs: e008
> (XEN) Xen code around <ffff82d080126e70>
> (sched_credit2.c#vcpu_is_migrateable+0x22/0x9a):
> (XEN)  8b 50 68 48 85 d2 75 02 <0f> 0b 49 89 f4 48 89 fb 48 8d 05 81 52
> 21 00 48
> (XEN) Xen stack trace from rsp=ffff830473fffd40:
> (XEN)    0000000000000006 ffff83047f114f10 ffff83047f114190 ffff83023fed0498
> (XEN)    ffff830473fffe20 ffff82d080129763 ffff830473fffde0 ffff82d0802e66c0
> (XEN)    ffff83023fed0000 ffff83023fed0000 ffff83040000000e ffff83040000000e
> (XEN)    000000070000000e 000000528d5c4e92 ffff830473fffdc8 ffff830473fffe68
> (XEN)    ffff82d080130110 0000000002a5a4fa 0000000000000000 0000000000000000
> (XEN)    ffff83023fed0960 ffff83023fed0458 0000000000000002 ffff8300679fc000
> (XEN)    ffff82d08033c140 000000528d5c4e92 ffff83023fed0964 000000000000000e
> (XEN)    ffff830473fffeb0 ffff82d08012c17e a6671e8700000002 ffff83023ff70160
> (XEN)    0000000e00fffe60 ffff83023ff70140 ffff830473fffe60 ffff82d0801301a1
> (XEN)    ffff830473fffeb0 ffff82d0801330ad ffff830473fffef0 ffff82d0801bb4a2
> (XEN)    00000010679fc000 ffff82d080313180 ffff82d080312a80 ffffffffffffffff
> (XEN)    ffff830473ffffff ffff8304677f2000 ffff830473fffee0 ffff82d08012f8bd
> (XEN)    ffff830473ffffff ffff83007bad0000 00000000ffffffff ffff83023fec2000
> (XEN)    ffff830473fffef0 ffff82d08012f912 ffff830473ffff10 ffff82d080164b17
> (XEN)    ffff82d08012f912 ffff8300679fc000 ffff830473fffdd8 0000000000000000
> (XEN)    ffffffff81c01fd8 ffffffff81c01fd8 0000000000000000 ffffffff81c01e68
> (XEN)    ffffffffffffffff 0000000000000246 000000528d4bace3 0000000000000000
> (XEN)    0000000000000000 0000000000000000 ffffffff810013aa ffffffff81c319a0
> (XEN)    00000000deadbeef 00000000deadbeef 0000010000000000 ffffffff810013aa
> (XEN)    000000000000e033 0000000000000246 ffffffff81c01e50 000000000000e02b
> (XEN) Xen call trace:
> (XEN)    [<ffff82d080126e70>] sched_credit2.c#vcpu_is_migrateable+0x22/0x9a
> (XEN)    [<ffff82d080129763>] sched_credit2.c#csched2_schedule+0x823/0xb4e
> (XEN)    [<ffff82d08012c17e>] schedule.c#schedule+0x108/0x609
> (XEN)    [<ffff82d08012f8bd>] softirq.c#__do_softirq+0x7f/0x8a
> (XEN)    [<ffff82d08012f912>] do_softirq+0x13/0x15
> (XEN)    [<ffff82d080164b17>] domain.c#idle_loop+0x55/0x62
> (XEN)
> (XEN)
> (XEN) ****************************************
> (XEN) Panic on CPU 14:
> (XEN) Assertion 'd->cpupool != NULL' failed at
> ...5948.build-amd64/xen/xen/include/xen/sched-if.h:200
> (XEN) ****************************************
> (XEN)
> (XEN) Manual reset required ('noreboot' specified)
> 
> I am guessing the most recent credit2 backports weren't quite so safe?

Well, there was only one in the batch under test (and that is what
adds the cpupool_domain_cpumask() causing the ASSERT() above
to trigger). However, comparing with the staging version of the file
(which is heavily different), the immediate code involved here isn't
all that different, so I wonder whether (a) this is a problem on
staging too or (b) we're missing another backport. Dario?

Jan

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
https://lists.xen.org/xen-devel