[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-devel] [xen-unstable test] 25828: regressions - trouble: broken/fail/pass



On Thu, 2014-04-10 at 03:09 +0100, xen.org wrote:
> flight 25828 xen-unstable real [real]
> http://www.chiark.greenend.org.uk/~xensrcts/logs/25828/
> 
> Regressions :-(
> 
> Tests which did not succeed and are blocking,
> including tests which could not be run:
>  test-amd64-i386-xl-multivcpu  3 host-install(3)         broken REGR. vs. 
> 25819
>  test-amd64-i386-qemut-rhel6hvm-intel  3 host-install(3) broken REGR. vs. 
> 25819
>  test-amd64-i386-freebsd10-i386  3 host-install(3)       broken REGR. vs. 
> 25819
>  test-amd64-i386-qemuu-rhel6hvm-intel  3 host-install(3) broken REGR. vs. 
> 25819
>  test-amd64-i386-xl-winxpsp3-vcpus1  3 host-install(3)   broken REGR. vs. 
> 25819
>  test-amd64-amd64-xl-qemuu-winxpsp3  3 host-install(3)   broken REGR. vs. 
> 25819

These were all on earwig. The 3 serial logs I looked at all ended with
variants on:

        Apr  9 19:38:48.133763 [    5.640341] ------------[ cut here 
]------------
        Apr  9 19:38:48.145726 [    5.640348] kernel BUG at 
drivers/xen/events/events_base.c:1233!
        Apr  9 19:38:48.153714 [    5.640354] invalid opcode: 0000 [#1] SMP 
        Apr  9 19:38:48.153740 [    5.640361] Modules linked in:
        Apr  9 19:38:48.153766 [    5.640367] CPU: 0 PID: 9 Comm: migration/0 
Tainted: G        W     3.14.0+ #1
        Apr  9 19:38:48.165731 [    5.640374] Hardware name: Dell Inc. 
PowerEdge R410/0N051F, BIOS 1.2.4 11/02/2009
        Apr  9 19:38:48.173722 [    5.640382] task: db46af00 ti: db488000 
task.ti: db488000
        Apr  9 19:38:48.173753 [    5.640388] EIP: 0061:[<c13183b2>] EFLAGS: 
00010202 CPU: 0
        Apr  9 19:38:48.185726 [    5.640395] EIP is at 
__xen_evtchn_do_upcall+0x72/0x80
        Apr  9 19:38:48.185761 [    5.640401] EAX: c104027c EBX: dfab20c0 ECX: 
db407000 EDX: dfab5e60
        Apr  9 19:38:48.193730 [    5.640407] ESI: 00000001 EDI: 00000000 EBP: 
db489e38 ESP: db489e2c
        Apr  9 19:38:48.208719 [    5.640414]  DS: 007b ES: 007b FS: 00d8 GS: 
0000 SS: e021
        Apr  9 19:38:48.208750 [    5.640422] CR0: 8005003b CR2: 00000000 CR3: 
019d7000 CR4: 00002660
        Apr  9 19:38:48.213726 [    5.640431] Stack:
        Apr  9 19:38:48.213747 [    5.640434]  00000000 db44de8c db44028c 
db489e44 c1319e42 00000001 db489e98 c16af07b
        Apr  9 19:38:48.225728 [    5.640447]  00000001 00000000 000000ff 
db44de8c db44028c db489e98 00000001 0000007b
        Apr  9 19:38:48.236719 [    5.640460]  dfab007b db4600d8 00000000 
ffffffff c110942c 0000e019 00000293 01489eb4
        Apr  9 19:38:48.244710 [    5.640474] Call Trace:
        Apr  9 19:38:48.244733 [    5.640480]  [<c1319e42>] 
xen_evtchn_do_upcall+0x22/0x40
        Apr  9 19:38:48.244767 [    5.640488]  [<c16af07b>] 
xen_do_upcall+0x7/0xc
        Apr  9 19:38:48.256721 [    5.640495]  [<c110942c>] ? 
multi_cpu_stop+0x5c/0x100
        Apr  9 19:38:48.256765 [    5.640503]  [<c11093d0>] ? 
cpu_stopper_thread+0x130/0x130
        Apr  9 19:38:48.264724 [    5.640510]  [<c110930e>] 
cpu_stopper_thread+0x6e/0x130
        Apr  9 19:38:48.264760 [    5.640517]  [<c10bfe29>] ? 
finish_task_switch+0x59/0x100
        Apr  9 19:38:48.276725 [    5.640524]  [<c16a3f03>] ? 
__schedule+0x343/0x780
        Apr  9 19:38:48.276755 [    5.640532]  [<c16a73c4>] ? 
_raw_spin_unlock_irqrestore+0x24/0x50
        Apr  9 19:38:48.284730 [    5.640541]  [<c10c39fb>] ? 
default_wake_function+0xb/0x10
        Apr  9 19:38:48.296713 [    5.640548]  [<c10d204d>] ? 
__wake_up_common+0x3d/0x70
        Apr  9 19:38:48.296744 [    5.640555]  [<c16a71c3>] ? 
_raw_spin_lock_irqsave+0x33/0x90
        Apr  9 19:38:48.304719 [    5.640563]  [<c16a70de>] ? 
_raw_spin_lock_irq+0x1e/0x80
        Apr  9 19:38:48.304750 [    5.640570]  [<c16a73c4>] ? 
_raw_spin_unlock_irqrestore+0x24/0x50
        Apr  9 19:38:48.316769 [    5.640578]  [<c10bd00a>] 
smpboot_thread_fn+0xca/0x140
        Apr  9 19:38:48.316791 [    5.640586]  [<c10bcf40>] ? 
SyS_setgroups+0x110/0x110
        Apr  9 19:38:48.324726 [    5.640592]  [<c10b6416>] kthread+0x96/0xb0
        Apr  9 19:38:48.324754 [    5.640599]  [<c10b0606>] ? 
rescuer_thread+0x46/0x370
        Apr  9 19:38:48.333725 [    5.640606]  [<c16aeac1>] 
ret_from_kernel_thread+0x21/0x30
        Apr  9 19:38:48.333760 [    5.640613]  [<c10b6380>] ? 
flush_kthread_worker+0x70/0x70
        Apr  9 19:38:48.344728 [    5.640619] Code: 14 c7 8c c1 f6 c4 02 75 22 
64 a1 98 8d 9c c1 64 c7 05 98 8d 9c c1 00 00 00 00 83 f8 01 75 ba 80 3b 00 75 
b5 5b 5e 5f 5d c3 0f 0b <0f> 0b 8d b6 00 00 00 00 8d bf 00 00 00 00 55 89 e5 e8 
78 ff ff
        Apr  9 19:38:48.364752 [    5.640696] EIP: [<c13183b2>] 
__xen_evtchn_do_upcall+0x72/0x80 SS:ESP e021:db489e2c
        Apr  9 19:38:48.373748 [    5.640708] ---[ end trace de87db1dbc652f01 
]---
        
http://www.chiark.greenend.org.uk/~xensrcts/logs/25828/test-amd64-i386-qemuu-rhel6hvm-intel/serial-earwig.log
http://www.chiark.greenend.org.uk/~xensrcts/logs/25828/test-amd64-i386-qemut-rhel6hvm-intel/serial-earwig.log
http://www.chiark.greenend.org.uk/~xensrcts/logs/25828/test-amd64-i386-freebsd10-i386/serial-earwig.log

Of the commits under test only bd04059b1179 "x86: move PIRQ EOI map
fields to arch_domain" seems plausibly related.

I suppose another option is that a Linux change got lucky and avoided
running on earwig and so made it through the Linux push gate.

>  test-amd64-i386-xl-qemuu-win7-amd64  7 windows-install    fail REGR. vs. 
> 25819
> 
> Tests which did not succeed, but are not blocking:
>  test-amd64-amd64-xl-pcipt-intel  9 guest-start                 fail never 
> pass
>  test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 14 guest-stop         fail never 
> pass
>  test-amd64-i386-xl-qemuu-winxpsp3 14 guest-stop                fail never 
> pass
>  test-amd64-amd64-xl-qemuu-win7-amd64 14 guest-stop             fail never 
> pass
>  test-amd64-i386-xl-win7-amd64 14 guest-stop                   fail  never 
> pass
>  test-amd64-amd64-xl-winxpsp3 14 guest-stop                   fail   never 
> pass
>  test-amd64-i386-xl-winxpsp3  14 guest-stop                   fail   never 
> pass
>  test-amd64-i386-xl-qemut-winxpsp3 14 guest-stop                fail never 
> pass
>  test-amd64-i386-xl-qemut-winxpsp3-vcpus1 14 guest-stop         fail never 
> pass
>  test-amd64-amd64-xl-win7-amd64 14 guest-stop                   fail never 
> pass
>  test-amd64-amd64-xl-qemut-winxpsp3 14 guest-stop               fail never 
> pass
>  test-amd64-i386-xl-qemut-win7-amd64 14 guest-stop              fail never 
> pass
>  test-armhf-armhf-xl          10 migrate-support-check        fail   never 
> pass
>  test-amd64-amd64-xl-qemut-win7-amd64 14 guest-stop             fail never 
> pass
> 
> version targeted for testing:
>  xen                  bd04059b1179df29c431e7cba17000052ea8e15c
> baseline version:
>  xen                  d2b4c27c0718f27deba00a16317a8ba04c1a2cb7
> 
> ------------------------------------------------------------
> People who touched revisions under test:
>   Don Slutz <dslutz@xxxxxxxxxxx>
>   George Dunlap <george.dunlap@xxxxxxxxxxxxx>
>   Jan Beulich <jbeulich@xxxxxxxx>
>   Roger Pau Monnà <roger.pau@xxxxxxxxxx>
> ------------------------------------------------------------
> 
> jobs:
>  build-amd64                                                  pass    
>  build-armhf                                                  pass    
>  build-i386                                                   pass    
>  build-amd64-oldkern                                          pass    
>  build-i386-oldkern                                           pass    
>  build-amd64-pvops                                            pass    
>  build-armhf-pvops                                            pass    
>  build-i386-pvops                                             pass    
>  test-amd64-amd64-xl                                          pass    
>  test-armhf-armhf-xl                                          pass    
>  test-amd64-i386-xl                                           pass    
>  test-amd64-i386-rhel6hvm-amd                                 pass    
>  test-amd64-i386-qemut-rhel6hvm-amd                           pass    
>  test-amd64-i386-qemuu-rhel6hvm-amd                           pass    
>  test-amd64-i386-freebsd10-amd64                              pass    
>  test-amd64-amd64-xl-qemut-win7-amd64                         fail    
>  test-amd64-i386-xl-qemut-win7-amd64                          fail    
>  test-amd64-amd64-xl-qemuu-win7-amd64                         fail    
>  test-amd64-i386-xl-qemuu-win7-amd64                          fail    
>  test-amd64-amd64-xl-win7-amd64                               fail    
>  test-amd64-i386-xl-win7-amd64                                fail    
>  test-amd64-i386-xl-credit2                                   pass    
>  test-amd64-i386-freebsd10-i386                               broken  
>  test-amd64-amd64-xl-pcipt-intel                              fail    
>  test-amd64-i386-rhel6hvm-intel                               pass    
>  test-amd64-i386-qemut-rhel6hvm-intel                         broken  
>  test-amd64-i386-qemuu-rhel6hvm-intel                         broken  
>  test-amd64-i386-xl-multivcpu                                 broken  
>  test-amd64-amd64-pair                                        pass    
>  test-amd64-i386-pair                                         pass    
>  test-amd64-amd64-xl-sedf-pin                                 pass    
>  test-amd64-amd64-xl-sedf                                     pass    
>  test-amd64-i386-xl-qemut-winxpsp3-vcpus1                     fail    
>  test-amd64-i386-xl-qemuu-winxpsp3-vcpus1                     fail    
>  test-amd64-i386-xl-winxpsp3-vcpus1                           broken  
>  test-amd64-amd64-xl-qemut-winxpsp3                           fail    
>  test-amd64-i386-xl-qemut-winxpsp3                            fail    
>  test-amd64-amd64-xl-qemuu-winxpsp3                           broken  
>  test-amd64-i386-xl-qemuu-winxpsp3                            fail    
>  test-amd64-amd64-xl-winxpsp3                                 fail    
>  test-amd64-i386-xl-winxpsp3                                  fail    
> 
> 
> ------------------------------------------------------------
> sg-report-flight on osstest.cam.xci-test.com
> logs: /home/xc_osstest/logs
> images: /home/xc_osstest/images
> 
> Logs, config files, etc. are available at
>     http://www.chiark.greenend.org.uk/~xensrcts/logs
> 
> Test harness code can be found at
>     http://xenbits.xensource.com/gitweb?p=osstest.git;a=summary
> 
> 
> Not pushing.
> 
> ------------------------------------------------------------
> commit bd04059b1179df29c431e7cba17000052ea8e15c
> Author: Roger Pau Monnà <roger.pau@xxxxxxxxxx>
> Date:   Wed Apr 9 12:18:10 2014 +0200
> 
>     x86: move PIRQ EOI map fields to arch_domain
>     
>     This is done so PVH guests can use PHYSDEVOP_pirq_eoi_gmfn_v{1/2}.
>     Update users of this fields, to reflect that this has been moved and
>     it is now also available to other kind of guests.
>     
>     Signed-off-by: Roger Pau Monnà <roger.pau@xxxxxxxxxx>
>     
>     Move auto_unmask ahead of the other two fields, to reduce padding.
>     
>     Signed-off-by: Jan Beulich <jbeulich@xxxxxxxx>
> 
> commit 55ee5dea32dfdf121bf11620ffe7e523b948135a
> Author: Don Slutz <dslutz@xxxxxxxxxxx>
> Date:   Wed Apr 9 12:16:00 2014 +0200
> 
>     xentrace: add TRC_HVM_EMUL
>     
>     This add a set of trace events that track the setup of various
>     emulated devices related to timers in domU.
>     
>     This set is hpet, pit (i8253, i8254), rtc (MC146818), apic (lapic),
>     and pic (i8259).  The pmtimer is not traced since it does not have a
>     changeable rate.
>     
>     Signed-off-by: Don Slutz <dslutz@xxxxxxxxxxx>
>     Reviewed-by: Tim Deegan <tim@xxxxxxx>
>     Acked-by: George Dunlap <george.dunlap@xxxxxxxxxxxxx>
> 
> commit 464451e3b2184c755d0c68543873ffa410b1e874
> Author: Don Slutz <dslutz@xxxxxxxxxxx>
> Date:   Wed Apr 9 12:15:35 2014 +0200
> 
>     x86/HVM: add emacs local variables to a couple of files
>     
>     This is per CODING_STYLE.
>     
>     Signed-off-by: Don Slutz <dslutz@xxxxxxxxxxx>
> (qemu changes not included)
> 
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@xxxxxxxxxxxxx
> http://lists.xen.org/xen-devel



_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
http://lists.xen.org/xen-devel

 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.