[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Xen-devel] Testing status of HVM (Intel VT) on 64bit XEN unstable c/s 11388



Summary:
Changeset 11388
- NEW: dom0 panic booting an 64bit SMP HVM guest with/without noapic.
  32bit SMP HVM guests get the same error and then boot up OK
  but with only one of their two CPUs.
  (failure.3  (XEN) malloc vlapic regs error for vcpu 1)

Test Configuration:
Dell Precision WorkStation 380, Dual Core, 2GB, 3 SATA (Intel VT)
64bit XEN Hypervisor on a RHEL4U2 64bit root (/dev/sda)
32bit fully virtualized (HVM) guest RHEL4U2 256MB (/dev/sdb)
      pae=1(smp) pae=0(up), acpi=1, apic=1
      kernargs noapic
64bit fully virtualized (HVM) guest RHEL4U2 256MB (/dev/sdc)
      pae=1, acpi=1, apic=1
      kernargs noapic

Boot Tests:
Boot a fully virtualized (HVM) guest to the login prompt
Results are marked Pass|Fail where (n) points to a failure description

Regression Tests:
852 tests (851 ltp tests and one 30 minute user load test)
Tests are marked #Pass/#Fail where (n) points to a failure description

XEN 64bit 2 CPU Hypervisor (booted smp):
 ----------------------------------------------------------------------
| XEN      | Guest Kernel (SMP kernels booted with 2 CPUs)             |
| Changeset|-----------------------------------------------------------|
|          | 32bit UP     | 32bit SMP    | 64bit UP     | 64bit SMP    |
|          |--------------|--------------|--------------|--------------|
|          | Boot | Test  | Boot | Test  | Boot | Test  | Boot | Test  |
|----------|------|-------|------|-------|------|-------|------|-------|
| 11388    | Pass |       | Fail |       | Pass |       | Fail |       |
|          |      |       | (3)  |       |      |       | (3)  |       |
|----------|------|-------|------|-------|------|-------|------|-------|
| 11286    | Fail |       | Fail |       | Fail |       | Fail |       |
|          | (2)  |       | (2)  |       | (2)  |       | (2)  |       |
|----------|------|-------|------|-------|------|-------|------|-------|
| 11269    | Pass |       | Fail |       | Pass |       | Pass | 852/0 |
|          |      |       | (6,7)|       |      |       |      |       |
|----------|------|-------|------|-------|------|-------|------|-------|
| 11259    | Pass |       | Fail |       | Pass |       | Pass | 852/0 |
|          |      |       | (6,7)|       |      |       |      |       |
|----------|------|-------|------|-------|------|-------|------|-------|
| 11251    | Pass |       | Fail |       | Pass |       | Pass | 852/0 |
|          |      |       | (6)  |       |      |       |      |       |
 ----------------------------------------------------------------------

Multiple Guest Boot Test
Test is a 30 minute user load on both Guests
XEN 64bit 2 CPU Hypervisor (booted smp):
 --------------------------------------------
| XEN      | Guest Kernel                    |
| Changeset|---------------------------------|
|          | 32bit 1CPU UP  | 32bit 2CPU SMP |
|          | 64bit 1CPU UP  | 64bit 2CPU SMP |
|          |----------------|----------------|
|          | Boot | Test    | Boot | Test    |
|----------|------|---------|------|---------|
| 11388    | Pass | Pass    | Fail |         |
|          |      |         | (3)  |         |
|----------|------|---------|------|---------|
| 11286    | Fail |         | Fail |         |
|          | (2)  |         | (2)  |         |
|----------|------|---------|------|---------|
| 11269    | Pass | Pass    | Fail |         |
|          |      |         | (6)  |         |
|----------|------|---------|------|---------|
| 11259    | Pass | Pass    | Fail |         |
|          |      |         | (6)  |         |
|----------|------|---------|------|---------|
| 11251    | Pass | Pass    | Fail |         |
|          |      |         | (6)  |         |
 --------------------------------------------

Failures:
 1. BUG 666: 32bit guests fail ltp gettimeofday02:
    "Time is going backwards"
 2. FIXED: HVM guests fail to boot:
    Error: (12, 'Cannot allocate memory')
 3. NEW: dom0 panic booting an 64bit SMP HVM guest:
    (XEN) malloc vlapic regs error for vcpu 1)

These may be fixed but I will not know until
failure #3 is corrected:
 6. 32bit SMP (pae) XEN panic in:
    sh2_page_fault__shadow_3_guest_3+0x493/0xdd0
    NOTE: On c/s 11269 sh2 becomes sh
 7. 32bit SMP (pae) Guest domain crash:
    sh2 error: sh2_remove_shadows(): can't find all
    shadows of mfn 10ef3 (shadow2_flags=00000100)
    domain_crash called from shadow2-common.c:2251
    NOTE: On c/s 11269 sh2 becomes sh
File: failure.1

Time            Level   Message
05:00:50        INFO    Reporting status: 'Test Running' for test: 
ltp_gettimeofday02
05:00:52        INFO    Preparing to run test 'ltp_gettimeofday02' using 
profile: /qa/conductor/profiles/ltp/syscalls/gettimeofday02.xml
05:00:52        INFO    Starting test 'ltp_gettimeofday02' using profile: 
/qa/conductor/profiles/ltp/syscalls/gettimeofday02.xml
05:00:52        INFO    Dispatching operation: RemoteShell
05:00:52        FINE    Client sequencer got message requesting the start of a 
new test: ltp_gettimeofday02
05:00:52        FINER   Client sequencer sent message of type: 4 with seq num: 
1 of size: 289 bytes
05:00:52        FINER   Client sequencer handling new operation from control 
sequencer
05:00:52        FINE    Client sequencer looking for class: 
com.katana.conductor.operations.RemoteShell
05:00:52        INFO    Operation RemoteShell running
05:00:52        FINE    Client sequencer was told that an operation is now 
running
05:00:52        INFO    RemoteShell: target node(s) = vs177
05:00:52        INFO    ssh: /usr/bin/ssh root@vs177 cd 
/qa/conductor/tests/ltp/testcases/bin; gettimeofday02
05:00:52        FINE    ssh: waiting for command to finish
05:00:53        INFO       ssh: gettimeofday02 0 INFO : checking if 
gettimeofday is monotonous, takes 30s
05:00:53        INFO       ssh: gettimeofday02 1 FAIL : Time is going backwards 
(old 1145696453.61428 vs new 1145696453.60660!
05:00:53        FINE    executeShellCmd(ssh): exit value is 1
05:00:53        SEVERE  RemoteShell: command failed with error = 1
05:00:53        SEVERE  Operation RemoteShell failed
05:00:53        SEVERE  Reporting status: 'Test Failed' for test: 
ltp_gettimeofday02
05:00:53        FINE    Client sequencer detected operation completed with 
status of: Fail
05:00:53        FINER   Client sequencer sent message of type: 5 with seq num: 
2 of size: 429 bytes
05:00:53        SEVERE  Crash Collection disabled for queue : RHEL4U2-32b-XEN
05:00:53        INFO    Cleaning up after test

File: failure.3

Red Hat Enterprise Linux ES release 4 (Nahant Update 2)
Kernel 2.6.16.13-xen on an x86_64

tst177 login: root
Password:
Last login: Thu Aug 31 07:23:11 from 10.1.3.202
You have new mail.
[root@tst177 ~]# /etc/init.d/xend start
Bridge firewalling registered
ip_tables: (C) 2000-2006 Netfilter Core Team
[root@tst177 ~]# xm info
host                   : tst177
release                : 2.6.16.13-xen
version                : #1 SMP Thu Aug 31 04:44:29 EDT 2006
machine                : x86_64
nr_cpus                : 2
nr_nodes               : 1
sockets_per_node       : 1
cores_per_socket       : 2
threads_per_core       : 1
cpu_mhz                : 2793
hw_caps                : 
bfebfbff:20100800:00000000:00000180:0000e43d:00000000:00000001
total_memory           : 2046
free_memory            : 131
xen_major              : 3
xen_minor              : 0
xen_extra              : -unstable
xen_caps               : xen-3.0-x86_64 hvm-3.0-x86_32 hvm-3.0-x86_32p 
hvm-3.0-x86_64
xen_pagesize           : 4096
platform_params        : virt_start=0xffff800000000000
xen_changeset          : Wed Aug 30 22:36:18 2006 +0100 11388:50aea0ec406b
cc_compiler            : gcc version 4.0.0 20050519 (Red Hat 4.0.0-8)
cc_compile_by          : build
cc_compile_domain      : virtualiron.com
cc_compile_date        : Thu Aug 31 03:53:30 EDT 2006
xend_config_format     : 2
[root@tst177 ~]# xm list
Name                              ID Mem(MiB) VCPUs State  Time(s)
Domain-0                           0     1876     2 r-----    42.1
[root@tst177 ~]# (XEN) sh_update_paging_modes: postponing determination of 
shadow mode
(XEN) sh_update_paging_modes: postponing determination of shadow mode
ip_tables: (C) 2000-2006 Netfilter Core Team
(XEN) vmx_do_launch(): GUEST_CR3<=00fdb7a0, HOST_CR3<=0397b000
(XEN) (GUEST: 1) HVM Loader
(XEN) (GUEST: 1) Detected Xen v3.0-unstable
(XEN) (GUEST: 1) Loading ROMBIOS ...
(XEN) (GUEST: 1) Creating MP tables ...
(XEN) (GUEST: 1) Loading Cirrus VGABIOS ...
(XEN) (GUEST: 1) Loading ACPI ...
(XEN) (GUEST: 1) Writing SMBIOS tables ...
(XEN) (GUEST: 1) Loading VMXAssist ...
(XEN) (GUEST: 1) VMX go ...
(XEN) (GUEST: 1) VMXAssist (Aug 31 2006)
(XEN) (GUEST: 1) Memory size 256 MB
(XEN) (GUEST: 1) E820 map:
(XEN) (GUEST: 1) 0000000000000000 - 000000000009F000 (RAM)
(XEN) (GUEST: 1) 000000000009F000 - 00000000000A0000 (Reserved)
(XEN) (GUEST: 1) 00000000000A0000 - 00000000000C0000 (Type 16)
(XEN) (GUEST: 1) 00000000000F0000 - 0000000000100000 (Reserved)
(XEN) (GUEST: 1) 0000000000100000 - 000000000FFF0000 (RAM)
(XEN) (GUEST: 1) 000000000FFF0000 - 000000000FFFA000 (ACPI Data)
(XEN) (GUEST: 1) 000000000FFFA000 - 000000000FFFD000 (ACPI NVS)
(XEN) (GUEST: 1) 000000000FFFD000 - 000000000FFFE000 (Type 19)
(XEN) (GUEST: 1) 000000000FFFE000 - 000000000FFFF000 (Type 18)
(XEN) (GUEST: 1) 000000000FFFF000 - 0000000010000000 (Type 17)
(XEN) (GUEST: 1) 00000000FEC00000 - 0000000100000000 (Type 16)
(XEN) (GUEST: 1)
(XEN) (GUEST: 1) Start BIOS ...
(XEN) (GUEST: 1) Starting emulated 16-bit real-mode: ip=F000:FFF0
(XEN) (GUEST: 1)  rombios.c,v 1.138 2005/05/07 15:55:26 vruppert Exp $
(XEN) (GUEST: 1) Remapping master: ICW2 0x8 -> 0x20
(XEN) (GUEST: 1) Remapping slave: ICW2 0x70 -> 0x28
(XEN) (GUEST: 1) VGABios $Id: vgabios.c,v 1.61 2005/05/24 16:50:50 vruppert Exp 
$
(XEN) (GUEST: 1) HVMAssist BIOS, 1 cpu, $Revision: 1.138 $ $Date: 2005/05/07 
15:55:26 $
(XEN) (GUEST: 1)
(XEN) (GUEST: 1) ata0-0: PCHS=16383/16/63 translation=lba LCHS=1024/255/63
(XEN) (GUEST: 1) ata0 master: QEMU HARDDISK ATA-7 Hard-Disk (12997 MBytes)
(XEN) (GUEST: 1) ata0  slave: Unknown device
(XEN) (GUEST: 1)
(XEN) (GUEST: 1) Booting from Hard Disk...
(XEN) (GUEST: 1) int13_harddisk: function 41, unmapped device for ELDL=81
(XEN) (GUEST: 1) int13_harddisk: function 08, unmapped device for ELDL=81
(XEN) (GUEST: 1) *** int 15h function AX=00C0, BX=0000 not yet supported!
(XEN) (GUEST: 1) int13_harddisk: function 15, unmapped device for ELDL=81
(XEN) (GUEST: 1) *** int 15h function AX=EC00, BX=0002 not yet supported!
(XEN) (GUEST: 1) KBD: unsupported int 16h function 03
(XEN) (GUEST: 1) int13_harddisk: function 15, unmapped device for ELDL=81
(XEN) (GUEST: 1) int13_harddisk: function 02, unmapped device for ELDL=81
(XEN) (GUEST: 1) int13_harddisk: function 41, unmapped device for ELDL=81
(XEN) Local APIC Write to read-only register
(XEN) This hvm_vlapic is for P4, no work for De-assert init
(XEN) AP 1 bringup suceeded.
(XEN) malloc vlapic regs error for vcpu 1
(XEN) vmx_do_launch(): GUEST_CR3<=00fd97a0, HOST_CR3<=039dc000
(XEN) (GUEST: 1) Start AP 1 from 00006000 ...
(XEN) (GUEST: 1) Starting emulated 16-bit real-mode: ip=0600:0000
(XEN) ----[ Xen-3.0-unstable    Not tainted ]----
(XEN) CPU:    1
(XEN) RIP:    e010:[<ffff83000013d647>] vlapic_range+0x7/0x40
(XEN) RFLAGS: 0000000000010246   CONTEXT: hypervisor
(XEN) rax: ffff83000018e970   rbx: ffff8300001888a0   rcx: ffff830050d85008
(XEN) rdx: 0000000000000000   rsi: 00000000fee00020   rdi: ffff830000fd8080
(XEN) rbp: 0000000000000000   rsp: ffff830000ff3ae0   r8:  0000000000000000
(XEN) r9:  0000000000000001   r10: 0000000000000004   r11: 0000000000000200
(XEN) r12: ffff830000fd8080   r13: ffff830050d85040   r14: ffff8300001888a0
(XEN) r15: ffff830000fd96b0   cr0: 000000008005003b   cr3: 00000000039da000
(XEN) ds: 0000   es: 0000   fs: 0000   gs: 0000   ss: 0000   cs: e010
(XEN) Xen stack trace from rsp=ffff830000ff3ae0:
(XEN)    ffff830000138ac6 0000000000000007 0000000000000007 ffffffff804e1a3c
(XEN)    ffff83000014ffbe ffffffff804e1a3c ffff830050d85040 ffff830000fd8080
(XEN)    0000000000000001 0000000000000000 0000000000000000 ffff830000fd96b0
(XEN)    ffff83000013a44f 000000000004f77f 00000004ffffffff 0000000000000001
(XEN)    00000000fee00020 00000001001fe080 ffff830000ff3c08 0000000000000001
(XEN)    00000000fee00020 0000000000000007 ffff830000ff3c08 ffff830000fd9690
(XEN)    ffff83000013aa12 0000000000000000 00000000000fee00 ffff830000ff3c28
(XEN)    0000000000000000 ffff830000fd96b0 ffff83000013b9af 0000000000000000
(XEN)    0000000000000000 ffff830000ff3f28 00000000fee00020 ffffffffff5fd020
(XEN)    ffff830000ff3f28 0000000000040206 0000000000000000 0400000200000000
(XEN)    0000000004060001 00ff5fd02025348b 0000000000000000 0000000000000000
(XEN)    00000000000fee00 80000000fee00762 00000000fee00020 ffff830000fd8080
(XEN)    ffff8300001f0080 ffff8300001f0080 00000000000fee00 0000000000003962
(XEN)    ffff8300001533df ffff830000fd8080 ffffffffff5fd020 ffff81ffffffafe8
(XEN)    0000000100fd8080 0000000000003963 ffff8140ffffffd0 0000000000003969
(XEN)    00000000000039db ffff828400ca6570 0000000050f56667 0000000000000001
(XEN)    0000000100124f3f 000000000000681e 0000000000000000 0000000050f56667
(XEN)    ffff83000014f4e7 0000000000000000 ffff8300039df170 00000000000001d2
(XEN)    0000000000050f56 000ffffffffff000 0000000000ca6570 00000000000039df
(XEN)    ffff83000014f75f ffff830000fd8080 ffff830000fd7a00 0000000000000636
(XEN) Xen call trace:
(XEN)    [<ffff83000013d647>] vlapic_range+0x7/0x40
(XEN)    [<ffff830000138ac6>] hvm_mmio_intercept+0x66/0x370
(XEN)    [<ffff83000014ffbe>] sh_gva_to_gfn__shadow_4_guest_4+0xe/0x30
(XEN)    [<ffff83000013a44f>] send_mmio_req+0x16f/0x1e0
(XEN)    [<ffff83000013aa12>] mmio_operands+0x112/0x160
(XEN)    [<ffff83000013b9af>] handle_mmio+0xf4f/0x11c0
(XEN)    [<ffff8300001533df>] sh_page_fault__shadow_4_guest_4+0xf1f/0xf70
(XEN)    [<ffff83000014f4e7>] shadow_set_l1e+0x157/0x180
(XEN)    [<ffff83000014f75f>] sh_remove_write_access__shadow_4_guest_4+0x8f/0xd0
(XEN)    [<ffff83000014ba0a>] hash_foreach+0x6a/0xb0
(XEN)    [<ffff830000149743>] vmx_cr_access+0x363/0x1020
(XEN)    [<ffff83000014670b>] vmx_do_page_fault+0x2b/0x50
(XEN)    [<ffff83000014a8ff>] vmx_vmexit_handler+0x4ff/0x12b0
(XEN)    [<ffff830000144602>] cpu_has_pending_irq+0x32/0x60
(XEN)    [<ffff830000144738>] vmx_intr_assist+0x108/0x430
(XEN)    [<ffff83000014b6d5>] vmx_asm_vmexit_handler+0x25/0x30
(XEN)
(XEN) Pagetable walk from 0000000000000000:
(XEN)  L4[0x000] = 0000000000000000 ffffffffffffffff
(XEN)
(XEN) ****************************************
(XEN) Panic on CPU 1:
(XEN) CPU1 FATAL PAGE FAULT
(XEN) [error_code=0000]
(XEN) Faulting linear address: 0000000000000000
(XEN) ****************************************
(XEN)
(XEN) Reboot in five seconds...
_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel

 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.