Re: [Xen-users] XEN 4.2.2: Windows 2008 R2 server HVM does not start when attempting to use more than 3072MB of RAM

[Wei Liu <wei.liu2@xxxxxxxxxx>]

On Mon, Jul 01, 2013 at 12:12:31AM +0300, NiX wrote:
> System:
> 
> CPU's: 2 x XEON X5450
> Motherboard: http://www.intel.com/p/en_US/support/highlights/server/s5000psl/
> RAM: 16GB DDR2 ECC
> OS: Debian 7.0 64bit
> 
> If I attempt to use more than 3GB of RAM to the guest below (Windows 2008
> server R2 64bit) it will end up with the following error message:
> 
> xl create win_2008_server_hvm.cfg
> Parsing config from win_2008_server_hvm.cfg
> xc: info: VIRTUAL MEMORY ARRANGEMENT:
>   Loader:        0000000000100000->000000000019df48
>   TOTAL:         0000000000000000->00000000ff000000
>   ENTRY ADDRESS: 0000000000100000
> xc: info: PHYSICAL MEMORY ALLOCATION:
>   4KB PAGES: 0x0000000000000200
>   2MB PAGES: 0x00000000000003f7
>   1GB PAGES: 0x0000000000000002
> xc: error: panic: xc_dom_boot.c:388: xc_dom_gnttab_hvm_seed: failed to add
> gnttab to physmap [errno=22]
> : Internal error

I think I've experience this before. And a fix by Tim / Jan went into
Xen-unstable to fix this.

Unfortunately I could not get hold of that changeset as it was not
directly related to this problem. Could you try Xen-4.3-rc6 and see if
you still see this error?

> libxl: error: libxl_dm.c:1218:device_model_spawn_outcome: domain 1 device
> model: spawn failed (rc=-3)
> libxl: error: libxl_exec.c:118:libxl_report_child_exitstatus:
> /etc/xen/scripts/vif-bridge add [4567] exited with error status 1
> libxl: error: libxl_create.c:1116:domcreate_attach_pci: unable to add nic
> devices
> libxl: error: libxl_dm.c:1251:libxl__destroy_device_model: Device Model
> already exited
> 
> On my AMD 1090T CPU with 12GB DDR3, there is no issues whatsoever starting
> windows 2008 R2 server with more than 4GB of RAM.
> 

So you mean the exact same version of Xen, exact configs of everything,
on AMD box, doesn't have this problem? Weird...


Wei.

> Any solution for XEON based hardware?
> 
> ------------------------------
> cat win_2008_server_hvm.cfg
> ------------------------------
> builder="hvm"
> vcpus=1
> memory=3072
> name="Windows.Server.2008.R2.Enterprise.x64.SP1"
> 
> # rtl8139 e1000
> 
> vif = [
> "type=ioemu,ip=10.100.12.6,mac=00:16:3E:E6:7E:48,bridge=br0,model=rtl8139"
> ]
> disk = [ "raw:/home/servers/xen/images/win_2008_server.img,ioemu:hda,w" ]
> 
> boot="c"
> 
> serial="pty"
> usbdevice="tablet"
> 
> sdl=0
> vnc=1
> vncpasswd="secret12345"
> vnclisten="0.0.0.0"
> vncdisplay=10
> vncconsole=1
> monitor=1
> 
> acpi=1
> apic=1
> localtime=0
> xen_platform_pci=1
> stdvga=1
> videoram=16
> gfx_passthru=0
> 
> shadow_memory=8
> 
> on_poweroff="destroy"
> on_reboot="restart"
> on_crash="restart"
> 
> ------------------------------
> xl info
> ------------------------------
> 
> host                   : nix
> release                : 3.2.47-grsec
> version                : #10 SMP Sun Jun 23 00:19:06 EEST 2013
> machine                : x86_64
> nr_cpus                : 8
> max_cpu_id             : 7
> nr_nodes               : 1
> cores_per_socket       : 4
> threads_per_core       : 1
> cpu_mhz                : 2992
> hw_caps                :
> bfebfbff:20100800:00000000:00000940:040ce3bd:00000000:00000001:00000000
> virt_caps              : hvm
> total_memory           : 16378
> free_memory            : 646
> sharing_freed_memory   : 0
> sharing_used_memory    : 0
> free_cpus              : 0
> xen_major              : 4
> xen_minor              : 2
> xen_extra              : .2
> xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32
> hvm-3.0-x86_32p hvm-3.0-x86_64
> xen_scheduler          : credit
> xen_pagesize           : 4096
> platform_params        : virt_start=0xffff800000000000
> xen_changeset          : unavailable
> xen_commandline        : placeholder
> cc_compiler            : gcc (Debian 4.7.2-5) 4.7.2
> cc_compile_by          : root
> cc_compile_domain      :
> cc_compile_date        : Mon Jun  3 19:24:27 EEST 2013
> xend_config_format     : 4
> 
> ------------------------------
> xl dmesg
> ------------------------------
>  __  __            _  _    ____    ____
>  \ \/ /___ _ __   | || |  |___ \  |___ \
>   \  // _ \ '_ \  | || |_   __) |   __) |
>   /  \  __/ | | | |__   _| / __/ _ / __/
>  /_/\_\___|_| |_|    |_|(_)_____(_)_____|
> 
> (XEN) Xen version 4.2.2 (root@) (gcc (Debian 4.7.2-5) 4.7.2) Mon Jun  3
> 19:24:27 EEST 2013
> (XEN) Latest ChangeSet: unavailable
> (XEN) Bootloader: GRUB 1.99-27+deb7u1
> (XEN) Command line: placeholder
> (XEN) Video information:
> (XEN)  VGA is text mode 80x25, font 8x16
> (XEN)  VBE/DDC methods: V2; EDID transfer time: 2 seconds
> (XEN) Disc information:
> (XEN)  Found 5 MBR signatures
> (XEN)  Found 5 EDD information structures
> (XEN) Xen-e820 RAM map:
> (XEN)  0000000000000000 - 000000000009b000 (usable)
> (XEN)  000000000009b000 - 0000000000100000 (reserved)
> (XEN)  0000000000100000 - 00000000df91a000 (usable)
> (XEN)  00000000df91a000 - 00000000df9d1000 (ACPI NVS)
> (XEN)  00000000df9d1000 - 00000000dfa32000 (usable)
> (XEN)  00000000dfa32000 - 00000000dfa9a000 (reserved)
> (XEN)  00000000dfa9a000 - 00000000dfab4000 (usable)
> (XEN)  00000000dfab4000 - 00000000dfb1a000 (ACPI NVS)
> (XEN)  00000000dfb1a000 - 00000000dfb28000 (usable)
> (XEN)  00000000dfb28000 - 00000000dfb3a000 (ACPI data)
> (XEN)  00000000dfb3a000 - 00000000dfc00000 (usable)
> (XEN)  00000000dfc00000 - 00000000f0000000 (reserved)
> (XEN)  00000000ffc00000 - 00000000ffc0c000 (reserved)
> (XEN)  0000000100000000 - 0000000420000000 (usable)
> (XEN) ACPI: RSDP 000F0410, 0024 (r2 INTEL )
> (XEN) ACPI: XSDT DFB39120, 0074 (r1 INTEL  S5000PSL        0 INTL  1000013)
> (XEN) ACPI: FACP DFB37000, 00F4 (r3 INTEL  S5000PSL        0 INTL  1000013)
> (XEN) ACPI: DSDT DFB30000, 5809 (r2 INTEL  S5000PSL        1 INTL  1000013)
> (XEN) ACPI: FACS DFAB4000, 0040
> (XEN) ACPI: APIC DFB36000, 00C8 (r1 INTEL  S5000PSL        0 INTL  1000013)
> (XEN) ACPI: SPCR DFB2F000, 0050 (r1 INTEL  S5000PSL        0 INTL  1000013)
> (XEN) ACPI: HPET DFB2E000, 0038 (r1 INTEL  S5000PSL        1 INTL  1000013)
> (XEN) ACPI: MCFG DFB2D000, 003C (r1 INTEL  S5000PSL        1 INTL  1000013)
> (XEN) ACPI: SSDT DFB2C000, 0193 (r2  INTEL IPMI         4000 INTL 20060317)
> (XEN) ACPI: HEST DFB2B000, 00A8 (r1 INTEL  S5000PSL        1 INTL        1)
> (XEN) ACPI: BERT DFB2A000, 0030 (r1 INTEL  S5000PSL        1 INTL        1)
> (XEN) ACPI: ERST DFB29000, 0230 (r1 INTEL  S5000PSL        1 INTL        1)
> (XEN) ACPI: EINJ DFB28000, 0130 (r1 INTEL  S5000PSL        1 INTL        1)
> (XEN) System RAM: 16378MB (16771088kB)
> (XEN) Domain heap initialised
> (XEN) Processor #0 7:7 APIC version 20
> (XEN) Processor #2 7:7 APIC version 20
> (XEN) Processor #4 7:7 APIC version 20
> (XEN) Processor #6 7:7 APIC version 20
> (XEN) Processor #1 7:7 APIC version 20
> (XEN) Processor #3 7:7 APIC version 20
> (XEN) Processor #5 7:7 APIC version 20
> (XEN) Processor #7 7:7 APIC version 20
> (XEN) IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
> (XEN) IOAPIC[1]: apic_id 9, version 32, address 0xfec80000, GSI 24-47
> (XEN) Enabling APIC mode:  Flat.  Using 2 I/O APICs
> (XEN) Using scheduler: SMP Credit Scheduler (credit)
> (XEN) Detected 2992.578 MHz processor.
> (XEN) Initing memory sharing.
> (XEN) xstate_init: using cntxt_size: 0x240 and states: 0x3
> (XEN) I/O virtualisation disabled
> (XEN) ENABLING IO-APIC IRQs
> (XEN)  -> Using new ACK method
> (XEN) Platform timer is 14.318MHz HPET
> (XEN) Allocated console ring of 16 KiB.
> (XEN) VMX: Supported advanced features:
> (XEN)  - APIC MMIO access virtualisation
> (XEN)  - APIC TPR shadow
> (XEN)  - Virtual NMI
> (XEN)  - MSR direct-access bitmap
> (XEN) HVM: ASIDs disabled.
> (XEN) HVM: VMX enabled
> (XEN) Brought up 8 CPUs
> (XEN) *** LOADING DOMAIN 0 ***
> (XEN)  Xen  kernel: 64-bit, lsb, compat32
> (XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x1c00000
> (XEN) PHYSICAL MEMORY ARRANGEMENT:
> (XEN)  Dom0 alloc.:   000000040c000000->0000000410000000 (4095169 pages to
> be allocated)
> (XEN)  Init. ramdisk: 000000041fa89000->000000041ffffe00
> (XEN) VIRTUAL MEMORY ARRANGEMENT:
> (XEN)  Loaded kernel: ffffffff81000000->ffffffff81c00000
> (XEN)  Init. ramdisk: ffffffff81c00000->ffffffff82176e00
> (XEN)  Phys-Mach map: ffffffff82177000->ffffffff840d81c0
> (XEN)  Start info:    ffffffff840d9000->ffffffff840d94b4
> (XEN)  Page tables:   ffffffff840da000->ffffffff840ff000
> (XEN)  Boot stack:    ffffffff840ff000->ffffffff84100000
> (XEN)  TOTAL:         ffffffff80000000->ffffffff84400000
> (XEN)  ENTRY ADDRESS: ffffffff819661c0
> (XEN) Dom0 has maximum 8 VCPUs
> (XEN) Scrubbing Free RAM: .done.
> (XEN) Initial low memory virq threshold set at 0x4000 pages.
> (XEN) Std. Loglevel: Errors and warnings
> (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
> (XEN) Xen is relinquishing VGA console.
> (XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input
> to Xen)
> (XEN) Freed 268kB init memory.
> 
> 
> _______________________________________________
> Xen-users mailing list
> Xen-users@xxxxxxxxxxxxx
> http://lists.xen.org/xen-users

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxx
http://lists.xen.org/xen-users