* Hardware:
Supermicro H8D3II+-F, 1x Opteron 2376 (AMD 5690+5670 chipset, IOMMU enabled, iommu=1, iommu=pt, has bad bios: used patch to forced enabled IOMMU – some ignored wrong tables)
20GB RAM (should’ve been 24Gigs, probing Bios messages next days)
AMD 6450 for passthrough
10GBit Broadcom NIC („bridge1“)
* Software:
Ubuntu 12.04 x64, kernel 3.9.4 custom
* Guest operating systems:
Windows 2008 R2 x64 (HVM), old installation automatically (unintentionally) migrated from KVM ;)
* Functionality tested:
xl
VGA passthrough
PV SCSI
PV net (10Gig, BCM57810)
* Comments:
It did not boot the installation-cd but directly the old (forgotten) installation found in the 100gb-raw-image-file. Immediately updated to PV drivers (SCSI, e1000@1GBit->Xen-Net@10Gbit, XEN PCI) and demanded reboot. After reboot, the GPU Passthrough (AMD 6450 passive) was present and used connected AV-Receiver->Beamer. Full System update and installation of newest AMD-drivers (13.6 beta) sound device was present and working (AMD High Definition, over HDMI->AV-Receiver).
IMPORTANT! It only went beyond „BSOD“ when reducing RAM to <4GB! This is only badly written on any WIKI, I found it after many frustrating hours in a forum. I thought this a KVM-problem… :/ On a 64bit-host a 64-bit-guest should not have these problems…?!
Config:
#####
builder = "hvm"
vcpus = 2
memory = "2048"
##### Disks
disk = [
'file:/recording/virtual/w2k8r2x64.img,hda,w',
'file:/recording/archiv/Systeme/w2k8r2x64/w2k8r2x64_X15-50367.img,hdc:cdrom,r',
#'phy:/dev/sr0,hdd:cdrom,r'
]
##### Hostname
name = "w2k8r2x64"
##### Networking
vif = ['model=e1000,ip=172.16.1.252,mac=00:26:B9:48:74:d9,bridge=bridge1']
##### Behavior
>
>
>
##### Monitoring
vnc=1 # Enable VNC
vncconsole=1 #
gfx_passthrough = 1
pci = ['01:00.0','01:00.1']
keymap = "de"
boot = „d“
xl dmesg:
(XEN) HVM15: HVM Loader
(XEN) HVM15: Detected Xen v4.3-unstable
(XEN) HVM15: Xenbus rings @0xfeffc000, event channel 4
(XEN) HVM15: System requested SeaBIOS
(XEN) HVM15: CPU speed is 2300 MHz
(XEN) irq.c:270: Dom15 PCI link 0 changed 0 -> 5
(XEN) HVM15: PCI-ISA link 0 routed to IRQ5
(XEN) irq.c:270: Dom15 PCI link 1 changed 0 -> 10
(XEN) HVM15: PCI-ISA link 1 routed to IRQ10
(XEN) irq.c:270: Dom15 PCI link 2 changed 0 -> 11
(XEN) HVM15: PCI-ISA link 2 routed to IRQ11
(XEN) irq.c:270: Dom15 PCI link 3 changed 0 -> 5
(XEN) HVM15: PCI-ISA link 3 routed to IRQ5
(XEN) HVM15: pci dev 01:3 INTA->IRQ10
(XEN) HVM15: pci dev 03:0 INTA->IRQ5
(XEN) HVM15: pci dev 04:0 INTA->IRQ5
(XEN) HVM15: pci dev 05:0 INTA->IRQ10
(XEN) HVM15: pci dev 06:0 INTB->IRQ5
(XEN) HVM15: pci dev 05:0 bar 10 size lx: 10000000
(XEN) memory_map:add: dom15 gfn=e0000 mfn=d0000 nr=10000
(XEN) HVM15: pci dev 02:0 bar 10 size lx: 02000000
(XEN) HVM15: pci dev 03:0 bar 14 size lx: 01000000
(XEN) HVM15: pci dev 04:0 bar 10 size lx: 00020000
(XEN) HVM15: pci dev 04:0 bar 30 size lx: 00020000
(XEN) memory_map:add: dom15 gfn=f3040 mfn=fd3e0 nr=20
(XEN) HVM15: pci dev 05:0 bar 18 size lx: 00020000
(XEN) HVM15: pci dev 05:0 bar 30 size lx: 00020000
(XEN) HVM15: pci dev 02:0 bar 30 size lx: 00010000
(XEN) HVM15: pci dev 06:0 bar 10 size lx: 00004000
(XEN) memory_map:add: dom15 gfn=f3090 mfn=fd3bc nr=4
(XEN) HVM15: pci dev 02:0 bar 14 size lx: 00001000
(XEN) HVM15: pci dev 03:0 bar 10 size lx: 00000100
(XEN) HVM15: pci dev 05:0 bar 20 size lx: 00000100
(XEN) ioport_map:add: dom15 gport=c100 mport=b000 nr=100
(XEN) HVM15: pci dev 04:0 bar 14 size lx: 00000040
(XEN) HVM15: pci dev 01:1 bar 20 size lx: 00000010
(XEN) HVM15: Multiprocessor initialisation:
(XEN) HVM15: - CPU0 ... 48-bit phys ... fixed MTRRs ... var MTRRs [3/8] ... done.
(XEN) HVM15: - CPU1 ... 48-bit phys ... fixed MTRRs ... var MTRRs [3/8] ... done.
(XEN) HVM15: Testing HVM environment:
(XEN) HVM15: - REP INSB across page boundaries ... passed
(XEN) HVM15: - GS base MSRs and SWAPGS ... passed
(XEN) HVM15: Passed 2 of 2 tests
(XEN) HVM15: Writing SMBIOS tables ...
(XEN) HVM15: Loading SeaBIOS ...
(XEN) HVM15: Creating MP tables ...
(XEN) HVM15: Loading ACPI ...
(XEN) HVM15: vm86 TSS at fc00a080
(XEN) HVM15: BIOS map:
(XEN) HVM15: 10000-100d3: Scratch space
(XEN) HVM15: e0000-fffff: Main BIOS
(XEN) HVM15: E820 table:
(XEN) HVM15: [00]: 00000000:00000000 - 00000000:000a0000: RAM
(XEN) HVM15: HOLE: 00000000:000a0000 - 00000000:000e0000
(XEN) HVM15: [01]: 00000000:000e0000 - 00000000:00100000: RESERVED
(XEN) HVM15: [02]: 00000000:00100000 - 00000000:7f800000: RAM
(XEN) HVM15: HOLE: 00000000:7f800000 - 00000000:fc000000
(XEN) HVM15: [03]: 00000000:fc000000 - 00000001:00000000: RESERVED
(XEN) HVM15: Invoking SeaBIOS ...
(XEN) HVM15: SeaBIOS (version rel-1.7.1-2-g30ef08f-20130526_001220-server)
(XEN) HVM15:
(XEN) HVM15: Found Xen hypervisor signature at 40000000
(XEN) HVM15: xen: copy e820...
(XEN) HVM15: Ram Size=0x7f800000 (0x0000000000000000 high)
(XEN) HVM15: Relocating low data from 0x000e3d70 to 0x000ef790 (size 2153)
(XEN) HVM15: Relocating init from 0x000e45d9 to 0x7f7e2bf0 (size 53991)
(XEN) HVM15: CPU Mhz=2300
(XEN) HVM15: Found 9 PCI devices (max PCI bus is 00)
(XEN) HVM15: Allocated Xen hypercall page at 7f7ff000
(XEN) HVM15: Detected Xen v4.3-unstable
(XEN) HVM15: Found 2 cpu(s) max supported 2 cpu(s)
(XEN) HVM15: xen: copy BIOS tables...
(XEN) HVM15: Copying SMBIOS entry point from 0x00010010 to 0x000fdbd0
(XEN) HVM15: Copying MPTABLE from 0xfc001160/fc001170 to 0x000fdad0
(XEN) HVM15: Copying PIR from 0x00010030 to 0x000fda50
(XEN) HVM15: Copying ACPI RSDP from 0x000100b0 to 0x000fda20
(XEN) HVM15: Scan for VGA option rom
(XEN) HVM15: Running option rom at c000:0003
(XEN) stdvga.c:147:d15 entering stdvga and caching modes
(XEN) HVM15: Turning on vga text mode console
(XEN) HVM15: SeaBIOS (version rel-1.7.1-2-g30ef08f-20130526_001220-server)
(XEN) HVM15:
(XEN) HVM15: Found 1 lpt ports
(XEN) HVM15: Found 1 serial ports
(XEN) HVM15: ATA controller 1 at 1f0/3f4/c240 (irq 14 dev 9)
(XEN) HVM15: ATA controller 2 at 170/374/c248 (irq 15 dev 9)
(XEN) HVM15: ata0-0: QEMU HARDDISK ATA-7 Hard-Disk (108 GiBytes)
(XEN) HVM15: Searching bootorder for: /pci@i0cf8/*@1,1/drive@0/disk@0
(XEN) HVM15: DVD/CD [ata1-0: QEMU DVD-ROM ATAPI-4 DVD/CD]
(XEN) HVM15: Searching bootorder for: /pci@i0cf8/*@1,1/drive@1/disk@0
(XEN) HVM15: PS2 keyboard initialized
(XEN) HVM15: All threads complete.
(XEN) HVM15: Scan for option roms
(XEN) HVM15: Running option rom at c900:0003
(XEN) HVM15: pmm call arg1=1
(XEN) HVM15: pmm call arg1=0
(XEN) HVM15: pmm call arg1=1
(XEN) HVM15: pmm call arg1=0
(XEN) HVM15: Searching bootorder for: /pci@i0cf8/*@4
(XEN) HVM15: Press F12 for boot menu.
(XEN) HVM15:
(XEN) HVM15: drive 0x000fd9d0: PCHS=16383/16/63 translation=lba LCHS=1024/255/63 s=22649241
(XEN) HVM15: 6
(XEN) HVM15: Space available for UMB: 000ca000-000ee800
(XEN) HVM15: Returned 61440 bytes of ZoneHigh
(XEN) HVM15: e820 map has 6 items:
(XEN) HVM15: 0: 0000000000000000 - 000000000009fc00 = 1 RAM
(XEN) HVM15: 1: 000000000009fc00 - 00000000000a0000 = 2 RESERVED
(XEN) HVM15: 2: 00000000000f0000 - 0000000000100000 = 2 RESERVED
(XEN) HVM15: 3: 0000000000100000 - 000000007f7ff000 = 1 RAM
(XEN) HVM15: 4: 000000007f7ff000 - 000000007f800000 = 2 RESERVED
(XEN) HVM15: 5: 00000000fc000000 - 0000000100000000 = 2 RESERVED
(XEN) HVM15: enter handle_19:
(XEN) HVM15: NULL
(XEN) HVM15: Booting from DVD/CD...
(XEN) HVM15: Booting from 0000:7c00
(XEN) stdvga.c:151:d15 leaving stdvga
(XEN) stdvga.c:147:d15 entering stdvga and caching modes
(XEN) irq.c:270: Dom15 PCI link 0 changed 5 -> 0
(XEN) irq.c:270: Dom15 PCI link 1 changed 10 -> 0
(XEN) irq.c:270: Dom15 PCI link 2 changed 11 -> 0
(XEN) irq.c:270: Dom15 PCI link 3 changed 5 -> 0
(XEN) memory_map:remove: dom15 gfn=e0000 mfn=d0000 nr=10000
(XEN) memory_map:remove: dom15 gfn=f3040 mfn=fd3e0 nr=20
(XEN) ioport_map:remove: dom15 gport=c100 mport=b000 nr=100
(XEN) memory_map:add: dom15 gfn=e0000 mfn=d0000 nr=10000
(XEN) memory_map:add: dom15 gfn=f3040 mfn=fd3e0 nr=20
(XEN) ioport_map:add: dom15 gport=c100 mport=b000 nr=100
(XEN) memory_map:remove: dom15 gfn=f3090 mfn=fd3bc nr=4
(XEN) memory_map:add: dom15 gfn=f3090 mfn=fd3bc nr=4
(XEN) grant_table.c:1250:d15 Expanding dom (15) grant table from (4) to (32) frames.
(XEN) irq.c:375: Dom15 callback via changed to GSI 28
(XEN) grant_table.c:289:d0 Increased maptrack size to 2 frames
(XEN) memory_map:remove: dom15 gfn=e0000 mfn=d0000 nr=10000
(XEN) memory_map:remove: dom15 gfn=f3040 mfn=fd3e0 nr=20
(XEN) ioport_map:remove: dom15 gport=c100 mport=b000 nr=100
(XEN) memory_map:add: dom15 gfn=e0000 mfn=d0000 nr=10000
(XEN) memory_map:add: dom15 gfn=f3040 mfn=fd3e0 nr=20
(XEN) ioport_map:add: dom15 gport=c100 mport=b000 nr=100
(XEN) memory_map:remove: dom15 gfn=f3090 mfn=fd3bc nr=4
(XEN) memory_map:add: dom15 gfn=f3090 mfn=fd3bc nr=4
(XEN) stdvga.c:151:d15 leaving stdvga
(XEN) memory_map:remove: dom15 gfn=e0000 mfn=d0000 nr=10000
(XEN) memory_map:remove: dom15 gfn=f3040 mfn=fd3e0 nr=20
(XEN) ioport_map:remove: dom15 gport=c100 mport=b000 nr=100
(XEN) memory_map:add: dom15 gfn=e0000 mfn=d0000 nr=10000
(XEN) memory_map:add: dom15 gfn=f3040 mfn=fd3e0 nr=20
(XEN) ioport_map:add: dom15 gport=c100 mport=b000 nr=100
(XEN) stdvga.c:147:d15 entering stdvga and caching modes
(XEN) 'u' pressed -> dumping numa info (now-0x1571:A50786B7)
(XEN) idx0 -> NODE0 start->0 size->5439488 free->1687393
(XEN) phys_to_nid(0000000000001000) -> 0 should be 0
(XEN) CPU0 -> NODE0
(XEN) CPU1 -> NODE0
(XEN) CPU2 -> NODE0
(XEN) CPU3 -> NODE0
(XEN) Memory location of each domain:
(XEN) Domain 0 (total: 2967805):
(XEN) Node 0: 2967805
(XEN) Domain 15 (total: 524067):
(XEN) Node 0: 524067
Fine so far!
