[Xen-users] >2GB RAM issue for passed through VF devices

[Matthew Hook <matthew.hook@xxxxxxxx>]

Good afternoon xen users.

I am passing through a Mellanox Infiniband virtual function device into a Paravirtualised guest

under xen 4.1.x

When the guest has <= 2GB of RAM it works perfectly.

If I increase the RAM to > 2GB it fails to initialize.

[    7.999791] pci 0000:00:00.1: [15b3:1004] type 00 class 0x028000

[    8.000989] pci 0000:00:00.1: reg 0x18: [mem 0xbe000000-0xbe7fffff 64bit pref]

[    8.002810] pcifront pci-0: New device on 0000:00:00.1 found.

[    8.005248] pcifront pci-0: claiming resource 0000:00:00.1/2

[    8.005254] pci 0000:00:00.1: address space collision: [mem 0xbe000000-0xbe7fffff 64bit pref] conflicts with System RAM [mem 0x00100000-0x1007fffff]

[    8.005257] pcifront pci-0: Could not claim resource 0000:00:00.1/2! Device offline. Try using e820_host=1 in the guest config.

[    8.005390] mlx4_core: Mellanox ConnectX core driver v1.1 (Dec, 2011)

[    8.005392] mlx4_core: Initializing 0000:00:00.1

[    8.005431] mlx4_core 0000:00:00.1: device not available (can't reserve [mem 0xbe000000-0xbe7fffff 64bit pref])

[    8.005441] mlx4_core 0000:00:00.1: Cannot enable PCI device, aborting.

[    8.005451] mlx4_core: probe of 0000:00:00.1 failed with error -2

I have tried putting e820_host=1 into the guest config as suggested but that didn't fix it.

Neither did adding iommu=soft or iommu=1 or any other settings to the guest kernel command line that I've read about from googling this problem.

How can I solve or work around this problem?  I need to give my guest more than 2GB of physical memory.

Regards,  Matthew

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxx
http://lists.xen.org/xen-users