[Xen-users] PCI passthrough problem

[Leo Krüger <leo.krueger@xxxxxxxxxxxxx>]

Hello,

I'm having huge problems getting pci passthrough to work.
There is a mini-pcie wlan-card (atheros, requires ath9k) which I want to
pass to a domU.
Everytime ath9k is loaded in domU, I get these errors:

PCI memory map error
ath9k: probe of 0000:00:00.0 failed with error -5

The device is of course hidden with pciback.hide for dom0. Xen Version is
3.4.1 and 3.4 (tried both), Kernel in dom0 and domU is 2.6.26 (debian) or
2.6.27 (XCI) or 2.6.29.6 (OpenSUSE Xen kernel patches).

Is there anyone on this list who has even a small idea why this isn't
working?
I'm kind of frustrated... with xen 3.2 it worked without a problem.

Greetings, Leo



Here is the output of xm dmesg:

debserv:~# xm dmesg
(XEN) Xen version 3.4 (Debian 3.4.0-2) (waldi@xxxxxxxxxx) (gcc version 4.3.3
(De
bian 4.3.3-14) ) Sat Jul 18 16:34:47 UTC 2009
(XEN) Command line: cpuidle cpufreq=xen
(XEN) Video information:
(XEN)  VGA is text mode 80x25, font 8x16
(XEN)  VBE/DDC methods: V2; EDID transfer time: 1 seconds
(XEN) Disc information:
(XEN)  Found 1 MBR signatures
(XEN)  Found 1 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN)  0000000000000000 - 000000000009fc00 (usable)
(XEN)  000000000009fc00 - 00000000000a0000 (reserved)
(XEN)  00000000000e0000 - 0000000000100000 (reserved)
(XEN)  0000000000100000 - 000000007f7c0000 (usable)
(XEN)  000000007f7c0000 - 000000007f7ce000 (ACPI data)
(XEN)  000000007f7ce000 - 000000007f800000 (ACPI NVS)
(XEN)  00000000fee00000 - 00000000fee01000 (reserved)
(XEN)  00000000fff80000 - 0000000100000000 (reserved)
(XEN) System RAM: 2039MB (2088316kB)
(XEN) ACPI: RSDP 000F9710, 0024 (r2 ACPIAM)
(XEN) ACPI: XSDT 7F7C0100, 004C (r1 030609 XSDT0942 20090306 MSFT       97)
(XEN) ACPI: FACP 7F7C0290, 00F4 (r3 030609 FACP0942 20090306 MSFT       97)
(XEN) ACPI: DSDT 7F7C0430, 465E (r1  A9830 A983010E      10E INTL 20051117)
(XEN) ACPI: FACS 7F7CE000, 0040
(XEN) ACPI: APIC 7F7C0390, 005C (r1 030609 APIC0942 20090306 MSFT       97)
(XEN) ACPI: MCFG 7F7C03F0, 003C (r1 030609 OEMMCFG  20090306 MSFT       97)
(XEN) ACPI: OEMB 7F7CE040, 0071 (r1 030609 OEMB0942 20090306 MSFT       97)
(XEN) ACPI: SSDT 7F7CE3D0, 04F0 (r1  PmRef    CpuPm     3000 INTL 20051117)
(XEN) Xen heap: 9MB (9660kB)
(XEN) Domain heap initialised
(XEN) Processor #0 7:12 APIC version 20
(XEN) Processor #1 7:12 APIC version 20
(XEN) IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23
(XEN) Enabling APIC mode:  Flat.  Using 1 I/O APICs
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 1596.020 MHz processor.
(XEN) CPU0: Intel Genuine Intel(R) CPU N270   @ 1.60GHz stepping 02
(XEN) Booting processor 1/1 eip 8c000
(XEN) CPU1: Intel Genuine Intel(R) CPU N270   @ 1.60GHz stepping 02
(XEN) Total of 2 processors activated.
(XEN) ENABLING IO-APIC IRQs
(XEN)  -> Using new ACK method
(XEN) checking TSC synchronization across 2 CPUs: passed.
(XEN) Platform timer is 3.579MHz ACPI PM Timer
(XEN) Brought up 2 CPUs
(XEN) I/O virtualisation disabled
(XEN) HPET broadcast init failed, turn to PIT broadcast.
(XEN) xenoprof: Initialization failed. Intel processor model 28 for P6 class
fam
ily is not supported
(XEN) *** LOADING DOMAIN 0 ***
(XEN)  Xen  kernel: 32-bit, PAE, lsb
(XEN)  Dom0 kernel: 32-bit, PAE, lsb, paddr 0x100000 -> 0xa5f000
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN)  Dom0 alloc.:   000000003c000000->000000003e000000 (475120 pages to be
all
ocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN)  Loaded kernel: c0100000->c0a5f000
(XEN)  Init. ramdisk: c0a5f000->c1a03200
(XEN)  Phys-Mach map: c1a04000->c1bdbfc0
(XEN)  Start info:    c1bdc000->c1bdc47c
(XEN)  Page tables:   c1bdd000->c1bf2000
(XEN)  Boot stack:    c1bf2000->c1bf3000
(XEN)  TOTAL:         c0000000->c2000000
(XEN)  ENTRY ADDRESS: c0100000
(XEN) Dom0 has maximum 2 VCPUs
(XEN) Scrubbing Free RAM: .done.
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: Errors and warnings
(XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to
Xen
)
(XEN) Freed 120kB init memory.
(XEN) xen_pminfo: @acpi_cpufreq_cpu_init,HARDWARE addr space
(XEN) CPU 0 initialization completed
(XEN) xen_pminfo: @acpi_cpufreq_cpu_init,HARDWARE addr space
(XEN) CPU 1 initialization completed
(XEN) mm.c:740:d1 Non-privileged (1) attempt to map I/O space 000febf0


debserv:~# xm info
host                   : debserv
release                : 2.6.29.6
version                : #3 SMP Mon Sep 28 03:03:06 CEST 2009
machine                : i686
nr_cpus                : 2
nr_nodes               : 1
cores_per_socket       : 1
threads_per_core       : 2
cpu_mhz                : 1596
hw_caps                :
bfe9fbff:00100000:00000000:00000140:0040c39d:00000000:00000001:00000000
virt_caps              :
total_memory           : 2039
free_memory            : 253
node_to_cpu            : node0:0-1
node_to_memory         : node0:253
xen_major              : 3
xen_minor              : 4
xen_extra              :
xen_caps               : xen-3.0-x86_32p
xen_scheduler          : credit
xen_pagesize           : 4096
platform_params        : virt_start=0xf5800000
xen_changeset          : unavailable
cc_compiler            : gcc version 4.3.3 (Debian 4.3.3-14)
cc_compile_by          : waldi
cc_compile_domain      : debian.org
cc_compile_date        : Sat Jul 18 16:34:47 UTC 2009
xend_config_format     : 4


And here is the bootlog of the virtual machine:

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 2.6.29.6 (root@debserv) (gcc version 4.3.2
(Debian
4.3.2-1.1) ) #3 SMP Mon Sep 28 03:03:06 CEST 2009
[    0.000000] Reserving virtual address space above 0xf5800000
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   NSC Geode by NSC
[    0.000000]   Cyrix CyrixInstead
[    0.000000]   Centaur CentaurHauls
[    0.000000]   Transmeta GenuineTMx86
[    0.000000]   Transmeta TransmetaCPU
[    0.000000] Xen-provided physical RAM map:
[    0.000000]  Xen: 0000000000000000 - 0000000020800000 (usable)
[    0.000000] last_pfn = 0x20800 max_arch_pfn = 0x10000000
[    0.000000] kernel direct mapping tables up to 20800000 @ 1a97000-1ba0000
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] RAMDISK: 00a5f000 - 01a04000
[    0.000000] ACPI in unprivileged domain disabled
[    0.000000] 0MB HIGHMEM available.
[    0.000000] 520MB LOWMEM available.
[    0.000000]   mapped low ram: 0 - 20800000
[root@ipfire ~]# cat /var/log/bootlog
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 2.6.29.6 (root@debserv) (gcc version 4.3.2
(Debian 4.3.2-1.1) ) #3 SMP Mon Sep 28 03:03:06 CEST 2009
[    0.000000] Reserving virtual address space above 0xf5800000
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   NSC Geode by NSC
[    0.000000]   Cyrix CyrixInstead
[    0.000000]   Centaur CentaurHauls
[    0.000000]   Transmeta GenuineTMx86
[    0.000000]   Transmeta TransmetaCPU
[    0.000000] Xen-provided physical RAM map:
[    0.000000]  Xen: 0000000000000000 - 0000000020800000 (usable)
[    0.000000] last_pfn = 0x20800 max_arch_pfn = 0x10000000
[    0.000000] kernel direct mapping tables up to 20800000 @ 1a97000-1ba0000
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] RAMDISK: 00a5f000 - 01a04000
[    0.000000] ACPI in unprivileged domain disabled
[    0.000000] 0MB HIGHMEM available.
[    0.000000] 520MB LOWMEM available.
[    0.000000]   mapped low ram: 0 - 20800000
[    0.000000]   low ram: 00000000 - 20800000
[    0.000000]   bootmap 00000000 - 00004000
[    0.000000] (4 early reservations) ==> bootmem [0000000000 - 0020000000]
[    0.000000]   #0 [0000100000 - 0000a5e77c]    TEXT DATA BSS ==>
[0000100000 - 0000a5e77c]
[    0.000000]   #1 [0000a5f000 - 0001a97000]     Xen provided ==>
[0000a5f000 - 0001a97000]
[    0.000000]   #2 [0001a97000 - 0001b90000]          PGTABLE ==>
[0001a97000 - 0001b90000]
[    0.000000]   #3 [0000000000 - 0000004000]          BOOTMAP ==>
[0000000000 - 0000004000]
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000000 -> 0x00001000
[    0.000000]   Normal   0x00001000 -> 0x00020800
[    0.000000]   HighMem  0x00020800 -> 0x00020800
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[1] active PFN ranges
[    0.000000]     0: 0x00000000 -> 0x00020800
[    0.000000] On node 0 totalpages: 133120
[    0.000000] free_area_init_node: node 0, pgdat c03b8680, node_mem_map
c1b90000
[    0.000000]   DMA zone: 32 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 4064 pages, LIFO batch:0
[    0.000000]   Normal zone: 1008 pages used for memmap
[    0.000000]   Normal zone: 128016 pages, LIFO batch:31
[    0.000000] NR_CPUS:32 nr_cpumask_bits:32 nr_cpu_ids:2 nr_node_ids:1
[    0.000000] PERCPU: Allocating 28672 bytes of per cpu data
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total
pages: 132080
[    0.000000] Kernel command line: root=/dev/xvda1 xencons=tty console=hvc0
clocksource=jiffies
[    0.000000] Enabling fast FPU save and restore... done.
[    0.000000] Enabling unmasked SIMD FPU exception support... done.
[    0.000000] Initializing CPU#0
[    0.000000] PID hash table entries: 4096 (order: 12, 16384 bytes)
[    0.000000] Xen reported: 1596.000 MHz processor.
[    0.004000] Console: colour dummy device 80x25
[    0.004000] console [tty-1] enabled
[    0.004000] Dentry cache hash table entries: 131072 (order: 7, 524288
bytes)
[    0.004000] Inode-cache hash table entries: 65536 (order: 6, 262144
bytes)
[    0.004000] Software IO TLB disabled
[    0.004000] Software IO TLB disabled
[    0.004000] Memory: 491772k/532480k available (2052k kernel code, 32252k
reserved, 888k data, 200k init, 0k highmem)
[    0.004000] virtual kernel memory layout:
[    0.004000]     fixmap  : 0xf5559000 - 0xf57ff000   (2712 kB)
[    0.004000]     pkmap   : 0xf5000000 - 0xf5200000   (2048 kB)
[    0.004000]     vmalloc : 0xe1000000 - 0xf4ffe000   ( 319 MB)
[    0.004000]     lowmem  : 0xc0000000 - 0xe0800000   ( 520 MB)
[    0.004000]       .init : 0xc03e7000 - 0xc0419000   ( 200 kB)
[    0.004000]       .data : 0xc030113b - 0xc03df2fc   ( 888 kB)
[    0.004000]       .text : 0xc0100000 - 0xc030113b   (2052 kB)
[    0.004000] Checking if this processor honours the WP bit even in
supervisor mode...Ok.
[    0.136006] Calibrating delay using timer specific routine.. 3195.85
BogoMIPS (lpj=6391717)
[    0.136126] Security Framework initialized
[    0.136141] SELinux:  Disabled at boot.
[    0.136203] Mount-cache hash table entries: 512
[    0.136481] Initializing cgroup subsys ns
[    0.136497] Initializing cgroup subsys cpuacct
[    0.136507] Initializing cgroup subsys devices
[    0.136576] CPU: L1 I cache: 32K, L1 D cache: 24K
[    0.136589] CPU: L2 cache: 512K
[    0.136627] Checking 'hlt' instruction... OK.
[    0.137086] SMP alternatives: switching to UP code
[    0.377757] Brought up 1 CPUs
[    0.377792] CPU0 attaching NULL sched-domain.
[    0.379177] net_namespace: 1056 bytes
[    0.380219] NET: Registered protocol family 16
[    0.385214] SMP alternatives: switching to SMP code
[    0.000021] Initializing CPU#1
[    0.658760] CPU: L1 I cache: 32K, L1 D cache: 24K
[    0.658760] CPU: L2 cache: 512K
[    0.660156] CPU0 attaching NULL sched-domain.
[    0.677014] CPU0 attaching sched-domain:
[    0.677022]  domain 0: span 0-1 level CPU
[    0.677027]   groups: 0 1
[    0.677036] CPU1 attaching sched-domain:
[    0.677040]  domain 0: span 0-1 level CPU
[    0.677044]   groups: 1 0
[    0.677147] Brought up 2 CPUs
[    0.678243] PCI: Fatal: No config space access function found
[    0.678263] PCI: setting up Xen PCI frontend stub
[    0.681862] bio: create slab <bio-0> at 0
[    0.682481] ACPI: Interpreter disabled.
[    0.683400] suspend: event channel 13
[    0.684482] xen_mem: Initialising balloon driver.
[    0.693466] PCI: System does not support PCI
[    0.693479] PCI: System does not support PCI
[    0.695484] pcifront pci-0: Installing PCI frontend
[    0.696440] pcifront pci-0: Creating PCI Frontend Bus 0000:00
[    0.697533] pci 0000:00:00.0: reg 10 64bit mmio: [0xfebf0000-0xfebfffff]
[    0.699362] pci 0000:00:00.0: supports D1
[    0.716217] pnp: PnP ACPI: disabled
[    0.717813] pci_bus 0000:00: resource 0 io:  [0x00-0xffff]
[    0.717820] pci_bus 0000:00: resource 1 mem:
[0x000000-0xffffffffffffffff]
[    0.717992] NET: Registered protocol family 2
[    0.764195] IP route cache hash table entries: 32768 (order: 5, 131072
bytes)
[    0.765110] TCP established hash table entries: 131072 (order: 8, 1048576
bytes)
[    0.766183] TCP bind hash table entries: 65536 (order: 7, 524288 bytes)
[    0.766753] TCP: Hash tables configured (established 131072 bind 65536)
[    0.766789] TCP reno registered
[    0.776251] NET: Registered protocol family 1
[    0.776526] checking if image is initramfs... it is
[    0.834754] Freeing initrd memory: 16020k freed
[    0.836076] platform rtc_cmos: registered platform RTC device (no PNP
device found)
[    0.836847] audit: initializing netlink socket (disabled)
[    0.836879] type=2000 audit(1254139666.746:1): initialized
[    0.837732] VFS: Disk quotas dquot_6.5.2
[    0.837883] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    0.837997] msgmni has been set to 1055
[    0.838517] alg: No test for stdrng (krng)
[    0.838813] Block layer SCSI generic (bsg) driver version 0.4 loaded
(major 253)
[    0.838834] io scheduler noop registered
[    0.838844] io scheduler anticipatory registered
[    0.838854] io scheduler deadline registered
[    0.839369] io scheduler cfq registered (default)
[    0.844935] brd: module loaded
[    0.851508] Xen virtual console successfully installed as tty1
[    0.851640] Event-channel device installed.
[    1.275160] netfront: Initialising virtual ethernet driver.
[    1.285556] PNP: No PS/2 controller found. Probing ports directly.
[    1.286468] i8042.c: No controller found.
[    1.286884] mice: PS/2 mouse device common for all mice
[    1.287421] rtc_cmos rtc_cmos: rtc core: registered rtc_cmos as rtc0
[    1.288085] No iBFT detected.
[    1.296906] TCP cubic registered
[    1.296922] NET: Registered protocol family 17
[    1.297174] Bridge firewalling registered
[    1.297196] 802.1Q VLAN Support v1.8 Ben Greear <greearb@xxxxxxxxxxxxxxx>
[    1.297208] All bugs added by David S. Miller <davem@xxxxxxxxxx>
[    1.297239] Using IPI No-Shortcut mode
[    1.297430] xen-vbd: registered block device major 202
[    1.297486] blkfront: xvda1: barriers enabled
[    1.297949] registered taskstats version 1
[    1.301141] blkfront: xvda2: barriers enabled
[    1.396019] XENBUS: Device with no driver: device/console/0
[    1.396038] drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
[    1.396269] Freeing unused kernel memory: 200k freed
[    1.399281]
[    1.399297]
***************************************************************
[    1.399309]
***************************************************************
[    1.399320]   ** WARNING: Currently emulating unsupported memory accesses
**
[    1.399330]   **          in /lib/tls glibc libraries. The emulation is
**
[    1.399340]   **          slow. To ensure full performance you should
**
[    1.399349]   **          install a 'xen-friendly' (nosegneg) version of
**
[    1.399360]   **          the library, or disable tls support by
executing **
[    1.399370]   **          the following as root:
**
[    1.399380]   **          mv /lib/tls /lib/tls.disabled
**
[    1.399391]   ** Offending process: init (pid=271)
**
[    1.399400]
***************************************************************
[    1.399419]
***************************************************************
[    1.399429]
[    1.399436] Continuing...
[    6.365082]
[    6.712206] thermal: Unknown symbol acpi_processor_set_thermal_limit
[    7.417496] device-mapper: uevent: version 1.0.3
[    7.420512] device-mapper: ioctl: 4.14.0-ioctl (2008-04-23) initialised:
dm-devel@xxxxxxxxxx
[    7.583625] ReiserFS: xvda1: found reiserfs format "3.6" with standard
journal
[    7.583665] ReiserFS: xvda1: using ordered data mode
[    7.596367] ReiserFS: xvda1: journal params: device xvda1, size 8192,
journal first block 18, max trans len 1024, max batch 900, max commit age
30, max trans age 30
[    7.597403] ReiserFS: xvda1: checking transaction log (xvda1)
[    7.894418] ReiserFS: xvda1: replayed 20 transactions in 0 seconds
[    7.896222] ReiserFS: xvda1: Using r5 hash to sort names
[    9.488128] cfg80211: Using static regulatory domain info
[    9.488144] cfg80211: Regulatory domain: EU
[    9.488153]  (start_freq - end_freq @ bandwidth), (max_antenna_gain,
max_eirp)
[    9.488165]  (2402000 KHz - 2482000 KHz @ 40000 KHz), (600 mBi, 2000 mBm)
[    9.488176]  (5170000 KHz - 5190000 KHz @ 40000 KHz), (600 mBi, 2300 mBm)
[    9.488187]  (5190000 KHz - 5210000 KHz @ 40000 KHz), (600 mBi, 2300 mBm)
[    9.488198]  (5210000 KHz - 5230000 KHz @ 40000 KHz), (600 mBi, 2300 mBm)
[    9.488209]  (5230000 KHz - 5330000 KHz @ 40000 KHz), (600 mBi, 2000 mBm)
[    9.488220]  (5490000 KHz - 5710000 KHz @ 40000 KHz), (600 mBi, 3000 mBm)
[    9.488230] cfg80211: Calling CRDA for country: EU
[    9.582105] ath9k: 0.1
[    9.582744] ath9k 0000:00:00.0: enabling device (0000 -> 0002)
[    9.583784] ath9k 0000:00:00.0: setting latency timer to 64
[    9.584100] PCI memory map error
[    9.584556] ath9k: probe of 0000:00:00.0 failed with error -5
[    9.758973] Adding 524280k swap on /dev/xvda2.  Priority:1 extents:1
across:524280k


lspci on dom0

[root@ipfire ~]# debserv:~# lspci
00:00.0 Host bridge: Intel Corporation Mobile 945GME Express Memory
Controller Hub (rev 03)
00:02.0 VGA compatible controller: Intel Corporation Mobile 945GME Express
Integrated Graphics Controller (rev 03)
00:02.1 Display controller: Intel Corporation Mobile 945GM/GMS/GME,
943/940GML Express Integrated Graphics Controller (rev 03)
00:1c.0 PCI bridge: Intel Corporation 82801G (ICH7 Family) PCI Express Port
1 (rev 02)
00:1c.1 PCI bridge: Intel Corporation 82801G (ICH7 Family) PCI Express Port
2 (rev 02)
00:1c.2 PCI bridge: Intel Corporation 82801G (ICH7 Family) PCI Express Port
3 (rev 02)
00:1d.0 USB Controller: Intel Corporation 82801G (ICH7 Family) USB UHCI
Controller #1 (rev 02)
00:1d.7 USB Controller: Intel Corporation 82801G (ICH7 Family) USB2 EHCI
Controller (rev 02)
00:1e.0 PCI bridge: Intel Corporation 82801 Mobile PCI Bridge (rev e2)
00:1f.0 ISA bridge: Intel Corporation 82801GBM (ICH7-M) LPC Interface Bridge
(rev 02)
00:1f.2 IDE interface: Intel Corporation 82801GBM/GHM (ICH7 Family) SATA IDE
Controller (rev 02)
00:1f.3 SMBus: Intel Corporation 82801G (ICH7 Family) SMBus Controller (rev
02)
01:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network
Connection
02:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network
Connection
03:00.0 Network controller: Atheros Communications Inc. AR5418 802.11abgn
Wireless PCI Express Adapter (rev 01)




_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users