[Xen-users] Request for help with pci passthrough with VTd on Debian Jessie

[Jo Mills <jo@xxxxxxxxxxxxxxxx>]

Hi,

I am having great difficulties in getting pci passthrough with VTd to 
work, surely I am doing something stupid but I cannot see what.  
"tangram" (https://www.blogger.com/profile/06588030231546523539) has 
been a huge help, but despite his efforts I am still stuck.

    Hardware:   Intel S3200SHV motherboard
    BIOS    :   S3200X38.86B.00.00.0052
    CPU     :   Intel Core 2 (quad)
    


Bios settings:

    Enhanced Intel (R) SpeedStep Tech           [Enabled]
    Core Multi-processing                       [Enabled]
    Intel (R) Virtualization Technology         [Enabled]
    Intel (R) VT for Directed I/O               [Enabled]
    Execute Disable Bit                         [Enabled]
    Multi-Thread Support in MPS table           [Enabled]
    


Debian "Jessie" installation as at Thurs 20-FEB-2104 GMT

  ii  libxen-4.3                          4.3.0-3+b1      amd64
  ii  libxenstore3.0                      4.3.0-3+b1      amd64
  ii  linux-image-xen-amd64               2.6.32+29       amd64
  ii  xen-hypervisor-4.3-amd64            4.3.0-3+b1      amd64
  ii  xen-linux-system-3.12-1-amd64       3.12.9-1        amd64
  ii  xen-linux-system-amd64              3.12+55         amd64
  ii  xen-system-amd64                    4.3.0-3+b1      amd64
  ii  xen-tools                           4.4-1           all
  ii  xen-utils-4.3                       4.3.0-3+b1      amd64
  ii  xen-utils-common                    4.3.0-3         all
  ii  xenstore-utils                      4.3.0-3+b1      amd64



lspci -k
  .
  .
  .
  03:00.0 Ethernet controller: VIA Technologies, Inc. \
                            VT6105/VT6106S [Rhine-III] (rev 86)
          Subsystem: D-Link System Inc DFE-530TX rev C
          Kernel driver in use: via-rhine
  03:01.0 Ethernet controller: VIA Technologies, Inc. \
                            VT6105/VT6106S [Rhine-III] (rev 86)
          Subsystem: D-Link System Inc DFE-530TX rev C
          Kernel driver in use: via-rhine
  03:02.0 Ethernet controller: Intel Corporation 82541GI \
                            Gigabit Ethernet Controller (rev 05)
          Subsystem: Intel Corporation Device 34d0
          Kernel driver in use: e1000



lspci -n
  .
  .
  .
  03:00.0 0200: 1106:3106 (rev 86)
  03:01.0 0200: 1106:3106 (rev 86)
  03:02.0 0200: 8086:1076 (rev 05)



"xm dmesg" shows "I/O virtualisation enabled"

    
  (XEN) Xen version 4.3.0 (Debian 4.3.0-3+b1) \
                          (buildd-binet@xxxxxxxxxxxxxxxxx) \
                          (gcc (Debian 4.8.2-8) 4.8.2) \
                          debug=n Wed Dec  4 07:43:54 UTC 2013
  (XEN) Bootloader: GRUB 2.00-22
  (XEN) Command line: placeholder dom0_mem=2G,max:2G dom0_max_vcpus=1 \
                                  dom0_vcpus_pin
  (XEN) Video information:
  (XEN)  VGA is text mode 80x25, font 8x16
  (XEN)  VBE/DDC methods: none; EDID transfer time: 0 seconds
  (XEN)  EDID info not retrieved because no DDC retrieval method detected
  (XEN) Disc information:
  (XEN)  Found 1 MBR signatures
  (XEN)  Found 1 EDD information structures
  (XEN) Xen-e820 RAM map:
  (XEN)  0000000000000000 - 000000000009fc00 (usable)
  (XEN)  000000000009fc00 - 0000000000100000 (reserved)
  (XEN)  0000000000100000 - 00000000dfbea000 (usable)
  (XEN)  00000000dfbea000 - 00000000dfc96000 (ACPI NVS)
  (XEN)  00000000dfc96000 - 00000000dfcfa000 (usable)
  (XEN)  00000000dfcfa000 - 00000000dfd5f000 (reserved)
  (XEN)  00000000dfd5f000 - 00000000dfd69000 (usable)
  (XEN)  00000000dfd69000 - 00000000dfddf000 (ACPI NVS)
  (XEN)  00000000dfddf000 - 00000000dfde5000 (usable)
  (XEN)  00000000dfde5000 - 00000000dfdff000 (ACPI data)
  (XEN)  00000000dfdff000 - 00000000dfe00000 (usable)
  (XEN)  00000000dfe00000 - 00000000dff00000 (reserved)
  (XEN)  00000000f0000000 - 00000000f4000000 (reserved)
  (XEN)  00000000fff80000 - 00000000fff8c000 (reserved)
  (XEN)  0000000100000000 - 0000000220000000 (usable)
  (XEN) ACPI: RSDP 000F03C0, 0024 (r2 INTEL )
  (XEN) ACPI: XSDT DFDFE120, 00AC (r1 INTEL  S3200SHV   0 INTL  1000013)
  (XEN) ACPI: SLIC DFDFC000, 0176 (r1 INTEL  S3200SHV   2 INTL  1000013)
  (XEN) ACPI: FACP DFDFA000, 00F4 (r3 INTEL  S3200SHV   0 MSFT  1000013)
  (XEN) ACPI: DSDT DFDF4000, 56BC (r1 INTEL  S3200SHV   0 MSFT  1000013)
  (XEN) ACPI: FACS DFD69000, 0040
  (XEN) ACPI: APIC DFDF3000, 0084 (r1 INTEL  S3200SHV   0 MSFT  1000013)
  (XEN) ACPI: WDDT DFDF2000, 0040 (r1 INTEL  S3200SHV   0 MSFT  1000013)
  (XEN) ACPI: MCFG DFDF1000, 003C (r1 INTEL  S3200SHV   0 MSFT  1000013)
  (XEN) ACPI: HPET DFDF0000, 0038 (r1 INTEL  S3200SHV   1 MSFT  1000013)
  (XEN) ACPI: SPCR DFDEF000, 0050 (r1 INTEL  S3200SHV   0 MSFT  1000013)
  (XEN) ACPI: SSDT DFDEE000, 0175 (r1 INTEL   Cpu0Ist  10 MSFT  1000013)
  (XEN) ACPI: SSDT DFDED000, 0175 (r1 INTEL   Cpu1Ist  10 MSFT  1000013)
  (XEN) ACPI: SSDT DFDEC000, 0175 (r1 INTEL   Cpu2Ist  10 MSFT  1000013)
  (XEN) ACPI: SSDT DFDEB000, 0175 (r1 INTEL   Cpu3Ist  10 MSFT  1000013)
  (XEN) ACPI: SSDT DFDEA000, 01BC (r1 INTEL     CpuPm  10 MSFT  1000013)
  (XEN) ACPI: HEST DFDE9000, 00A8 (r1 INTEL  S3200SHV   1 INTL        1)
  (XEN) ACPI: BERT DFDE8000, 0030 (r1 INTEL  S3200SHV   1 INTL        1)
  (XEN) ACPI: ERST DFDE7000, 0230 (r1 INTEL  S3200SHV   1 INTL        1)
  (XEN) ACPI: EINJ DFDE6000, 0130 (r1 INTEL  S3200SHV   1 INTL        1)
  (XEN) ACPI: DMAR DFDE5000, 0128 (r1 INTEL  S3200SHV   1 MSFT        0)
  (XEN) System RAM: 8187MB (8384504kB)
  (XEN) Domain heap initialised
  (XEN) Processor #0 7:7 APIC version 20
  (XEN) Processor #2 7:7 APIC version 20
  (XEN) Processor #1 7:7 APIC version 20
  (XEN) Processor #3 7:7 APIC version 20
  (XEN) IOAPIC[0]: apic_id 5, version 32, address 0xfec00000, GSI 0-23
  (XEN) Enabling APIC mode:  Flat.  Using 1 I/O APICs
  (XEN) Using scheduler: SMP Credit Scheduler (credit)
  (XEN) Detected 2660.084 MHz processor.
  (XEN) Initing memory sharing.
  (XEN) xstate_init: using cntxt_size: 0x240 and states: 0x3
  (XEN) Intel VT-d iommu 0 supported page sizes: 4kB.
  (XEN) Intel VT-d Snoop Control not enabled.
  (XEN) Intel VT-d Dom0 DMA Passthrough not enabled.
  (XEN) Intel VT-d Queued Invalidation not enabled.
  (XEN) Intel VT-d Interrupt Remapping not enabled.
  (XEN) Intel VT-d Shared EPT tables not enabled.
  (XEN) I/O virtualisation enabled
  (XEN)  - Dom0 mode: Relaxed
  (XEN) Interrupt remapping disabled
  (XEN) ENABLING IO-APIC IRQs
  (XEN)  -> Using new ACK method
  (XEN) Platform timer is 14.318MHz HPET
  (XEN) Allocated console ring of 16 KiB.
  (XEN) VMX: Supported advanced features:
  (XEN)  - APIC MMIO access virtualisation
  (XEN)  - APIC TPR shadow
  (XEN)  - Virtual NMI
  (XEN)  - MSR direct-access bitmap
  (XEN) HVM: ASIDs disabled.
  (XEN) HVM: VMX enabled
  (XEN) HVM: Hardware Assisted Paging (HAP) not detected
  (XEN) Brought up 4 CPUs
  (XEN) mtrr: your CPUs had inconsistent variable MTRR settings
  (XEN) *** LOADING DOMAIN 0 ***
  (XEN)  Xen  kernel: 64-bit, lsb, compat32
  (XEN)  Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x1eb3000
  (XEN) PHYSICAL MEMORY ARRANGEMENT:
  (XEN)  Dom0 alloc.:   0000000210000000->0000000214000000 \
                              (497895 pages to be allocated)
  (XEN)  Init. ramdisk: 000000021d8e7000->000000021ffff200
  (XEN) VIRTUAL MEMORY ARRANGEMENT:
  (XEN)  Loaded kernel: ffffffff81000000->ffffffff81eb3000
  (XEN)  Init. ramdisk: ffffffff81eb3000->ffffffff845cb200
  (XEN)  Phys-Mach map: ffffffff845cc000->ffffffff849cc000
  (XEN)  Start info:    ffffffff849cc000->ffffffff849cc4b4
  (XEN)  Page tables:   ffffffff849cd000->ffffffff849f6000
  (XEN)  Boot stack:    ffffffff849f6000->ffffffff849f7000
  (XEN)  TOTAL:         ffffffff80000000->ffffffff84c00000
  (XEN)  ENTRY ADDRESS: ffffffff818c01e0
  (XEN) Dom0 has maximum 1 VCPUs
  (XEN) Scrubbing Free RAM: ................................\
                                  ............................done.
  (XEN) Initial low memory virq threshold set at 0x4000 pages.
  (XEN) Std. Loglevel: Errors and warnings
  (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
  (XEN) Xen is relinquishing VGA console.
  (XEN) *** Serial input -> DOM0 (type 'CTRL-a' three\
                                times to switch input to Xen)
  (XEN) Freed 260kB init memory.



lsmod | grep pci
  ehci_pci               12472  0 
  ehci_hcd               48414  1 ehci_pci
  usbcore               154167  3 uhci_hcd,ehci_hcd,ehci_pci



modprobe pci_stub
echo "1106 3106"    > /sys/bus/pci/drivers/pci-stub/new_id
echo "0000:03:01.0" > /sys/bus/pci/devices/0000:03:01.0/driver/unbind
echo "0000:03:01.0" > /sys/bus/pci/drivers/pci-stub/bind



tail -f /var/log/kern.log
  Feb 20 19:41:10 green kernel: [   44.768042] xenbr0: port 1(eth0) \
                                               entered forwarding state
  Feb 20 19:41:11 green kernel: [   46.215190] xen:xen_evtchn: \
                                        Event-channel device installed
  Feb 20 19:49:31 green kernel: [  545.879059] \
                                pci-stub 0000:03:01.0: claimed by stub



lspci -k
    .
    .
    .
   03:00.0 Ethernet controller: VIA Technologies, Inc. \
                           VT6105/VT6106S [Rhine-III] (rev 86)
           Subsystem: D-Link System Inc DFE-530TX rev C
           Kernel driver in use: via-rhine
   03:01.0 Ethernet controller: VIA Technologies, Inc. \
                           VT6105/VT6106S [Rhine-III] (rev 86)
           Subsystem: D-Link System Inc DFE-530TX rev C
           Kernel driver in use: pci-stub
   03:02.0 Ethernet controller: Intel Corporation 82541GI \
                               Gigabit Ethernet Controller (rev 05)
           Subsystem: Intel Corporation Device 34d0
           Kernel driver in use: e1000


so it all looks OK so far, but:

xm pci-list-assignable-devices

    and nothing shows.




If anyone would point out my obvious mistake(s) I would be extremely 
grateful.

Regards,

Jo.

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxx
http://lists.xen.org/xen-users