Xen project Mailing List

On Tue, Jan 21, 2014 at 11:23 PM, Pasi Kärkkäinen <pasik@xxxxxx> wrote:

On Tue, Jan 21, 2014 at 06:53:14PM +0200, Alexander Savchenko wrote:
> Hi,
>
> Could someone advice on the issue I am facing?
>
> I am trying to run PV USB on omap5uevm (omap5-panda) board.
>
> I use latest drivers for PV USB from Nathanael server:
> http://members.iinet.net.au/~nathanael/0001-pvusb-driver.linux-next.patch
>

I think Konrad actually has the Xen PVUSB drivers in his git tree, and it has
some extra patches compared to nathanaels's version (iirc)..

-- Pasi

> I have applied it to k3.8(dom0) with some patches for USB HCD, usbback drivers
> (attached) and run on Xen 4.4.0-rc2.
>
> I am facing an issue with USB_STORAGE:
> USB storage inited and mounted on domU over PV USB drivers.
> But I only can copy files on USB storage with small sizes(no more than ~100-500 kBytes).
> Then USB storage falls to infinite loop
> (leds on USB storage blinking all the time, more than needing for copy)
> and then after few seconds dom0 disconnected usb device.
>
> Dom0, DomU use k3.8.
>
> I observed that usb-storage uses some scsi requests(from domU) which pass
> directly to hardware, I think this is a problem.
>
> So, I applied PV SCSI drivers from
> http://git.kernel.org/cgit/linux/kernel/git/konrad/xen.git/log/?id=refs/heads/devel/xen-scsi.v1.0
> to k3.8.
>
> Then I inited PV USB & PV SCSI with scripts vusb-start.sh and vscsi-start.sh accordingly.
> But I still facing issue with this.
>
> Dom0 log:
> [ 0.000000] Booting Linux on physical CPU 0x0
> [ 0.000000] Linux version 3.8.13-53079-g8f32ae6 (x0187394@uglx0187394) (gcc version 4.7 (GCC) ) #55 Tue Jan 21 18:01:39 EET 2014
> [ 0.000000] CPU: ARMv7 Processor [412fc0f2] revision 2 (ARMv7), cr=10c5387d
> [ 0.000000] CPU: PIPT / VIPT nonaliasing data cache, PIPT instruction cache
> [ 0.000000] Machine: OMAP5 Panda board, model: TI OMAP5 uEVM board
> [ 0.000000] bootconsole [earlycon0] enabled
> [ 0.000000] Memory policy: ECC disabled, Data cache writeback
> [ 0.000000] On node 0 totalpages: 65280
> [ 0.000000] free_area_init_node: node 0, pgdat c3d639f0, node_mem_map c428e000
> [ 0.000000] Normal zone: 512 pages used for memmap
> [ 0.000000] Normal zone: 0 pages reserved
> [ 0.000000] Normal zone: 64768 pages, LIFO batch:15
> [ 0.000000] psci: probing function IDs from device-tree
> [ 0.000000] OMAP5432 ES2.0
> [ 0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
> [ 0.000000] pcpu-alloc: [0] 0
> [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 64768
> [ 0.000000] Kernel command line: console=hvc0 earlyprintk
> [ 0.000000] PID hash table entries: 1024 (order: 0, 4096 bytes)
> [ 0.000000] Dentry cache hash table entries: 32768 (order: 5, 131072 bytes)
> [ 0.000000] Inode-cache hash table entries: 16384 (order: 4, 65536 bytes)
> [ 0.000000] __ex_table already sorted, skipping sort
> [ 0.000000] Memory: 255MB = 255MB total
> [ 0.000000] Memory: 190640k/190640k available, 71504k reserved, 0K highmem
> [ 0.000000] Virtual kernel memory layout:
> [ 0.000000] vector : 0xffff0000 - 0xffff1000 ( 4 kB)
> [ 0.000000] fixmap : 0xfff00000 - 0xfffe0000 ( 896 kB)
> [ 0.000000] vmalloc : 0xd0800000 - 0xff000000 ( 744 MB)
> [ 0.000000] lowmem : 0xc0000000 - 0xd0000000 ( 256 MB)
> [ 0.000000] pkmap : 0xbfe00000 - 0xc0000000 ( 2 MB)
> [ 0.000000] modules : 0xbf000000 - 0xbfe00000 ( 14 MB)
> [ 0.000000] .text : 0xc0008000 - 0xc0493748 (4654 kB)
> [ 0.000000] .init : 0xc0494000 - 0xc3cfa29c (57753 kB)
> [ 0.000000] .data : 0xc3cfc000 - 0xc3d64660 ( 418 kB)
> [ 0.000000] .bss : 0xc3d64660 - 0xc428d634 (5284 kB)
> [ 0.000000] NR_IRQS:16 nr_irqs:16 16
> [ 0.000000] Architected local timer running at 6.14MHz (virt).
> [ 0.000000] Switching to timer-based delay loop
> [ 0.000000] sched_clock: 32 bits at 128 Hz, resolution 7812500ns, wraps every 3489660920ms
> [ 0.000000] Console: colour dummy device 80x30
> [ 0.000000] Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar
> [ 0.000000] ... MAX_LOCKDEP_SUBCLASSES: 8
> [ 0.000000] ... MAX_LOCK_DEPTH: 48
> [ 0.000000] ... MAX_LOCKDEP_KEYS: 8191
> [ 0.000000] ... CLASSHASH_SIZE: 4096
> [ 0.000000] ... MAX_LOCKDEP_ENTRIES: 16384
> [ 0.000000] ... MAX_LOCKDEP_CHAINS: 32768
> [ 0.000000] ... CHAINHASH_SIZE: 16384
> [ 0.000000] memory used by lock dependency info: 3695 kB
> [ 0.000000] per task-struct memory footprint: 1152 bytes
> [ 0.046875] Calibrating delay loop (skipped), value calculated using timer frequency.. 12.30 BogoMIPS (lpj=48000)
> [ 0.054687] pid_max: default: 32768 minimum: 301
> [ 0.054687] Security Framework initialized
> [ 0.062500] Mount-cache hash table entries: 512
> [ 0.070312] CPU: Testing write buffer coherency: ok
> [ 0.078125] Setting up static identity map for 0xd0334e00 - 0xd0334e58
> [ 0.085937] devtmpfs: initialized
> [ 0.093750] Xen 4.4 support found, events_irq=31 gnttab_frame_pfn=4b000
> [ 0.101562] xen:grant_table: Grant tables using version 1 layout.
> [ 0.101562] Grant table initialized
> [ 0.109375] omap_hwmod: aess: _wait_target_disable failed
> [ 0.132812] omap_hwmod: dss_dispc: cannot be enabled for reset (3)
> [ 0.140625] omap_hwmod: dss_dsi1_a: cannot be enabled for reset (3)
> [ 0.148437] omap_hwmod: dss_dsi1_b: cannot be enabled for reset (3)
> [ 0.156250] omap_hwmod: dss_dsi1_c: cannot be enabled for reset (3)
> [ 0.164062] omap_hwmod: dss_hdmi: cannot be enabled for reset (3)
> [ 0.171875] omap_hwmod: dss_rfbi: cannot be enabled for reset (3)
> [ 0.234375] pinctrl core: initialized pinctrl subsystem
> [ 0.242187] regulator-dummy: no parameters
> [ 0.242187] NET: Registered protocol family 16
> [ 0.250000] Xen: initializing cpu0
> [ 0.250000] DMA: preallocated 256 KiB pool for atomic coherent allocations
> [ 0.257812] xen:swiotlb_xen: Warning: only able to allocate 8 MB for software IO TLB
> [ 0.265625] software IO TLB [mem 0xde000000-0xde800000] (8MB) mapped at [ce000000-ce7fffff]
> [ 0.281250] gpiochip_add: registered GPIOs 0 to 31 on device: gpio
> [ 0.281250] OMAP GPIO hardware version 0.1
> [ 0.289062] gpiochip_add: registered GPIOs 32 to 63 on device: gpio
> [ 0.289062] gpiochip_add: registered GPIOs 64 to 95 on device: gpio
> [ 0.296875] OMAP DMA hardware revision 0.0
> [ 0.304687] pinctrl-single 4a002840.pinmux: 219 pins at pa fc002840 size 438
> [ 0.312500] pinctrl-single 4ae0c840.pinmux: 28 pins at pa fce0c840 size 56
> [ 0.335937] bio: create slab <bio-0> at 0
> [ 0.343750] xen:balloon: Initialising balloon driver
> [ 0.343750] of_get_named_gpio_flags exited with status 80
> [ 0.343750] hsusb2_reset: 3300 mV
> [ 0.351562] of_get_named_gpio_flags exited with status 79
> [ 0.351562] hsusb3_reset: 3300 mV
> [ 0.351562] SCSI subsystem initialized
> [ 0.359375] libata version 3.00 loaded.
> [ 0.359375] usbcore: registered new interface driver usbfs
> [ 0.367187] usbcore: registered new interface driver hub
> [ 0.367187] usbcore: registered new device driver usb
> [ 0.375000] Switching to clocksource arch_sys_counter
> [ 0.414062] NET: Registered protocol family 2
> [ 0.414062] TCP established hash table entries: 2048 (order: 2, 16384 bytes)
> [ 0.421875] TCP bind hash table entries: 2048 (order: 4, 73728 bytes)
> [ 0.429687] TCP: Hash tables configured (established 2048 bind 2048)
> [ 0.437500] TCP: reno registered
> [ 0.437500] UDP hash table entries: 256 (order: 2, 20480 bytes)
> [ 0.445312] UDP-Lite hash table entries: 256 (order: 2, 20480 bytes)
> [ 0.453125] NET: Registered protocol family 1
> [ 0.679687] NetWinder Floating Point Emulator V0.97 (double precision)
> [ 0.687500] VFS: Disk quotas dquot_6.5.2
> [ 0.695312] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
> [ 0.703125] msgmni has been set to 372
> [ 0.710937] io scheduler noop registered
> [ 0.718750] io scheduler deadline registered
> [ 0.718750] io scheduler cfq registered (default)
> [ 0.726562] xen:xen_evtchn: Event-channel device installed
> [ 0.742187] console [hvc0] enabled, bootconsole disabled
> [ 0.765625] brd: module loaded
> [ 0.781250] loop: module loaded
> [ 0.789062] ahci ahci.0.auto: can't get clock
> [ 0.789062] ahci ahci.0.auto: SATA PLL_STATUS = 0x00018041
> [ 0.796875] ahci ahci.0.auto: forcing PORTS_IMPL to 0x1
> [ 0.804687] ahci ahci.0.auto: AHCI 0001.0300 32 slots 1 ports 3 Gbps 0x1 impl platform mode
> [ 0.812500] ahci ahci.0.auto: flags: 64bit ncq sntf pm led clo only pmp pio slum part ccc apst
> [ 0.820312] scsi0 : ahci_platform
> [ 0.828125] ata1: SATA max UDMA/133 mmio [mem 0x4a140000-0x4a1401ff] port 0x100 irq 86
> [ 0.835937] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
> [ 0.843750] ehci-omap: OMAP-EHCI Host Controller driver
> [ 0.859375] ehci-omap 4a064c00.ehci: EHCI Host Controller
> [ 0.867187] ehci-omap 4a064c00.ehci: new USB bus registered, assigned bus number 1
> [ 0.875000] ehci-omap 4a064c00.ehci: irq 109, io mem 0x4a064c00
> [ 0.898437] ehci-omap 4a064c00.ehci: USB 2.0 started, EHCI 1.00
> [ 0.898437] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
> [ 0.906250] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
> [ 0.914062] usb usb1: Product: EHCI Host Controller
> [ 0.921875] usb usb1: Manufacturer: Linux 3.8.13-53079-g8f32ae6 ehci_hcd
> [ 0.929687] usb usb1: SerialNumber: 4a064c00.ehci
> [ 0.937500] hub 1-0:1.0: USB hub found
> [ 0.937500] hub 1-0:1.0: 3 ports detected
> [ 1.085937] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
> [ 1.085937] ohci-omap3 4a064800.ohci: OMAP3 OHCI Host Controller
> [ 1.093750] ohci-omap3 4a064800.ohci: new USB bus registered, assigned bus number 2
> [ 1.101562] ohci-omap3 4a064800.ohci: irq 108, io mem 0x4a064800
> [ 1.187500] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001
> [ 1.195312] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
> [ 1.203125] usb usb2: Product: OMAP3 OHCI Host Controller
> [ 1.210937] usb usb2: Manufacturer: Linux 3.8.13-53079-g8f32ae6 ohci_hcd
> [ 1.210937] usb usb2: SerialNumber: 4a064800.ohci
> [ 1.218750] ata1: SATA link down (SStatus 0 SControl 300)
> [ 1.226562] hub 2-0:1.0: USB hub found
> [ 1.226562] hub 2-0:1.0: 3 ports detected
> [ 1.359375] usb 1-2: new high-speed USB device number 2 using ehci-omap
> [ 1.515625] usb 1-2: New USB device found, idVendor=0424, idProduct=3503
> [ 1.515625] usb 1-2: New USB device strings: Mfr=0, Product=0, SerialNumber=0
> [ 1.531250] hub 1-2:1.0: USB hub found
> [ 1.531250] hub 1-2:1.0: 3 ports detected
> [ 1.664062] usb 1-3: new high-speed USB device number 3 using ehci-omap
> [ 1.820312] usb 1-3: New USB device found, idVendor=0424, idProduct=9730
> [ 1.820312] usb 1-3: New USB device strings: Mfr=0, Product=0, SerialNumber=0
> [ 1.835937] usbcore: registered new interface driver usbback
> [ 1.843750] Initializing USB Mass Storage driver...
> [ 1.843750] usbcore: registered new interface driver usb-storage
> [ 1.851562] USB Mass Storage support registered.
> [ 1.859375] i2c /dev entries driver
> [ 1.859375] usbcore: registered new interface driver usbhid
> [ 1.867187] usbhid: USB HID core driver
> [ 1.875000] TCP: cubic registered
> [ 1.875000] Initializing XFRM netlink socket
> [ 1.882812] NET: Registered protocol family 17
> [ 1.882812] NET: Registered protocol family 15
> [ 1.890625] VFP support v0.3: implementor 41 architecture 4 part 30 variant f rev 0
> [ 1.898437] mux: Failed to setup hwmod io irq -22
> [ 1.898437] Power Management for TI OMAP4PLUS devices.
> [ 1.906250] ThumbEE CPU extension supported.
> [ 1.914062] Registering SWP/SWPB emulation handler
> [ 1.921875] devtmpfs: mounted
> [ 1.968750] Freeing init memory: 57752K
> # ./vusb-start.sh 1 0
> [ 9.289062] xen-usbback:urb-ring-ref 8, conn-ring-ref 9, event-channel 3
> # ./vscsi-start.sh 1 0
> # echo 1-2.1:1:0:1 > /sys/bus/usb/drivers/usbback/new_vport
>
> [ 40.796875] usb 1-2.1: new high-speed USB device number 4 using ehci-omap
> [ 40.914062] usb 1-2.1: New USB device found, idVendor=8564, idProduct=1000
> [ 40.921875] usb 1-2.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
> [ 40.929687] usb 1-2.1: Product: Mass Storage Device
> [ 40.929687] usb 1-2.1: Manufacturer: JetFlash
> [ 40.937500] usb 1-2.1: SerialNumber: 54S44YGYMT2ZM7XO
>
> DomU log:
> 0.710937] console [hvc0] enabled, bootconsole disabled
> [ 0.718750] 4806a000.serial: ttyO0 at MMIO 0x4806a000 (irq = 104) is a OMAP UART0
> [ 0.718750] omap_uart 4806c000.serial: did not get pins for uart1 error: -19
> [ 0.718750] 4806c000.serial: ttyO1 at MMIO 0x4806c000 (irq = 105) is a OMAP UART1
> [ 0.718750] omap_uart 4806e000.serial: did not get pins for uart3 error: -19
> [ 0.718750] 4806e000.serial: ttyO3 at MMIO 0x4806e000 (irq = 102) is a OMAP UART3
> [ 0.718750] 48066000.serial: ttyO4 at MMIO 0x48066000 (irq = 137) is a OMAP UART4
> [ 0.726562] omap_uart 48068000.serial: did not get pins for uart5 error: -19
> [ 0.726562] 48068000.serial: ttyO5 at MMIO 0x48068000 (irq = 138) is a OMAP UART5
> [ 0.726562] [drm] Initialized drm 1.1.0 20060810
> [ 0.742187] brd: module loaded
> [ 0.757812] loop: module loaded
> [ 0.757812] omap2_mcspi 48098000.spi: pins are not configured from the driver
> [ 0.765625] Initialising Xen virtual ethernet driver.
> [ 0.765625] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
> [ 0.765625] ehci-platform: EHCI generic platform driver
> [ 0.765625] vusb vusb-0: Xen USB2.0 Virtual Host Controller
> [ 0.765625] vusb vusb-0: new USB bus registered, assigned bus number 1
> [ 0.765625] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
> [ 0.765625] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
> [ 0.765625] usb usb1: Product: Xen USB2.0 Virtual Host Controller
> [ 0.765625] usb usb1: Manufacturer: Linux 3.8.13-53079-g8f32ae6 xen_hcd
> [ 0.765625] usb usb1: SerialNumber: vusb-0
> [ 0.773437] hub 1-0:1.0: USB hub found
> [ 0.773437] hub 1-0:1.0: 8 ports detected
> [ 0.773437] Initializing USB Mass Storage driver...
> [ 0.773437] usbcore: registered new interface driver usb-storage
> [ 0.773437] USB Mass Storage support registered.
> [ 0.773437] mousedev: PS/2 mouse device common for all mice
> [ 0.781250] usbcore: registered new interface driver usbhid
> [ 0.781250] usbhid: USB HID core driver
> [ 0.789062] TCP: cubic registered
> [ 0.789062] Initializing XFRM netlink socket
> [ 0.789062] NET: Registered protocol family 17
> [ 0.789062] NET: Registered protocol family 15
> [ 0.789062] VFP support v0.3: implementor 41 architecture 4 part 30 variant f rev 0
> [ 0.789062] mux: Failed to setup hwmod io irq -22
> [ 0.789062] ThumbEE CPU extension supported.
> [ 0.789062] Registering SWP/SWPB emulation handler
> [ 0.789062] dmm 4e000000.dmm: initialized all PAT entries
> [ 0.804687] /home/x0187394/work/xen/kernel_dom0/drivers/rtc/hctosys.c: unable to open rtc device (rtc0)
> [ 0.804687] devtmpfs: mounted
> [ 0.812500] Freeing init memory: 6044K
>
> Please press Enter to activate this console.
> [ 6.500000] scsi0 : Xen SCSI frontend driver
>
> / # [ 40.796875] usb 1-2.1: new high-speed USB device number 4 using ehci-omap
> [ 40.914062] usb 1-2.1: New USB device found, idVendor=8564, idProduct=1000
> [ 40.921875] usb 1-2.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
> [ 40.929687] usb 1-2.1: Product: Mass Storage Device
> [ 40.929687] usb 1-2.1: Manufacturer: JetFlash
> [ 40.937500] usb 1-2.1: SerialNumber: 54S44YGYMT2ZM7XO
> [ 32.703125] usb 1-1: new high-speed USB device number 2 using vusb
> (XEN) mm.c:1176:d0 gnttab_mark_dirty not implemented yet
> [ 32.875000] usb 1-1: New USB device found, idVendor=8564, idProduct=1000
> [ 32.875000] usb 1-1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
> [ 32.875000] usb 1-1: Product: Mass Storage Device
> [ 32.875000] usb 1-1: Manufacturer: JetFlash
> [ 32.875000] usb 1-1: SerialNumber: 54S44YGYMT2ZM7XO
> [ 32.906250] scsi1 : usb-storage 1-1:1.0
> [ 34.117187] scsi 1:0:0:0: Direct-Access JetFlash Transcend 8GB 1100 PQ: 0 ANSI: 4
> [ 34.132812] sd 1:0:0:0: [sda] 15826944 512-byte logical blocks: (8.10 GB/7.54 GiB)
> [ 34.140625] sd 1:0:0:0: [sda] Write Protect is off
> [ 34.140625] sd 1:0:0:0: [sda] Mode Sense: 00 f1 7f ff *<--this data may changed on different boots*
> [ 34.156250] sd 1:0:0:0: [sda] Asking for cache data failed
> [ 34.156250] sd 1:0:0:0: [sda] Assuming drive cache: write through
> [ 34.179687] sd 1:0:0:0: [sda] Asking for cache data failed
> [ 34.179687] sd 1:0:0:0: [sda] Assuming drive cache: write through
> [ 34.195312] sda: sda1
> [ 34.203125] sd 1:0:0:0: [sda] Asking for cache data failed
> [ 34.203125] sd 1:0:0:0: [sda] Assuming drive cache: write through
> [ 34.203125] sd 1:0:0:0: [sda] Attached SCSI removable disk
>
> # lsusb
> Bus 001 Device 002: ID 8564:1000
> Bus 001 Device 001: ID 1d6b:0002
>
> But it looks like scsi requests from usb-storage still passing directly to hardware
> instead of passing through PV SCSI.
>
> Could smb tell me how to init PV SCSI and PV USB correctly?
>
> Regards,
> Alexander
>
> Alexander Savchenko (2):
> usbback: Add new features
> HACK: usb:core:hcd: Do not remapping self dma addresses
>
> Nathanael Rensen (1):
> pvusb drivers
>
> drivers/usb/core/hcd.c | 1 +
> drivers/usb/host/Kconfig | 23 +
> drivers/usb/host/Makefile | 2 +
> drivers/usb/host/xen-usbback/Makefile | 3 +
> drivers/usb/host/xen-usbback/common.h | 170 ++++
> drivers/usb/host/xen-usbback/usbback.c | 1272 +++++++++++++++++++++++
> drivers/usb/host/xen-usbback/usbdev.c | 402 ++++++++
> drivers/usb/host/xen-usbback/xenbus.c | 482 +++++++++
> drivers/usb/host/xen-usbfront.c | 1739 ++++++++++++++++++++++++++++++++
> include/xen/interface/io/usbif.h | 150 +++
> 10 files changed, 4244 insertions(+)
> create mode 100644 drivers/usb/host/xen-usbback/Makefile
> create mode 100644 drivers/usb/host/xen-usbback/common.h
> create mode 100644 drivers/usb/host/xen-usbback/usbback.c
> create mode 100644 drivers/usb/host/xen-usbback/usbdev.c
> create mode 100644 drivers/usb/host/xen-usbback/xenbus.c
> create mode 100644 drivers/usb/host/xen-usbfront.c
> create mode 100644 include/xen/interface/io/usbif.h
>
> --
> 1.7.9.5
>
>

> _______________________________________________
> Xen-devel mailing list
> Xen-devel@xxxxxxxxxxxxx
> http://lists.xen.org/xen-devel

Alexander Savchenko | Kernel developer
GlobalLogic
M +38-093-808-37-33 S darkside.warlock
www.globallogic.com

Re: [Xen-devel] [PATCH 0/3] xen/arm: omap5: PV USB driver issue