[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

RE: [Xen-devel] disk offline with xen4.0+pvops2.6.31.13


  • To: yingbin wang <yingbin.wangyb@xxxxxxxxx>, Jeremy Fitzhardinge <jeremy@xxxxxxxx>
  • From: "Zhang, Xiantao" <xiantao.zhang@xxxxxxxxx>
  • Date: Thu, 29 Apr 2010 10:56:00 +0800
  • Accept-language: en-US
  • Acceptlanguage: en-US
  • Cc: Xen-devel <xen-devel@xxxxxxxxxxxxxxxxxxx>
  • Delivery-date: Wed, 28 Apr 2010 19:56:57 -0700
  • List-id: Xen developer discussion <xen-devel.lists.xensource.com>
  • Thread-index: Acrm1rGv59bnWOyLQXS6HkH0LMuMjQAb0FKQ
  • Thread-topic: [Xen-devel] disk offline with xen4.0+pvops2.6.31.13

Xen hypervisor has the MSI support from Xen 3.3 or newer version, but if you 
want to use MSI for your device, you have to check its MSI capability 
first(e.g. lspci -vvv).  For the device you are using, you have to enable its 
MSI through a kernel module parameter because its MSI is set to off by default. 
Xiantao

yingbin wang wrote:
> we found some info from xen wiki:
> 
> Enabling MSI/MSI-X for Assigned Devices
> As of Xen 3.4.0 MSI/MSI-X is always on.
>       This change was made in changeset: 18454:65dc37be0443
> In Xen 3.3.0, MSI/MSI-X could be enabled using the xen boot parameter
>       "msi=1". This change was made in changeset: 18127:89d05940cc1c
>       The following snippet from a grub configuration enables MSI/MSI-X
>               kernel xen.gz msi=1
> 
> does it mean that we should also Enable MSI Support for SAS in
> mptbase module? 
> 
> 2010/4/28 tsk <aixt2006@xxxxxxxxx>:
>> It seem that we have got a mitigation when enable the
>> mpt_msi_enable_sas option of mptbase module. But not sure if it
>> solve the problem. "So you're saying that any recent Xen with any
>> kernel is failing on 
>> fairly recent hardware.  Have you tried playing with the iommu boot
>> command line options?"
>> We have not tried the iommu option.
>> 
>> "Can you post a complete log of Xen's console output (both
>> hypervisor and kernel console)?" It seem that if we do uncompressing
>> stress test in Dom0, offline will appear. "What is the hardware
>> platform?  Am I right in guessing that you're 
>> seeing this on two distinct machines?"
>> the detail hardware info of huawei machines is:
>> root@r02k05040 # lspci
>> 00:00.0 Host bridge: Intel Corporation 5500 I/O Hub to ESI Port (rev
>> 13) 00:01.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI
>> Express Root Port 1 (rev 13) 00:03.0 PCI bridge: Intel Corporation
>> 5520/5500/X58 I/O Hub PCI Express Root Port 3 (rev 13) 00:07.0 PCI
>> bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root
>> Port 7 (rev 13) 00:09.0 PCI bridge: Intel Corporation 5520/5500/X58
>> I/O Hub PCI Express Root Port 9 (rev 13) 00:10.0 PIC: Intel
>> Corporation 5520/5500/X58 Physical and Link Layer Registers Port 0
>> (rev 13) 00:10.1 PIC: Intel Corporation 5520/5500/X58 Routing and
>> Protocol Layer Registers Port 0 (rev 13) 00:11.0 PIC: Intel
>> Corporation 5520/5500 Physical and Link Layer Registers Port 1 (rev
>> 13) 00:11.1 PIC: Intel Corporation 5520/5500 Routing & Protocol
>> Layer Register Port 1 (rev 13) 00:13.0 PIC: Intel Corporation
>> 5520/5500/X58 I/O Hub I/OxAPIC Interrupt Controller (rev 13) 00:14.0
>> PIC: Intel Corporation 5520/5500/X58 I/O Hub System Management
>> Registers (rev 13) 00:14.1 PIC: Intel Corporation 5520/5500/X58 I/O
>> Hub GPIO and Scratch Pad Registers (rev 13) 00:14.2 PIC: Intel
>> Corporation 5520/5500/X58 I/O Hub Control Status and RAS Registers
>> (rev 13) 00:14.3 PIC: Intel Corporation 5520/5500/X58 I/O Hub
>> Throttle Registers (rev 13) 00:1a.0 USB Controller: Intel
>> Corporation 82801JI (ICH10 Family) USB UHCI Controller #4 00:1a.7
>> USB Controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI
>> Controller #2 00:1d.0 USB Controller: Intel Corporation 82801JI
>> (ICH10 Family) USB UHCI Controller #1 00:1d.1 USB Controller: Intel
>> Corporation 82801JI (ICH10 Family) USB UHCI Controller #2 00:1d.2
>> USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI
>> Controller #3 00:1d.7 USB Controller: Intel Corporation 82801JI
>> (ICH10 Family) USB2 EHCI Controller #1 00:1e.0 PCI bridge: Intel
>> Corporation 82801 PCI Bridge (rev 90) 00:1f.0 ISA bridge: Intel
>> Corporation 82801JIB (ICH10) LPC Interface Controller 00:1f.2 IDE
>> interface: Intel Corporation 82801JI (ICH10 Family) 4 port SATA IDE
>> Controller 00:1f.3 SMBus: Intel Corporation 82801JI (ICH10 Family)
>> SMBus Controller 00:1f.5 IDE interface: Intel Corporation 82801JI
>> (ICH10 Family) 2 port SATA IDE Controller 01:00.0 Ethernet
>> controller: Broadcom Corporation NetXtreme II BCM5709 Gigabit
>> Ethernet (rev 20) 01:00.1 Ethernet controller: Broadcom Corporation
>> NetXtreme II BCM5709 Gigabit Ethernet (rev 20) 04:00.0 SCSI storage
>> controller: LSI Logic / Symbios Logic SAS1068E PCI-Express
>> Fusion-MPT SAS (rev 08) 05:00.0 VGA compatible controller: XGI
>> Technology Inc. (eXtreme Graphics Innovation) Z9s/Z9m (XG21 core)   
>> 
>> 
>> 
>> 2010/4/28 Jeremy Fitzhardinge <jeremy@xxxxxxxx>
>>> 
>>> On 04/27/2010 01:10 AM, tsk wrote:
>>>> Hi, I'm a friend of yingbin wang,
>>>> 
>>>> we take some pictures for the disk offline, in the attachment.
>>>> 
>>>> We did many stress test, the result is:
>>>> disk offline disappears when there is no xen hypervision in
>>>> 2.6.31.13, when we use RHEL 5.x kernel+Xen, disk offline
>>>> disappears too. It seems that redhat should add some patch to
>>>> solve this problem.. 
>>>> 
>>>> disk offline appears on:
>>>> linux-2.6.18.8 + Xen-3.4.2
>>>> linux-2.6.31.13 + Xen-4.0.0
>>>> linux-2.6.32.10 + Xen-3.4.2
>>>> Fedora linux-2.6.32 + Xen-4.0.0
>>>> Suse linux-2.6.32.11 + Xen-3.4.2
>>>> 
>>>> The servers tested above are all with Nehalem architecture CPU.
>>> 
>>> So you're saying that any recent Xen with any kernel is failing on
>>> fairly recent hardware.  Have you tried playing with the iommu boot
>>> command line options? 
>>> 
>>> Can you post a complete log of Xen's console output (both
>>> hypervisor and kernel console)? 
>>> 
>>> What is the hardware platform?  Am I right in guessing that you're
>>> seeing this on two distinct machines?
>>> 
>>> Thanks,
>>>    J
>> 
>> 
>> _______________________________________________
>> Xen-devel mailing list
>> Xen-devel@xxxxxxxxxxxxxxxxxxx
>> http://lists.xensource.com/xen-devel
>> 
>> 
> 
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@xxxxxxxxxxxxxxxxxxx
> http://lists.xensource.com/xen-devel


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel


 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.