Re: [Xen-devel] disk offline with xen4.0+pvops2.6.31.13

[yingbin wang <yingbin.wangyb@xxxxxxxxx>]

we found some info from xen wiki:

Enabling MSI/MSI-X for Assigned Devices
As of Xen 3.4.0 MSI/MSI-X is always on.
        This change was made in changeset: 18454:65dc37be0443
In Xen 3.3.0, MSI/MSI-X could be enabled using the xen boot parameter "msi=1".
        This change was made in changeset: 18127:89d05940cc1c
        The following snippet from a grub configuration enables MSI/MSI-X
                kernel xen.gz msi=1

does it mean that we should also Enable MSI Support for SAS in mptbase module?

2010/4/28 tsk <aixt2006@xxxxxxxxx>:
> It seem that we have got a mitigation when enable the mpt_msi_enable_sas
> option of mptbase module. But not sure if it solve the problem.
> "So you're saying that any recent Xen with any kernel is failing on
> fairly recent hardware.  Have you tried playing with the iommu boot
> command line options?"
> We have not tried the iommu option.
>
> "Can you post a complete log of Xen's console output (both hypervisor and
> kernel console)?"
> It seem that if we do uncompressing stress test in Dom0, offline will
> appear.
> "What is the hardware platform?  Am I right in guessing that you're
> seeing this on two distinct machines?"
> the detail hardware info of huawei machines is:
> root@r02k05040 # lspci
> 00:00.0 Host bridge: Intel Corporation 5500 I/O Hub to ESI Port (rev 13)
> 00:01.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root
> Port 1 (rev 13)
> 00:03.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root
> Port 3 (rev 13)
> 00:07.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root
> Port 7 (rev 13)
> 00:09.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root
> Port 9 (rev 13)
> 00:10.0 PIC: Intel Corporation 5520/5500/X58 Physical and Link Layer
> Registers Port 0 (rev 13)
> 00:10.1 PIC: Intel Corporation 5520/5500/X58 Routing and Protocol Layer
> Registers Port 0 (rev 13)
> 00:11.0 PIC: Intel Corporation 5520/5500 Physical and Link Layer Registers
> Port 1 (rev 13)
> 00:11.1 PIC: Intel Corporation 5520/5500 Routing & Protocol Layer Register
> Port 1 (rev 13)
> 00:13.0 PIC: Intel Corporation 5520/5500/X58 I/O Hub I/OxAPIC Interrupt
> Controller (rev 13)
> 00:14.0 PIC: Intel Corporation 5520/5500/X58 I/O Hub System Management
> Registers (rev 13)
> 00:14.1 PIC: Intel Corporation 5520/5500/X58 I/O Hub GPIO and Scratch Pad
> Registers (rev 13)
> 00:14.2 PIC: Intel Corporation 5520/5500/X58 I/O Hub Control Status and RAS
> Registers (rev 13)
> 00:14.3 PIC: Intel Corporation 5520/5500/X58 I/O Hub Throttle Registers (rev
> 13)
> 00:1a.0 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI
> Controller #4
> 00:1a.7 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI
> Controller #2
> 00:1d.0 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI
> Controller #1
> 00:1d.1 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI
> Controller #2
> 00:1d.2 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI
> Controller #3
> 00:1d.7 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI
> Controller #1
> 00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 90)
> 00:1f.0 ISA bridge: Intel Corporation 82801JIB (ICH10) LPC Interface
> Controller
> 00:1f.2 IDE interface: Intel Corporation 82801JI (ICH10 Family) 4 port SATA
> IDE Controller
> 00:1f.3 SMBus: Intel Corporation 82801JI (ICH10 Family) SMBus Controller
> 00:1f.5 IDE interface: Intel Corporation 82801JI (ICH10 Family) 2 port SATA
> IDE Controller
> 01:00.0 Ethernet controller: Broadcom Corporation NetXtreme II BCM5709
> Gigabit Ethernet (rev 20)
> 01:00.1 Ethernet controller: Broadcom Corporation NetXtreme II BCM5709
> Gigabit Ethernet (rev 20)
> 04:00.0 SCSI storage controller: LSI Logic / Symbios Logic SAS1068E
> PCI-Express Fusion-MPT SAS (rev 08)
> 05:00.0 VGA compatible controller: XGI Technology Inc. (eXtreme Graphics
> Innovation) Z9s/Z9m (XG21 core)
>
>
>
> 2010/4/28 Jeremy Fitzhardinge <jeremy@xxxxxxxx>
>>
>> On 04/27/2010 01:10 AM, tsk wrote:
>> > Hi, I'm a friend of yingbin wang,
>> >
>> > we take some pictures for the disk offline, in the attachment.
>> >
>> > We did many stress test, the result is:
>> > disk offline disappears when there is no xen hypervision in 2.6.31.13,
>> > when we use RHEL 5.x kernel+Xen, disk offline disappears too. It seems
>> > that redhat should add some patch to solve this problem..
>> >
>> > disk offline appears on:
>> > linux-2.6.18.8 + Xen-3.4.2
>> > linux-2.6.31.13 + Xen-4.0.0
>> > linux-2.6.32.10 + Xen-3.4.2
>> > Fedora linux-2.6.32 + Xen-4.0.0
>> > Suse linux-2.6.32.11 + Xen-3.4.2
>> >
>> > The servers tested above are all with Nehalem architecture CPU.
>>
>> So you're saying that any recent Xen with any kernel is failing on
>> fairly recent hardware.  Have you tried playing with the iommu boot
>> command line options?
>>
>> Can you post a complete log of Xen's console output (both hypervisor and
>> kernel console)?
>>
>> What is the hardware platform?  Am I right in guessing that you're
>> seeing this on two distinct machines?
>>
>> Thanks,
>>    J
>
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@xxxxxxxxxxxxxxxxxxx
> http://lists.xensource.com/xen-devel
>
>

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel