[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Report in downstream Debian: mpt3sas broken with xen dom0 with update to 5.10.149 in 5.10.y.
- To: Christoph Hellwig <hch@xxxxxxxxxxxxx>, Juergen Gross <jgross@xxxxxxxx>
- From: Andrew Cooper <Andrew.Cooper3@xxxxxxxxxx>
- Date: Mon, 24 Oct 2022 17:28:05 +0000
- Accept-language: en-GB, en-US
- Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=citrix.com; dmarc=pass action=none header.from=citrix.com; dkim=pass header.d=citrix.com; arc=none
- Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=OBf5iH04IB6LpL1AZHt/qQEG78BHFOYBu4nXeDYqywE=; b=ld/LaSYcsDZGRwlSwusWoQwE8L0Qs69KqzEyhUyXqHcGKaxV0E2p3nHftQKWq3Hf4y+SoI7i9Hx9OsdsGHtdPKd+u5IVA4xN8B77i5AsZ/9Khm953WS6Ol6L+SsXDx0rNlmurrHbFald/3JdVK9B+z6ck/S8hgIvv4puGcPTOKLUB7s70Jl2ZsZAmK0Q/7l0LNQ/gaZm0hzCsk1tNHOI5DX5DDMeMPYwQZGNjEUM3rSMCZ8OGiJlwFZMllkAtNIN59QatPZ/MqiHiqSZQ8rxb/zy2wlvzvEj+di5qj1B1VHNUFUr+i1BwppicaT3knDkzTpzNF4x1GgDnPmdJiu0hQ==
- Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=ODDwyf9zr+RH+7QCM2lHAFfYLX7kTGZi8MGrcIY/hW/SCt+ySO7GpAMBr8n8fpM7FPaYyf/7CtzR+3kUeEOHigVW/mPZUd09OYK87McFN3dgiBJLIAbb3NGOEpT5/cDuiAPwxbg5BvfkWyHDGeliNyu8nj0gNhA5TXPJ1oNgeS8Yzz/L3Xg1PK+uBWXTIz4mstORafYk45DoJaZu9wbL5fGf8LA16r/rBUWnVfchO6Hwt3NlPnUBnmv7rWPtWI7PfEFgoWAuVpOkvzfTjDUxcXRqUA1nng2LX5ygAGBELM7ZTtjfNVtrYxDXckYhXOBC2iTyVYJ5+oSMMQG9uMeLzw==
- Authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=citrix.com;
- Cc: "jejb@xxxxxxxxxxxxx" <jejb@xxxxxxxxxxxxx>, Sreekanth Reddy <sreekanth.reddy@xxxxxxxxxxxx>, Bart Van Assche <bvanassche@xxxxxxx>, Salvatore Bonaccorso <carnil@xxxxxxxxxx>, "sathya.prakash@xxxxxxxxxxxx" <sathya.prakash@xxxxxxxxxxxx>, "suganath-prabu.subramani@xxxxxxxxxxxx" <suganath-prabu.subramani@xxxxxxxxxxxx>, "Martin K. Petersen" <martin.petersen@xxxxxxxxxx>, "MPT-FusionLinux.pdl@xxxxxxxxxxxx" <MPT-FusionLinux.pdl@xxxxxxxxxxxx>, "linux-scsi@xxxxxxxxxxxxxxx" <linux-scsi@xxxxxxxxxxxxxxx>, "linux-kernel@xxxxxxxxxxxxxxx" <linux-kernel@xxxxxxxxxxxxxxx>, "xen-devel@xxxxxxxxxxxxxxxxxxxx" <xen-devel@xxxxxxxxxxxxxxxxxxxx>, "adi@xxxxxxxxxxxx" <adi@xxxxxxxxxxxx>
- Delivery-date: Mon, 24 Oct 2022 17:28:37 +0000
- Ironport-data: A9a23:/ZBQxKyHEI1zQ6+QP116t+f9xirEfRIJ4+MujC+fZmUNrF6WrkVRy zEZD2+PbKqOYTP2edEjb46z8xsG78DdyYQwHQVsrCAxQypGp/SeCIXCJC8cHc8wwu7rFxs7s ppEOrEsCOhuExcwcz/0auCJQUFUjP3OHPykYAL9EngZbRd+Tys8gg5Ulec8g4p56fC0GArIs t7pyyHlEAbNNwVcbyRFtspvlDs15K6o4WtC4gRkDRx2lAS2e0c9Xcp3yZ6ZdxMUcqEMdsamS uDKyq2O/2+x13/B3fv8z94X2mVTKlLjFVDmZkh+AsBOsTAbzsAG6Y4pNeJ0VKtio27hc+ada jl6ncfYpQ8BZsUgkQmGOvVSO3kW0aZuoNcrLZUj2CA6IoKvn3bEmp1T4E8K0YIwvepPMUZh9 tkjeGo8TAGKn+CR3uuHc7w57igjBJGD0II3nFhFlGmcIdN4BJfJTuPN+MNS2yo2ioZWB/HCa sEFaD1pKhPdfxlIPVRRA5U79AuqriCnL3sE9xTI9exuuzW7IA9ZidABNPL8fNCQSNoTtUGfv m/cpEzyAw0ANczZwj2Amp6prr+SzHmhAthNfFG+3tJbvnihmnIDMQctS3CloeicrE/gZs0Kf iT4/QJr98De7neDTtL9dxy+rmSNshMVV5xXCeJSwAOC0K3P+C6CG3MJCDVGbbQOtsI0TxQu1 1mUj5XoDzkpu7qQIVqG7LqZrjq0JShTN2IOaT4sRxEC6tXop4R1hRXKJv5pDqezh8buEjH96 zmBqW45nbp7pcUCzaO6+XjLjjitr56PSRQ6ji3MV36l/wo/fJSsZIWz6XDR9/FJII2eSx+Ku 31ss9OD4+kIBI2N0TSXSe8QWqq07eyMNTTagHZlBZ4o+z+q/jioeoU4yDR3PltoNIAcdCPke lTevytW/pZYOHbsZqhyC6qUM/hv47X7FNPjcvHSc8oIepR1XAWd+yhibkmVmWvqlSAElaA5J Ifeas23DF4EBql9ijm7XeEQ1fks3C9W7WfSQ43riheqy7yTYFaLRrofdliDdOY06OWDugq92 8ZSMY6GxgtSVMX6YzLL6sgDIFYSN385CJvq7ctNeYarKwZnMGI7CvLewKgqe8psg8xoevzg+ 3i8XgpUzQT5jHiecQGSMCk7NfXoQIp1qm89MWo0J1G01nM/YIGpqqACa58werph/+tmpRJpc 8Q4lwy7KqwnYlz6F/41NPERcKQKmMyXuD+z
- Ironport-hdrordr: A9a23:LPnCT6DEu0qfnkflHegPsceALOsnbusQ8zAXPh9KJCC9I/bzqy nxpp8mPEfP+U0ssHFJo6HiBEEZKUmsuKKdkrNhR4tKOzOW9FdATbsSp7cKpgeNJ8SQzJ876U 4NSclD4ZjLfCBHZKXBkUaF+rQbsb+6GcmT7I+woUuFDzsaEp2IhD0JaDpzZ3cGIDWucqBJca Z0iPAmmxOQPVAsKuirDHgMWObO4/fRkoj9XBIADxk7rCGTkDKB8tfBYlml9yZbdwkK7aYp8G DDnQC8zL6kqeuHxhjV0HKWx4hKmeHm1sBICKW3+4gow3TX+0WVjbZaKvi/VQMO0aWSAZER4Z 7xSiIbToZOArXqDyeISFXWqlDdOX0VmgLfIBej8AfeSIrCNXwH4oN69PxkmlGy0TtegPhslK 1MxG6XrJxREFfJmzn8/cHBU1VwmlOzumdKq59bs5Vza/poVFZql/1owGpFVJMbWC7q4oEuF+ djSMna+fZNaFufK3TUpHNmztCgVmk6Wk7ueDlIhuWFlzxN2HxpxUoRw8IS2n8G6ZImUpFBo+ DJKL5hmr1CRtIfKah9GOACS82qDXGle2OFDEuCZVD8UK0XMXPErJD6pL0z+eGxYZQNiIA/nZ zQOWkowVLau3iefPFm8Kc7gSwlGl/NLAgF4vsul6RRq/n7WKfhNzGFRRQnj9agys9vcPHmZw ==
- List-id: Xen developer discussion <xen-devel.lists.xenproject.org>
- Thread-index: AQHY5S6guM11mZi1eU2dnhLTM/dNx64bMt2AgAJCJQCAAA9HgIAACC+AgAA85QCAAAg5gA==
- Thread-topic: Report in downstream Debian: mpt3sas broken with xen dom0 with update to 5.10.149 in 5.10.y.
On 24/10/2022 17:58, Christoph Hellwig wrote:
> On Mon, Oct 24, 2022 at 03:20:43PM +0200, Juergen Gross wrote:
>> Dom0 is (normally) a PV domain, so the physical memory can be still above
>> 4 GB even with dom0_mem set to 4GB.
> Which means that we need to ensure the DMA ops for Xen-PV (which is
> always xen-swiotlb I think?) need to return DMA_BIT_MASK(64) or whatever
> is the highest possible address.
Xen tries to allocate memory from the top down, in order to keep the low
memory free for special purses. (32bit PV guests strictly need to live
below the 128G boundary in host physical space for ABI reasons, and
Xen's struct vcpu needs to be below the 4G boundary for compatibility
with some processors.)
This means that a 64bit PV dom0 ends up occupying the highest addresses
in RAM. Naturally, this is a problem for devices which can't do 64bit DMA.
The xen-swiotlb is a region (default 128M iirc) which dom0 requests of
Xen during startup. It is below the 4G boundary, and physically
contiguous (unlike most of the rest of PV guest memory).
Hence it's a suitable bounce buffer for any 32-bit-only devices.
I don't know exactly how this translates to Linux internals, but most
devices are fine and it's routinely the mpt2/3sas drivers which
encounter problems. It would be lovely if we could get to the bottom of
this for once and for all.
~Andrew
|
