[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: obtain a list of granttable PFNs from toolstack


  • To: Olaf Hering <olaf@xxxxxxxxx>, Jan Beulich <jbeulich@xxxxxxxx>
  • From: Andrew Cooper <andrew.cooper3@xxxxxxxxxx>
  • Date: Wed, 28 Apr 2021 12:43:45 +0100
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=citrix.com; dmarc=pass action=none header.from=citrix.com; dkim=pass header.d=citrix.com; arc=none
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=jN+ndvN9/DrxVG3muYUg2aYVO7Vk22ndV6F7PGNQf7A=; b=hC3z6p/ZejZ2mYpOBklLJzdxtkVx03r/oR1xDZAymx33XTYYCvehAW6geT89AMS0DzXNJDDqs38ZYLdL6cwjz5q05t2fQeVn2HMhJlQXcss4LFy2YBD7rvBUIIu+Xxv/TU/M7A1ZgsqAailSBx6wr9YIlnxoAh2qtn6XiZdTyvdlL1i0YBWycLO93ig2Qlajz2dalTA/gyk6NS9uUjEDggQdNtZ6BwjN9dIOyZord9DXzVchl47Tx+qe7pZ3fq5uu/BRVVba2etNeWV7kUSWVb6tXd83YdRFkY9rlEMJH7zAfPssgzxJwjSkwbjKYdAadp6YhvjetxYs9EKy9nZKtg==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Mgc9hEZ53b1cb7EDcyd51+epUwxeZhb8ujg7RMjPkmcokANO6JoGRND2L2Mump231TIgmuNwXCHPsqFd6Hw48KTakhbkzG2BzXsm0viwTqkkUM/ZcQut+aYqQ2niV8wq74tTV1dvsgnxwl5+tmO9xYnaT2YfgriqPf/ArbbD2UNGq/NQqOnYkYfNb60AzNXYXpq4i3b0jHHdaYR7BLRmMXn3Bcon1q78aPualh+OxXNnJMz09tVB1tunpjYIj1H/0lC8PjZ591k3HqjOHjbSMs7YzyGLaVCTPgDqdt2YqFjxvoQjax9p8quDaDzv823mieIuzJ84LRY2DChIYEWTAg==
  • Authentication-results: esa3.hc3370-68.iphmx.com; dkim=pass (signature verified) header.i=@citrix.onmicrosoft.com
  • Cc: <xen-devel@xxxxxxxxxxxxxxxxxxxx>
  • Delivery-date: Wed, 28 Apr 2021 11:44:19 +0000
  • Ironport-hdrordr: A9a23:8csJfampuHVYFjbIsYN24p9amh/pDfP+imdD5ilNYBxZY6Wkvu izgfUW0gL1gj4NWHcm3euNIrWEXGm0z/NIyKMaVI3DYCDNvmy0IIZ+qbbz2jGIIVybysdx94 dFN5J/Btr5EERgga/BijWQPt48zLC8n5yAqvzZyx5WIz1CT4FFw0NHBh2AEktwLTM2YKYRMJ aH/MJIq36BVB0sH6eGL0IIVeTCuNHH/aiOCXI7LiUq9RWUineQ4KP6eiLy4j4lTzhNzb0+mF K18TDR26PLiZCG4y6Z7UD/xdB8mNztytxMbfb89/Q9G3HXpSuDIKhkU72GljgprO+o80ZCqq ixnz4Qe/5dxlmUUmapoQb8+wSI6kdQ11bSjWW2rFGmgcvlSCk0A8BM7LgpDCfx2g4bk/xXlI dotljp0KZ/PFf7swnWo+XsbVVMkHG5pHIz+NRj9EB3YM8lR5J66bAE8Fg9KuZnIAvKrLoJPc NJF8/m6PNfYTqhHgrkl1gq+tCqU3gpdy32O3Qqi4iQ2zhSqnhz01EV8swZhmsB75IwUfB/lp z5Dpg=
  • Ironport-sdr: T5HGxE53Z6Z6jB55asCXhL1K51fCaAxt8eVcYKjtZfusPHPnULYk30waoNzNuDUqdXhxr7dBWI pb5pDi7V8bjd2EtvtwEgRqeMd7Pu2agAaPqWZuJEqN/C2tl0bbsAdFHbj0vGCqT+eR6uqpWeB1 RGiDwbnZtm8I1bMyNh+GAoYopC0Cosip+YuyBaf5ZEPB4f50W+iH2j6LnpXs/mf+oVOjaoDspU 4VVpgQYp1jB2kZm+a1i5V2zacOoZsK9S7TdoxkQvG1js9o3BTNy0K8fOhEFfEhRFOIfLjYOzYU vsE=
  • List-id: Xen developer discussion <xen-devel.lists.xenproject.org>

On 28/04/2021 12:03, Olaf Hering wrote:
> Am Wed, 28 Apr 2021 12:42:54 +0200
> schrieb Jan Beulich <jbeulich@xxxxxxxx>:
>
>> It might help if you would outline what you're actually after by
>> knowing a domain's active grants.
> There is REC_TYPE_VERIFY, which will re-transmit all memory of a paused domU 
> and compare what was previously transferred. Last time I used it a large 
> number of pages are different. I did not spent time to dig further into it, 
> what pfns are affected, how the pages differ. I suspect the backends do still 
> write into the granted pages, hence the question.
>
> I think the domU may undo all grants during its suspend anyway, that is 
> something to explore as well.

Grants are not properly accounted for in the logdirty bitmap, because
they're not unmapped during the final phase.

This came as an unexpected surprise when I was doing migration v2.  You
really will see `--debug` identify dirty frames, but its "fine", allegedly.

The reason is that frontends and backends can't disconnect while the VM
is paused, and will continue to process outstanding IO.  The reason this
doesn't explode on the destination is because the guest kernel replays
the command ring.

Disks get possibly re-issued read/writes.  Networks really does drop
some to-guest packets, and may send duplicate to-host packets - TCP
handles this normal mechanisms, and UDP is UDP.  Other PV protocols will
encounter similar problems.

I didn't get the impression that this behaviour was intentional in the
first place, and its certainly not something you'd deliberately design. 
It appears to have been a consequence of how PV guests evolved, where
kernel cooperation on migrate is mandatory, which caused kernel
cooperation to be mandatory for the paravirt driver pairs too.

~Andrew




 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.