[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Xen-devel] Re: [RFC PATCH 0/4] (Take 2): transcendent memory ("tmem") for Linux



Chris Mason wrote:
On Mon, Jul 13, 2009 at 03:38:45PM -0500, Anthony Liguori wrote:
I'll definitely grant that caching with writethough adds more caching,
but it does need trim support before it is similar to tmem.

I think trim is somewhat orthogonal but even if you do need it, the nice thing about implementing ATA trim support verses a paravirtualization is that it works with a wide variety of guests.

From the perspective of the VMM, it seems like a good thing.

  The caching
is transparent to the guest, but it is also transparent to qemu, and so
it is harder to manage and size (or even get a stat for how big it
currently is).

That's certainly a fixable problem though. We could expose statistics to userspace and then further expose those to guests. I think the first question to answer though is what you would use those statistics for.

The difference between our "tmem" is that instead of providing an interface where the guest explicitly says, "I'm throwing away this memory, I may need it later", and then asking again for it, the guest throws away the page and then we can later satisfy the disk I/O request that results from re-requesting the page instantaneously.

This transparent approach is far superior too because it enables transparent sharing across multiple guests. This works well for CoW images and would work really well if we had a file system capable of block-level deduplification... :-)

Grin, I'm afraid that even if someone were to jump in and write the
perfect cow based filesystem and then find a willing contributor to code
up a dedup implementation, each cow image would be a different file
and so it would have its own address space.

Dedup and COW are an easy way to have hints about which pages are
supposed to be have the same contents, but they would have to go with
some other duplicate page sharing scheme.

Yes. We have the information we need to dedup this memory though. We just need a way to track non-dirty pages that result from DMA, map the host page cache directly into the guest, and then CoW when the guest tries to dirty that memory.

We don't quite have the right infrastructure in Linux yet to do this effectively, but this is entirely an issue with the host. The guest doesn't need any changes here.

Regards,

Anthony Liguori
-chris



_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel


 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.