[Xen-devel] [PATCH v6 00/23] Virtual NUMA for PV and HVM

[Wei Liu <wei.liu2@xxxxxxxxxx>]

Hi all

This is version 6 of this series rebased on top of staging.

This patch series implements virtual NUMA support for both PV and HVM guest.
That is, admin can configure via libxl what virtual NUMA topology the guest
sees.

This is the stage 1 (basic vNUMA support) and part of stage 2 (vNUMA-ware
ballooning, hypervisor side) described in my previous email to xen-devel [0].

This series is broken into several parts:

1. xen patches: vNUMA debug output and vNUMA-aware memory hypercall support.
2. libxc/libxl support for PV vNUMA.
3. libxc/libxl/hypervisor support for HVM vNUMA.
4. xl vNUMA configuration documentation and parser.

One significant difference from Elena's work is that this patch series makes
use of multiple vmemranges should there be a memory hole, instead of shrinking
ram. This matches the behaviour of real hardware.

The vNUMA auto placement algorithm is missing at the moment and Dario is
working on it.

This series can be found at:
 git://xenbits.xen.org/people/liuw/xen.git wip.vnuma-v5

With this series, the following configuration can be used to enabled virtual
NUMA support, and it works for both PV and HVM guests.

vnuma = [ [ "pnode=0","size=3000","vcpus=0-3","vdistances=10,20"  ],
          [ "pnode=0","size=3000","vcpus=4-7","vdistances=20,10"  ],
        ]

For example output of guest NUMA information, please look at [1].

In terms of libxl / libxc internal, things are broken into several
parts:

1. libxl interface

Users of libxl can only specify how many vnodes a guest can have, but
currently they have no control over the actual memory layout. Note that
it's fairly easy to export the interface to control memory layout in the
future.

2. libxl internal

It generates some internal vNUMA configurations when building domain,
then transform them into libxc representations. It also validates vNUMA
configuration along the line.

3. libxc internal

Libxc does what it's told to do. It doesn't do anything smart (in fact,
I delibrately didn't put any smart logic inside it). Libxc will also
report back some information in HVM case to libxl but that's it.

Wei.

[0] <20141111173606.GC21312@xxxxxxxxxxxxxxxxxxxxx>
[1] <1416582421-10789-1-git-send-email-wei.liu2@xxxxxxxxxx>

Wei Liu (23):
  xen: factor out construct_memop_from_reservation
  xen: move NUMA_NO_NODE to public memory.h as XEN_NUMA_NO_NODE
  xen: make two memory hypercalls vNUMA-aware
  libxc: duplicate snippet to allocate p2m_host array
  libxc: add p2m_size to xc_dom_image
  libxc: allocate memory with vNUMA information for PV guest
  libxl: introduce vNUMA types
  libxl: add vmemrange to libxl__domain_build_state
  libxl: introduce libxl__vnuma_config_check
  libxl: x86: factor out e820_host_sanitize
  libxl: functions to build vmemranges for PV guest
  libxl: build, check and pass vNUMA info to Xen for PV guest
  libxc: indentation change to xc_hvm_build_x86.c
  libxc: allocate memory with vNUMA information for HVM guest
  libxl: build, check and pass vNUMA info to Xen for HVM guest
  libxl: disallow memory relocation when vNUMA is enabled
  libxl: define LIBXL_HAVE_VNUMA
  libxlu: rework internal representation of setting
  libxlu: nested list support
  libxlu: record line and column number when parsing values
  libxlu: introduce new APIs
  xl: introduce xcalloc
  xl: vNUMA support

 docs/man/xl.cfg.pod.5                    |  54 +++++++
 tools/libxc/include/xc_dom.h             |  13 +-
 tools/libxc/include/xenguest.h           |  11 ++
 tools/libxc/xc_dom_arm.c                 |   1 +
 tools/libxc/xc_dom_core.c                |   8 +-
 tools/libxc/xc_dom_x86.c                 | 129 +++++++++++++---
 tools/libxc/xc_hvm_build_x86.c           | 237 +++++++++++++++++++----------
 tools/libxl/Makefile                     |   2 +-
 tools/libxl/libxl.h                      |   7 +
 tools/libxl/libxl_arch.h                 |   6 +
 tools/libxl/libxl_arm.c                  |   8 +
 tools/libxl/libxl_create.c               |   9 ++
 tools/libxl/libxl_dm.c                   |   6 +-
 tools/libxl/libxl_dom.c                  | 120 +++++++++++++++
 tools/libxl/libxl_internal.h             |  24 +++
 tools/libxl/libxl_types.idl              |  10 ++
 tools/libxl/libxl_vnuma.c                | 253 +++++++++++++++++++++++++++++++
 tools/libxl/libxl_x86.c                  | 105 +++++++++++--
 tools/libxl/libxlu_cfg.c                 | 209 ++++++++++++++++++-------
 tools/libxl/libxlu_cfg_i.h               |  14 +-
 tools/libxl/libxlu_cfg_y.c               |  72 ++++-----
 tools/libxl/libxlu_cfg_y.h               |   2 +-
 tools/libxl/libxlu_cfg_y.y               |  18 ++-
 tools/libxl/libxlu_internal.h            |  24 ++-
 tools/libxl/libxlutil.h                  |  13 ++
 tools/libxl/xl_cmdimpl.c                 | 150 +++++++++++++++++-
 xen/arch/x86/hpet.c                      |   2 +-
 xen/arch/x86/irq.c                       |   4 +-
 xen/arch/x86/numa.c                      |  14 +-
 xen/arch/x86/physdev.c                   |   2 +-
 xen/arch/x86/setup.c                     |   2 +-
 xen/arch/x86/smpboot.c                   |   2 +-
 xen/arch/x86/srat.c                      |  28 ++--
 xen/arch/x86/x86_64/mm.c                 |   2 +-
 xen/common/kernel.c                      |   2 +-
 xen/common/memory.c                      |  85 ++++++++---
 xen/common/page_alloc.c                  |   4 +-
 xen/drivers/passthrough/amd/iommu_init.c |   2 +-
 xen/drivers/passthrough/vtd/iommu.c      |   8 +-
 xen/include/public/features.h            |   3 +
 xen/include/public/memory.h              |   4 +
 xen/include/xen/numa.h                   |   5 +-
 42 files changed, 1392 insertions(+), 282 deletions(-)
 create mode 100644 tools/libxl/libxl_vnuma.c

-- 
1.9.1


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
http://lists.xen.org/xen-devel