[Xen-devel] Xen 4.6 Development Update (two months reminder)

[<wei.liu2@xxxxxxxxxx>]

Hi all

We are now two months into 4.6 development window. This is an email to keep
track of all the patch series I gathered. It is by no means complete and / or
acurate. Feel free to reply this email with new projects or correct my
misunderstanding.

= Timeline =

We are planning on a 9-month release cycle, but we could also release a bit
earlier if everything goes well (no blocker, no critical bug).

* Development start: 6 Jan 2015
<=== We are here ===>
* Feature Freeze: 10 Jul 2015
* RCs: TBD
* Release Date: 9 Oct 2015 (could release earlier)

The RCs and release will of course depend on stability and bugs, and
will therefore be fairly unpredictable.

Bug-fixes, if Acked-by by maintainer, can go anytime before the First
RC. Later on we will need to figure out the risk of regression/reward
to eliminate the possiblity of a bug introducing another bug.

= Prognosis =

The states are: none -> fair -> ok -> good -> done

none - nothing yet
fair - still working on it, patches are prototypes or RFC
ok   - patches posted, acting on review
good - some last minute pieces
done - all done, might have bugs

= Bug Fixes =

Bug fixes can be checked in without a freeze exception throughout the
freeze, unless the maintainer thinks they are particularly high
risk.  In later RC's, we may even begin rejecting bug fixes if the
broken functionality is small and the risk to other functionality is
high.

Document changes can go in anytime if the maintainer is OK with it.

These are guidelines and principles to give you an idea where we're coming
from; if you think there's a good reason why making an exception for you will
help us make Xen better than not doing so, feel free to make your case.

== Linux ==

*  PV domain with memory > 512GB (fair)
  -  Juergen Gross

*  Block driver multiqueue support (fair)
   RFC posted
  -  Bob Liu

*  Block driver multi-page ring support (fair)
  -  Bob Liu

*  Preemptable privcmd hypercalls (good)
   v5 posted
  -  David Vrabel

*  Linux ARM - Device assigment (PCI) (none)
   Depends on Xen pieces which are on the Xen 4.6 list.
  -  Manish Jaggi

*  pvUSB in Linux (fronted and backend) (Fair)
  -  Juergen Gross

*  VPMU - 'perf' support in Linux (ok)
   Depends on Xen patches
   Acked by David Vrabel
  -  Boris Ostrovsky

*  vNUMA in Linux (ok)
   v6 posted
   git://gitorious.org/vnuma/linux_vnuma.git
  -  Elena Ufimtseva

*  vsyscall in Linux (fair)
  -  Konrad Rzeszutek Wilk

*  COLO Agent in Linux (fair)
  -  Gui Jianfeng
  -  Yang Hongyang
  -  Dong, Eddie

*  ARM64 - support 64K guest (none)
  -  Julien Grall

== OpenStack ==

*  setup CI loop for OpenStack (fair)
  -  Anthony Perard

== FreeBSD ==

*  PVH FreeBSD dom0 (ok)
   FreeBSD 11 goal. Toolstack side done in Xen 4.5
  -  Roger Pau Monné

== Other OSes (MiniOS, QNX) ==

*  PV drivers for automotive kernels (fair)
  -  Artem Mygaiev

*  mini-os: xenbus changes for rump kernels (ok)
   git://xenbits.xen.org/people/iwj/rumpuser-xen.git
   branch: base.dev-xen-xenbus.v1..dev-xen-xenbus.v1
   v2 posted
  -  Ian Jackson

== GRUB2 ==

*  GRUB2 multiboot2 (fair)
  -  Daniel Kiper

== OSSTEST ==

*  OSSTest: studom test case (none)
  -  Wei Liu

*  OSSTest: libvirt migration (fair)
  -  Wei Liu

*  OSSTest: upgrade to Debian Jessie (none)
  -  Wei Liu

*  OSSTest: performance test (fair)
  -  Dario Faggioli

*  CPU pool test case (fair)
  -  Dario Faggioli

*  Add a FreeBSD host (fair)
  -  Roger Pau Monné

*  Nested virt test case (fair)
  -  Robert Hu

== QEMU ==

*  Linux-based QEMU upstream stub domain (fair)
   RFC posted
  -  Eric Shelton

*  Using qemu-upstream in a stubdomain (none)
   Will use rump kernels.
  -  Wei Liu

*  AMD Radeon PCI GPU passthrough (none)
   Focusing on Xen 4.2 and qemu-traditional
  -  Kelly Zytaruk

*  Intel IGD PCI GPU passthrough (ok)
   v5 posted
  -  Chen, Tiejun

== Up for grabs ==

*  save/restore/migrate PVHVM guest with > 32 vcpus
   http://lists.xen.org/archives/html/xen-devel/2015-02/msg00244.html

*  PoD fixes
   if you boot with memory <= maxmem we have a size estimation bug

*  TLB flushing without locks in Xen

*  xl does not support specifying virtual function for passthrough device
   http://bugs.xenproject.org/xen/bug/22

*  PCI hole resize support hvmloader/qemu-traditional/qemu-upstream with 
PCI/GPU passthrough
   http://bugs.xenproject.org/xen/bug/28

*  libx{c,l} error handling cleanup

*  Adding missing 'xend' features in libxl
   Need to define what is missing

*  xl list -l doesn't contain tty console port

*  xl: passing more defaults in configuration in xl.conf
   There are a number of options for which it might be useful to pass a default 
in xl.conf.  For example, if we could have a default "backend" parameter for 
vifs, then it would be easy to switch back and forth between a backend in a 
driver domain and a backend in dom0.

*  PVH - PVH working with shadow.
   Based on Tim's work

*  PVH - PCI passthrough for DomU.

*  AMD performance regressions

*  Performance due to hypercall preemption. More preemptions - slower. (none)

== Hypervisor ==

*  Alternate p2m: support multiple copies of host p2m (ok)
  -  Ed White

*  Improve RTDS scheduler (none)
  -  Dagaen Golomb, Meng Xu

*  Repurpose SEDF Scheduler for Real-time (fair)
   RFC patch posted (v2)
  -  Joshua Whitehead, Robert VanVossen

*  Credit2: introduce per-vcpu hard and soft affinity (fair)
  -  Justin T. Weaver

*  sndif: add API for para-virtual sound (fair)
   v7 posted
  -  Oleksandr Dmytryshyn

*  gnttab: improve scalability (good)
   v5 posted
  -  Christoph Egger

*  Display IO topology when PXM data is available (good)
   v3 posted
  -  Boris Ostrovsky

*  Clean-up of mem-event subsystem (good)
   v5 posted
  -  Tamas K Lengyel

*  Xen Boot Information (xbi) (ok)
   Dependency for GRUB2 + EFI work
   http://lists.xen.org/archives/html/xen-devel/2014-10/msg02068.html
   v4, No go for full patchset. Only some of the patches.
   No ARM EFI hardware (yet) available to test them.
  -  Daniel Kiper

*  Xen multiboot2-EFI support (fair)
   Needed for GrUB2
   Depends on Xen Boot info (rework multiboot and other structs)
   See http://lists.xen.org/archives/html/xen-devel/2013-05/msg02281.html
   RFC posted
  -  Daniel Kiper

*  Default to credit2 (none)
   cpu pinning, numa affinity and cpu reservation
  -  George Dunlap

*  Convert tasklet to per-cpu tasklets (fair)
   RFC posted
  -  Konrad Rzeszutek Wilk

*  Further tmem cleanups/fixes (16TB etc) (fair)
  -  Bob Liu

*  1TB slow destruction (ok)
  -  Bob Liu

=== Hypervisor X86 ===

*  VT-d Posted-interrupt (PI) (none)
  -  Wu, Feng

*  amd_ucode cleanups, verify patch size(enhancement) (mostly in master except 
one patch)

*  Data breakpoint Extension support (new-feat) (in master)

*  Feature masking MSR support (enhancement) (in master)

*  Support BRCM TruManage chip (Serial over LAN support) (new-feat) (in master)

*  fix vmce_amd* functions, unify mce_amd mcheck initialization (fixes/cleanups)

*  multiple AMD container files appended together in initrd (early initramfs)
  -  Aravind and Suravee

*  HT enabled with credit has 7.9 per perf drop. (none)
   kernbench demonstrated it
   http://www.gossamer-threads.com/lists/xen/devel/339409
   This has existed since credit1 introduction.
  -  Dario Faggioli

*  Support controlling the max C-state sub-state (fair)
   v3 posted
   Hadn't see the patch reposted.
  -  Ross Lagerwall

*  IOMMU ABI for guests to map their DMA regions (fair)
  -  Malcolm Crossley

*  dirty vram / IOMMU bug (fair)
   http://bugs.xenproject.org/xen/bug/38
  -  Zhang, Yang Z

*  Xen HPET interrupt fixes (fair)
   behind migration v2
  -  Andrew Cooper

*  Intel PML (Page Modification Logging) for Xen (none)
   design doc posted
  -  Kai Huang

*  Intel memory bandwidth monitoring for VMs (fair)
   v9 posted
  -  Chao Peng

*  xc_reserved_device_memory_map in hvmloader to avoid conflicting MMIO/RAM 
(good)
   v7 posted.
   Treating pieces as bug-fixes only.
   Low likehood of making it in Xen 4.5. Deferred
  -  Tiejun Chen

*  VPMU - 'perf' support in Xen (good)
   v14 posted
   Need reviews/final ack.
  -  Boris Ostrovsky

*  PVH - AMD hardware support. (fair)
   RFC posted
  -  Elena Ufimtseva

*  PVH dom0 (fair)
   RFC posted
  -  Elena Ufimtseva

*  extending mem_access support to PV domain (fair)
   RFC v2
  -  Aravindh Puthiyaparambil (aravindp)

=== Hypervisor ARM ===

*  Add support for Xilinx ZynqMP SoC (fair)
  -  Edgar E. Iglesias

*  ITS support (fair )
  -  Vijaya Kumar K

*  Add support for Huawei hip04-d01 platform (ok)
  -  Frediano Ziglio

*  Thunder X platform support (ok)
  -  Vijay Kilari

*  Add ACPI support for arm64 on Xen (fair)
   RFC posted
  -  Parth Dixit

*  ARM: reenable support 32-bit userspace running in 64-bit guest (good)
   v2 posted
  -  Ian Campbell

*  ARM remote processor iommu module (GPUs + IPUs) (fair)
   v3 posted
  -  Andrii Tseglytskyi

*  ARM VM save/restore/live migration (none)
   Need to rebased against migrationv2 - no code posted.
  -  None

*  ARM GICv2m support (none)
  -  Suravee Suthikulanit

*  ARM - SMMU resync of Linux's one (ok)
  -  Julien Grall

*  ARM - passthrough of non-PCI (ok)
  -  Julien Grall

*  ARM  PCI passthrough (none)
  -  Manish Jaggi
  -  Vijay Kilari

== Xen toolstack ==

*  toolstack-based approach to pvhvm guest kexec (fair)
   also contains hypervisor side change
  -  Vitaly Kuznetsov

*  libxl: add qxl vga interface support for upstream qemu (fair)
  -  Fabio Fantoni

*  Toolstack-based approach to pvhvm guest kexec (ok)
   v4 posted
  -  Vitaly Kuznetsov

*  libxl: cancelling asynchronous operations (fair)
   RFC posted
  -  Ian Jackson

*  VMware tools support (fair)
  -  Don Slutz

*  pvUSB support in libxl (fair)
  -  Chunyan Liu

*  vNUMA in Xen toolstack (good)
   v7 posted
  -  Wei Liu

*  Blktap2 support (none)
  -  George Dunlap

*  pvscsi in libxl (fair)
  -  Juergen Gross and Olaf

*  COarse-grain LOck-stepping Virtual Machines in Xen (fair)
   RFC v3 posted, based on remus-v19
  -  Wen Congyang
  -  Gui Jianfeng
  -  Yang Hongyang
  -  Dong, Eddie

*  New Migration (v2). (good)
   v7 (libxc and libxl)
   git://xenbits.xen.org/people/andrewcoop/xen.git
   Seems that it might need to slip or we run v1 alongside v2.
  -  Andrew Cooper & David Vrabel

*  libxl migrationv2 patches. (none)
  -  Andrew Cooper & David Vrabel

*  tmem migrationv2 patches. (none)
  -  Bob Liu & Andrew Cooper & David Vrabel

*  Remus using migration-v2 (fair)
   RFC posted - depends on v6 of 'New Migration'
  -  Yang Hongyang

*  snapshot API extension (checkpointing disk) (ok)
   v5
  -  Chunyan Liu

*  Rearrange and cleanup installation destination directories (/var -> 
var/lib/xen) (fair)
  -  Daniel Kiper

*  libxl/xl - xm compatibility mode for mem-max and mem-set; (ok)
  -  Daniel Kiper

*  xl list --long (and some related xl commands) have some bugs (none)
  -  Zhigang Wang

*  cpuid leveling (none)
   
http://xenbits.xen.org/people/andrewcoop/feature-levelling/feature-levelling-D.pdf
  -  Andrew Cooper

*  live migration knobs, there is no suitable code yet, just ideas (none)
    http://lists.xenproject.org/archives/html/xen-devel/2014-03/msg00785.html
  -  Olaf Hering

*  xl does not handle migrate interruption gracefully (none)
   If you start a localhost migrate, and press "Ctrl-C" in the middle, you get 
two hung domains
  -  Ian Jackson

*  IO-NUMA - hwloc and xl (none)
   Andrew Cooper had an RFC patch for hwloc
   add restrictions  as to which devices cannot safely/functionally be split 
apart.
  -  Boris Ostrovsky

*  HVM guest NUMA (SRAT) (good)
   See vNUMA in Xen toolstack
  -  Wei Liu

*  PVH - Migration of PVH DomUs. (none)
   Depends on migration2 code
  -  Roger Pau Monné

*  PVH - Migration of guests from a PVH dom0  (none)
   Depends on migration2 code
  -  Roger Pau Monné

*  ucode=scan also scan compressed initramfs (none)
  -  Konrad Rzeszutek Wilk

*  adjust log buffer based on memmap size (none)
  -  Konrad Rzeszutek Wilk

*  Regression in PCI passthrough of INTx legacy devices can trigger list 
corruption (good)
   Sander reported it. Two different types of patches available.
  -  Konrad Rzeszutek Wilk

*  ARM - MiniOS (fair)
   v7 posted
  -  Thomas Leonard

== Deferred after 4.6 ==

*  Linux ARM - Device assigment usage in Linux code (arch/arm) non-PCI (none)
   Depends on Xen pieces which are on the Xen 4.6 list.
  -  Julien Grall

== Completed ==

*  Splitting off mini-os (done)
  -  Wei Liu

*  OVMF on ARM (done)
   v4 posted
  -  Ard Biesheuvel

*  Update Xen tree to use upstream OVMF (done)
  -  Anthony PERARD

*  Enable vTPM subsystem on TPM 2.0 (done)
  -  Xu, Quan

*  SPICE support improvement (done)
  -  Fabio Fantoni


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
http://lists.xen.org/xen-devel