Re: [Xen-devel] Xen 4.6 Development Update (two months reminder)

["Chun Yan Liu" <cyliu@xxxxxxxx>]

>>> On 3/12/2015 at 06:21 PM, in message
<E1YW0FY-0002P7-DJ@xxxxxxxxxxxxxxxxxxxxxxxx>, <wei.liu2@xxxxxxxxxx> wrote: 
> Hi all 
>  
> We are now two months into 4.6 development window. This is an email to keep 
> track of all the patch series I gathered. It is by no means complete and /  
> or 
> acurate. Feel free to reply this email with new projects or correct my 
> misunderstanding. 
>  
> = Timeline = 
>  
> We are planning on a 9-month release cycle, but we could also release a bit 
> earlier if everything goes well (no blocker, no critical bug). 
>  
> * Development start: 6 Jan 2015 
> <=== We are here ===> 
> * Feature Freeze: 10 Jul 2015 
> * RCs: TBD 
> * Release Date: 9 Oct 2015 (could release earlier) 
>  
> The RCs and release will of course depend on stability and bugs, and 
> will therefore be fairly unpredictable. 
>  
> Bug-fixes, if Acked-by by maintainer, can go anytime before the First 
> RC. Later on we will need to figure out the risk of regression/reward 
> to eliminate the possiblity of a bug introducing another bug. 
>  
> = Prognosis = 
>  
> The states are: none -> fair -> ok -> good -> done 
>  
> none - nothing yet 
> fair - still working on it, patches are prototypes or RFC 
> ok   - patches posted, acting on review 
> good - some last minute pieces 
> done - all done, might have bugs 
>  
> = Bug Fixes = 
>  
> Bug fixes can be checked in without a freeze exception throughout the 
> freeze, unless the maintainer thinks they are particularly high 
> risk.  In later RC's, we may even begin rejecting bug fixes if the 
> broken functionality is small and the risk to other functionality is 
> high. 
>  
> Document changes can go in anytime if the maintainer is OK with it. 
>  
> These are guidelines and principles to give you an idea where we're coming 
> from; if you think there's a good reason why making an exception for you  
> will 
> help us make Xen better than not doing so, feel free to make your case. 
>  
> == Linux ==  
>  
> *  PV domain with memory > 512GB (fair) 
>   -  Juergen Gross 
>  
> *  Block driver multiqueue support (fair) 
>    RFC posted 
>   -  Bob Liu 
>  
> *  Block driver multi-page ring support (fair) 
>   -  Bob Liu 
>  
> *  Preemptable privcmd hypercalls (good) 
>    v5 posted 
>   -  David Vrabel 
>  
> *  Linux ARM - Device assigment (PCI) (none) 
>    Depends on Xen pieces which are on the Xen 4.6 list. 
>   -  Manish Jaggi 
>  
> *  pvUSB in Linux (fronted and backend) (Fair) 
>   -  Juergen Gross 
>  
> *  VPMU - 'perf' support in Linux (ok) 
>    Depends on Xen patches 
>    Acked by David Vrabel 
>   -  Boris Ostrovsky 
>  
> *  vNUMA in Linux (ok) 
>    v6 posted 
>    git://gitorious.org/vnuma/linux_vnuma.git 
>   -  Elena Ufimtseva 
>  
> *  vsyscall in Linux (fair) 
>   -  Konrad Rzeszutek Wilk 
>  
> *  COLO Agent in Linux (fair) 
>   -  Gui Jianfeng 
>   -  Yang Hongyang 
>   -  Dong, Eddie 
>  
> *  ARM64 - support 64K guest (none) 
>   -  Julien Grall 
>  
> == OpenStack ==  
>  
> *  setup CI loop for OpenStack (fair) 
>   -  Anthony Perard 
>  
> == FreeBSD ==  
>  
> *  PVH FreeBSD dom0 (ok) 
>    FreeBSD 11 goal. Toolstack side done in Xen 4.5 
>   -  Roger Pau Monnà 
>  
> == Other OSes (MiniOS, QNX) ==  
>  
> *  PV drivers for automotive kernels (fair) 
>   -  Artem Mygaiev 
>  
> *  mini-os: xenbus changes for rump kernels (ok) 
>    git://xenbits.xen.org/people/iwj/rumpuser-xen.git 
>    branch: base.dev-xen-xenbus.v1..dev-xen-xenbus.v1 
>    v2 posted 
>   -  Ian Jackson 
>  
> == GRUB2 ==  
>  
> *  GRUB2 multiboot2 (fair) 
>   -  Daniel Kiper 
>  
> == OSSTEST ==  
>  
> *  OSSTest: studom test case (none) 
>   -  Wei Liu 
>  
> *  OSSTest: libvirt migration (fair) 
>   -  Wei Liu 
>  
> *  OSSTest: upgrade to Debian Jessie (none) 
>   -  Wei Liu 
>  
> *  OSSTest: performance test (fair) 
>   -  Dario Faggioli 
>  
> *  CPU pool test case (fair) 
>   -  Dario Faggioli 
>  
> *  Add a FreeBSD host (fair) 
>   -  Roger Pau Monnà 
>  
> *  Nested virt test case (fair) 
>   -  Robert Hu 
>  
> == QEMU ==  
>  
> *  Linux-based QEMU upstream stub domain (fair) 
>    RFC posted 
>   -  Eric Shelton 
>  
> *  Using qemu-upstream in a stubdomain (none) 
>    Will use rump kernels. 
>   -  Wei Liu 
>  
> *  AMD Radeon PCI GPU passthrough (none) 
>    Focusing on Xen 4.2 and qemu-traditional 
>   -  Kelly Zytaruk 
>  
> *  Intel IGD PCI GPU passthrough (ok) 
>    v5 posted 
>   -  Chen, Tiejun 
>  
> == Up for grabs ==  
>  
> *  save/restore/migrate PVHVM guest with > 32 vcpus 
>    http://lists.xen.org/archives/html/xen-devel/2015-02/msg00244.html 
>  
> *  PoD fixes 
>    if you boot with memory <= maxmem we have a size estimation bug 
>  
> *  TLB flushing without locks in Xen 
>  
> *  xl does not support specifying virtual function for passthrough device 
>    http://bugs.xenproject.org/xen/bug/22 
>  
> *  PCI hole resize support hvmloader/qemu-traditional/qemu-upstream with  
> PCI/GPU passthrough 
>    http://bugs.xenproject.org/xen/bug/28 
>  
> *  libx{c,l} error handling cleanup  
>  
> *  Adding missing 'xend' features in libxl 
>    Need to define what is missing 
>  
> *  xl list -l doesn't contain tty console port 
>  
> *  xl: passing more defaults in configuration in xl.conf 
>    There are a number of options for which it might be useful to pass a  
> default in xl.conf.  For example, if we could have a default "backend"  
> parameter for vifs, then it would be easy to switch back and forth between a  
> backend in a driver domain and a backend in dom0. 
>  
> *  PVH - PVH working with shadow. 
>    Based on Tim's work 
>  
> *  PVH - PCI passthrough for DomU. 
>  
> *  AMD performance regressions 
>  
> *  Performance due to hypercall preemption. More preemptions - slower. (none) 
>  
> == Hypervisor ==  
>  
> *  Alternate p2m: support multiple copies of host p2m (ok) 
>   -  Ed White 
>  
> *  Improve RTDS scheduler (none) 
>   -  Dagaen Golomb, Meng Xu 
>  
> *  Repurpose SEDF Scheduler for Real-time (fair) 
>    RFC patch posted (v2) 
>   -  Joshua Whitehead, Robert VanVossen 
>  
> *  Credit2: introduce per-vcpu hard and soft affinity (fair) 
>   -  Justin T. Weaver 
>  
> *  sndif: add API for para-virtual sound (fair) 
>    v7 posted 
>   -  Oleksandr Dmytryshyn 
>  
> *  gnttab: improve scalability (good) 
>    v5 posted 
>   -  Christoph Egger 
>  
> *  Display IO topology when PXM data is available (good) 
>    v3 posted 
>   -  Boris Ostrovsky 
>  
> *  Clean-up of mem-event subsystem (good) 
>    v5 posted 
>   -  Tamas K Lengyel 
>  
> *  Xen Boot Information (xbi) (ok) 
>    Dependency for GRUB2 + EFI work 
>    http://lists.xen.org/archives/html/xen-devel/2014-10/msg02068.html 
>    v4, No go for full patchset. Only some of the patches. 
>    No ARM EFI hardware (yet) available to test them. 
>   -  Daniel Kiper 
>  
> *  Xen multiboot2-EFI support (fair) 
>    Needed for GrUB2 
>    Depends on Xen Boot info (rework multiboot and other structs) 
>    See http://lists.xen.org/archives/html/xen-devel/2013-05/msg02281.html 
>    RFC posted 
>   -  Daniel Kiper 
>  
> *  Default to credit2 (none) 
>    cpu pinning, numa affinity and cpu reservation 
>   -  George Dunlap 
>  
> *  Convert tasklet to per-cpu tasklets (fair) 
>    RFC posted 
>   -  Konrad Rzeszutek Wilk 
>  
> *  Further tmem cleanups/fixes (16TB etc) (fair) 
>   -  Bob Liu 
>  
> *  1TB slow destruction (ok) 
>   -  Bob Liu 
>  
> === Hypervisor X86 ===  
>  
> *  VT-d Posted-interrupt (PI) (none) 
>   -  Wu, Feng 
>  
> *  amd_ucode cleanups, verify patch size(enhancement) (mostly in master  
> except one patch) 
>  
> *  Data breakpoint Extension support (new-feat) (in master) 
>  
> *  Feature masking MSR support (enhancement) (in master) 
>  
> *  Support BRCM TruManage chip (Serial over LAN support) (new-feat) (in  
> master) 
>  
> *  fix vmce_amd* functions, unify mce_amd mcheck initialization  
> (fixes/cleanups) 
>  
> *  multiple AMD container files appended together in initrd (early  
> initramfs) 
>   -  Aravind and Suravee 
>  
> *  HT enabled with credit has 7.9 per perf drop. (none) 
>    kernbench demonstrated it 
>    http://www.gossamer-threads.com/lists/xen/devel/339409 
>    This has existed since credit1 introduction. 
>   -  Dario Faggioli 
>  
> *  Support controlling the max C-state sub-state (fair) 
>    v3 posted 
>    Hadn't see the patch reposted. 
>   -  Ross Lagerwall 
>  
> *  IOMMU ABI for guests to map their DMA regions (fair) 
>   -  Malcolm Crossley 
>  
> *  dirty vram / IOMMU bug (fair) 
>    http://bugs.xenproject.org/xen/bug/38 
>   -  Zhang, Yang Z 
>  
> *  Xen HPET interrupt fixes (fair) 
>    behind migration v2 
>   -  Andrew Cooper 
>  
> *  Intel PML (Page Modification Logging) for Xen (none) 
>    design doc posted 
>   -  Kai Huang 
>  
> *  Intel memory bandwidth monitoring for VMs (fair) 
>    v9 posted 
>   -  Chao Peng  
>  
> *  xc_reserved_device_memory_map in hvmloader to avoid conflicting MMIO/RAM  
> (good) 
>    v7 posted. 
>    Treating pieces as bug-fixes only. 
>    Low likehood of making it in Xen 4.5. Deferred 
>   -  Tiejun Chen 
>  
> *  VPMU - 'perf' support in Xen (good) 
>    v14 posted 
>    Need reviews/final ack. 
>   -  Boris Ostrovsky 
>  
> *  PVH - AMD hardware support. (fair) 
>    RFC posted 
>   -  Elena Ufimtseva 
>  
> *  PVH dom0 (fair) 
>    RFC posted 
>   -  Elena Ufimtseva 
>  
> *  extending mem_access support to PV domain (fair) 
>    RFC v2 
>   -  Aravindh Puthiyaparambil (aravindp) 
>  
> === Hypervisor ARM ===  
>  
> *  Add support for Xilinx ZynqMP SoC (fair) 
>   -  Edgar E. Iglesias 
>  
> *  ITS support (fair ) 
>   -  Vijaya Kumar K 
>  
> *  Add support for Huawei hip04-d01 platform (ok) 
>   -  Frediano Ziglio 
>  
> *  Thunder X platform support (ok) 
>   -  Vijay Kilari 
>  
> *  Add ACPI support for arm64 on Xen (fair) 
>    RFC posted 
>   -  Parth Dixit 
>  
> *  ARM: reenable support 32-bit userspace running in 64-bit guest (good) 
>    v2 posted 
>   -  Ian Campbell 
>  
> *  ARM remote processor iommu module (GPUs + IPUs) (fair) 
>    v3 posted 
>   -  Andrii Tseglytskyi 
>  
> *  ARM VM save/restore/live migration (none) 
>    Need to rebased against migrationv2 - no code posted. 
>   -  None 
>  
> *  ARM GICv2m support (none) 
>   -  Suravee Suthikulanit 
>  
> *  ARM - SMMU resync of Linux's one (ok) 
>   -  Julien Grall 
>  
> *  ARM - passthrough of non-PCI (ok) 
>   -  Julien Grall 
>  
> *  ARM  PCI passthrough (none) 
>   -  Manish Jaggi 
>   -  Vijay Kilari 
>  
> == Xen toolstack ==  
>  
> *  toolstack-based approach to pvhvm guest kexec (fair) 
>    also contains hypervisor side change 
>   -  Vitaly Kuznetsov 
>  
> *  libxl: add qxl vga interface support for upstream qemu (fair) 
>   -  Fabio Fantoni 
>  
> *  Toolstack-based approach to pvhvm guest kexec (ok) 
>    v4 posted 
>   -  Vitaly Kuznetsov 
>  
> *  libxl: cancelling asynchronous operations (fair) 
>    RFC posted 
>   -  Ian Jackson 
>  
> *  VMware tools support (fair) 
>   -  Don Slutz 
>  
> *  pvUSB support in libxl (fair) 
>   -  Chunyan Liu 
>  
> *  vNUMA in Xen toolstack (good) 
>    v7 posted 
>   -  Wei Liu 
>  
> *  Blktap2 support (none) 
>   -  George Dunlap 
>  
> *  pvscsi in libxl (fair) 
>   -  Juergen Gross and Olaf 
>  
> *  COarse-grain LOck-stepping Virtual Machines in Xen (fair) 
>    RFC v3 posted, based on remus-v19 
>   -  Wen Congyang 
>   -  Gui Jianfeng 
>   -  Yang Hongyang 
>   -  Dong, Eddie 
>  
> *  New Migration (v2). (good) 
>    v7 (libxc and libxl) 
>    git://xenbits.xen.org/people/andrewcoop/xen.git 
>    Seems that it might need to slip or we run v1 alongside v2. 
>   -  Andrew Cooper & David Vrabel 
>  
> *  libxl migrationv2 patches. (none) 
>   -  Andrew Cooper & David Vrabel 
>  
> *  tmem migrationv2 patches. (none) 
>   -  Bob Liu & Andrew Cooper & David Vrabel 
>  
> *  Remus using migration-v2 (fair) 
>    RFC posted - depends on v6 of 'New Migration' 
>   -  Yang Hongyang 
>  
> *  snapshot API extension (checkpointing disk) (ok) 
>    v5 
>   -  Chunyan Liu 

Snapshot design V10 got general agreement among us with a few small changes.
http://lists.xenproject.org/archives/html/xen-devel/2015-01/msg03071.html

Coding work is almost completed based on V10 design. With full testing locally,
it should be posted soon. And V10 design with trival updates will be posted at
the same time. So the status should be fair (?)

- Chunyan


>  
> *  Rearrange and cleanup installation destination directories (/var ->  
> var/lib/xen) (fair) 
>   -  Daniel Kiper 
>  
> *  libxl/xl - xm compatibility mode for mem-max and mem-set; (ok) 
>   -  Daniel Kiper 
>  
> *  xl list --long (and some related xl commands) have some bugs (none) 
>   -  Zhigang Wang 
>  
> *  cpuid leveling (none) 
>     
> http://xenbits.xen.org/people/andrewcoop/feature-levelling/feature-levelling 
> -D.pdf 
>   -  Andrew Cooper 
>  
> *  live migration knobs, there is no suitable code yet, just ideas (none) 
>     http://lists.xenproject.org/archives/html/xen-devel/2014-03/msg00785.html 
>   -  Olaf Hering 
>  
> *  xl does not handle migrate interruption gracefully (none) 
>    If you start a localhost migrate, and press "Ctrl-C" in the middle, you  
> get two hung domains 
>   -  Ian Jackson 
>  
> *  IO-NUMA - hwloc and xl (none) 
>    Andrew Cooper had an RFC patch for hwloc 
>    add restrictions  as to which devices cannot safely/functionally be split  
> apart. 
>   -  Boris Ostrovsky 
>  
> *  HVM guest NUMA (SRAT) (good) 
>    See vNUMA in Xen toolstack 
>   -  Wei Liu 
>  
> *  PVH - Migration of PVH DomUs. (none) 
>    Depends on migration2 code 
>   -  Roger Pau Monnà 
>  
> *  PVH - Migration of guests from a PVH dom0  (none) 
>    Depends on migration2 code 
>   -  Roger Pau Monnà 
>  
> *  ucode=scan also scan compressed initramfs (none) 
>   -  Konrad Rzeszutek Wilk 
>  
> *  adjust log buffer based on memmap size (none) 
>   -  Konrad Rzeszutek Wilk 
>  
> *  Regression in PCI passthrough of INTx legacy devices can trigger list  
> corruption (good) 
>    Sander reported it. Two different types of patches available. 
>   -  Konrad Rzeszutek Wilk 
>  
> *  ARM - MiniOS (fair) 
>    v7 posted 
>   -  Thomas Leonard 
>  
> == Deferred after 4.6 ==  
>  
> *  Linux ARM - Device assigment usage in Linux code (arch/arm) non-PCI (none) 
>    Depends on Xen pieces which are on the Xen 4.6 list. 
>   -  Julien Grall 
>  
> == Completed ==  
>  
> *  Splitting off mini-os (done) 
>   -  Wei Liu 
>  
> *  OVMF on ARM (done) 
>    v4 posted 
>   -  Ard Biesheuvel 
>  
> *  Update Xen tree to use upstream OVMF (done) 
>   -  Anthony PERARD 
>  
> *  Enable vTPM subsystem on TPM 2.0 (done) 
>   -  Xu, Quan 
>  
> *  SPICE support improvement (done) 
>   -  Fabio Fantoni 
>  
>  
>  


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
http://lists.xen.org/xen-devel