Xen 4.6 and beyond Wei Liu Seattle August 17-18, 2015 Agenda Xen - - PowerPoint PPT Presentation

Xen 4.6 and beyond

Wei Liu Seattle – August 17-18, 2015

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Agenda

◮ Xen 4.6 timeline ◮ Development update ◮ Xen 4.6 retrospective

Seattle – August 17-18, 2015 Xen 4.6 and beyond 2 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Xen 4.6 timeline

◮ 9 months cycle

◮ Development start: 6 Jan 2015 ◮ Freeze: 10 Jul 2015 ◮ RC1: 12 Aug 2015 ◮ RCx: TBD ◮ Release date: 9 Oct 2015 (could release earlier)

◮ Main goal is to release on time ◮ Extra bonus if it is released earlier than scheduled

Seattle – August 17-18, 2015 Xen 4.6 and beyond 3 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Development update

◮ Xen code base

◮ Hypervisor: general, x86 and ARM ◮ Toolstack ◮ Others

◮ OpenStack ◮ Test lab ◮ Linux ◮ FreeBSD

Seattle – August 17-18, 2015 Xen 4.6 and beyond 4 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Development update: Hypervisor general

◮ VM event ◮ Improved XSM support ◮ VTPM 2.0 ◮ Grant table scalibility improvement ◮ Use ticket lock to improve fairness ◮ Removal of SEDF

Seattle – August 17-18, 2015 Xen 4.6 and beyond 5 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Development update: Hypervisor x86

◮ Intel Alternate P2M ◮ Intel Page Modification Logging ◮ Intel Cache Allocation Technology ◮ Intel Memory Bandwidth Monitoring ◮ Intel Reserve Memory Region Reporting ◮ Virtual Performance Monitoring Unit ◮ Virtual NUMA for HVM guest

Seattle – August 17-18, 2015 Xen 4.6 and beyond 6 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Development update: Hypervisor ARM

◮ Passthrough for non-PCI devices ◮ ARM GICv2 on GICv3 support ◮ 32 bit userspace in 64 bit guest support ◮ OVMF for ARM ◮ New platform support

◮ Renesas R-Car Gen2 ◮ Thunder X ◮ Huawei hip04-d01 ◮ Xilinx ZynqMP SoC Seattle – August 17-18, 2015 Xen 4.6 and beyond 7 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Development update: Toolstack

◮ Libxc / libxl migration v2 ◮ Remus based on migration v2 ◮ Libxl async operation cancellation support ◮ Improved SPICE/QXL support ◮ Guest AHCI disk controller support ◮ Host I/O topology querying interface ◮ Import xenanalyze in-tree ◮ 64K page ARM guest support

Seattle – August 17-18, 2015 Xen 4.6 and beyond 8 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Development update: Others

◮ Mini-OS moved to separate tree ◮ Mini-OS ARM support ◮ Project Raisin

Seattle – August 17-18, 2015 Xen 4.6 and beyond 9 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Development update: upcoming

◮ xSplice (hypervisor hot-patching) ◮ Intel GVT-g (graphics passthrough) ◮ Intel Posted-interrupt support ◮ Intel P-state driver support ◮ PV / HVM USB device passthrough ◮ COLO based on migration v2 ◮ Toolstack-based soft-reset (typically used in kexec) ◮ ACPI for ARM64 ◮ PCI passthrough for ARM ◮ Event driven RTDS ◮ XSRestrict QEMU / run QEMU with non-root user /

upstream QEMU stubdomain

◮ and more ...

Seattle – August 17-18, 2015 Xen 4.6 and beyond 10 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Development update: 4.6 diffstat

◮ Added lines: +91155 ◮ Removed lines: -85314 ◮ Lines of changes: +5841

Seattle – August 17-18, 2015 Xen 4.6 and beyond 11 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Development update: Test lab

◮ New community test lab is live ◮ Increased testing capacity (24 hosts and growing) ◮ More test cases

◮ Stubdomain (done) ◮ Libvirt (done) ◮ OVMF (done) ◮ Distro tests ◮ Devstack ◮ Nested HVM ◮ Raisin ◮ Performance tests ◮ FreeBSD Dom0 Seattle – August 17-18, 2015 Xen 4.6 and beyond 12 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Development update: OpenStack

◮ Xen Project CI loop up and running ◮ Xen moved from group C to group B

Seattle – August 17-18, 2015 Xen 4.6 and beyond 13 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Development update: Linux 3.18 - 4.3

3.18

◮ Xen SCSI frontend and backend

3.19

◮ P2M changed from tree to an array (perf improvement)

4.0

◮ Preempt support for privcmd ◮ PAT runtime support ◮ Xen PAT support (Write Combine for GPUs/InfiniBand works)

Seattle – August 17-18, 2015 Xen 4.6 and beyond 14 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Development update: Linux 3.18 - 4.3 (cont.)

4.1

◮ Xen PV APIC driver ◮ Performance improvement in mmap call ◮ Update hypercall symbols so they show up properly under perf

4.2

◮ Xen blkfront multipage ring support ◮ Xen blkfront !persistent support fix ◮ Cleanups for 64KB page support on ARM

4.3

◮ Xen blkfront multiqueue support ◮ P2M in PV guest can address 512GB or more ◮ VPMU kernel support, perf tool to be done ◮ 64KB page support for ARM

Seattle – August 17-18, 2015 Xen 4.6 and beyond 15 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Development update: FreeBSD

◮ Experimental PVH Dom0/DomU support ◮ Removal of classic i386 PV port (John Baldwin) ◮ Indirect descriptor support for blkfront (Colin Percival) ◮ Removal of broken FreeBSD specific blkfront/back extensions ◮ ARM32 and ARM 64 guest support, under development

Seattle – August 17-18, 2015 Xen 4.6 and beyond 16 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Xen 4.6 Retrospective: observations

◮ Vendors use upstream Xen to ship features to users

◮ Fully appreciate the impact of missing a release ◮ Bottom line: make decision based on technical merits

◮ Hard to upstream a feature, build up tensions and

frustratsions

◮ Need many iterations ◮ Are maintainers pickier than before? ◮ Submitters don’t address all comments? ◮ Long response time ◮ Bottleneck in review capability ◮ Encourage more people to review

◮ Hard freeze surprised contributors

◮ Could do better in announcement emails, wiki page. Seattle – August 17-18, 2015 Xen 4.6 and beyond 17 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Xen 4.6 Retrospective: ideas for improvement

◮ Suggestions already been made (publicly or privately)

◮ Reopen tree earlier ◮ Shorten release cycle ◮ Pull together better road map page ◮ Fixed freeze dates

◮ Join the discussion on xen-devel or send Lars / me emails

Seattle – August 17-18, 2015 Xen 4.6 and beyond 18 / 19

Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective

Thank you!

Seattle – August 17-18, 2015 Xen 4.6 and beyond 19 / 19