kernelci.org The upstream kernel validation project Who is this - - PowerPoint PPT Presentation

kernelci org
SMART_READER_LITE
LIVE PREVIEW

kernelci.org The upstream kernel validation project Who is this - - PowerPoint PPT Presentation

kernelci.org The upstream kernel validation project Who is this guy? Tyler Baker Director of Engineering at Linaro Automation and CI Maintainer of Linaros Automated Validation Architecture (LAVA) Upstream Linux Kernel


slide-1
SLIDE 1

kernelci.org

The upstream kernel validation project

slide-2
SLIDE 2

Who is this guy?

  • Tyler Baker
  • Director of Engineering at Linaro

○ Automation and CI

  • Maintainer of Linaro’s Automated Validation

Architecture (LAVA)

  • Upstream Linux Kernel contributor
  • Embedded Software Engineer
slide-3
SLIDE 3

Goals

Build every configuration for each architecture. Boot these configurations. Execute tests on these configurations. Do ALL of this each time a kernel tree changes. Report the results in a sensible way. Profit. #exactsteps

slide-4
SLIDE 4

Wait, but why?

To ensure the hard work being done upstream is gross regression free. In addition, to provide a platform reference for the community.

slide-5
SLIDE 5

Prologue

The ARM SoC maintainers developed scripts to build and boot test various boards for sanity

  • purposes. This work would eventually become

the basis for kernelci.org.

slide-6
SLIDE 6

Current Status

kernelci.org consists of five automated hardware labs distributed all over the world. The hardware ranges from x86 servers to very small embedded platforms. This cluster of labs produce ~450 platform results for each tree.

slide-7
SLIDE 7

0-Day

Does a really good job, it is extremely fast but does have some issues. Source code not available Only x86 VMs Does not publish artifacts

slide-8
SLIDE 8

How is this system different?

kernelci.org is… distributed utilizing real metal

  • pen source

community driven publishing artifacts

slide-9
SLIDE 9

Metrics

403,000 platforms booted 285,040 kernel trees built (arm, arm64, x86) 5,182 test cases executed 43 kernel bugs fixed upstream in 2015

slide-10
SLIDE 10

Lessons Learned

slide-11
SLIDE 11

Enough Talk Already

SHOW ME SOME DEMOS

slide-12
SLIDE 12

FRONTEND DEMO

slide-13
SLIDE 13

EMAIL REPORT DEMO

slide-14
SLIDE 14

LAVA DEMO

slide-15
SLIDE 15

KSELFTEST DEMO

slide-16
SLIDE 16

AUTOMATED BISECTION DEMO

slide-17
SLIDE 17

API DEMO

slide-18
SLIDE 18

Future

Test result reporting and visualization Result deltas Automagic bisection Toolchain testing Moar hardware

slide-19
SLIDE 19

Big Data

We have been archiving all data since v3.12. Elastic Search? Trends?

slide-20
SLIDE 20

What is missing?

slide-21
SLIDE 21

How can I halp?

Donations!

  • Upstream supported platforms
  • Build machines

Debug!

  • Report issues
  • Confirm fixes
  • Send patches
slide-22
SLIDE 22

Get involved

#kernelci on freenode https://github.com/kernelci kernel-build-reports mailing list http://wiki.kernelci.org http://api.kernelci.org info@kernelci.org

slide-23
SLIDE 23

Thanks!

Any Questions?