CernVM[FS] and CMS Open Data Pilot Jakob Blomer, Gerardo Ganis, Adam - - PowerPoint PPT Presentation

cernvm fs and cms open data pilot
SMART_READER_LITE
LIVE PREVIEW

CernVM[FS] and CMS Open Data Pilot Jakob Blomer, Gerardo Ganis, Adam - - PowerPoint PPT Presentation

CernVM[FS] and CMS Open Data Pilot Jakob Blomer, Gerardo Ganis, Adam Huffman, Kati Lassila-Perini, Tom McCauley, Andreas Pfeiffer DPHEP Implementation Board 11. March 2014 1 / 6 CMS Open Data Pilot Purpose: Provide an easy-to-use virtual


slide-1
SLIDE 1

CernVM[FS] and CMS Open Data Pilot

Jakob Blomer, Gerardo Ganis, Adam Huffman, Kati Lassila-Perini, Tom McCauley, Andreas Pfeiffer DPHEP Implementation Board

  • 11. March 2014

1 / 6

slide-2
SLIDE 2

CMS Open Data Pilot

Purpose: Provide an easy-to-use virtual machine of CMS computing environment for CMS Open Data Data:

  • Frozen data set
  • Remote data access

Initially through XrootD, eventually DPHEP portal Software:

  • Frozen CMS software framework (CMSSW.4.2.8.patch7)
  • Complete analysis environment required (compile + run)
  • Requires Scientific Linux 5 compatible virtual machine

Virtual machine, user interface:

  • Graphical environment, easy-to-install and easy-to-use
  • Deviate as little as possible from production CernVM

2 / 6

slide-3
SLIDE 3

Scientific Linux 5 on µCernVM

Note: CernVM 2.X is based on SL5 but this technology reaches end-of-life this year due to vendor lock-in Like SL4 exercise: SL5 template installation on CernVM-FS

JIRA CVM-586

initrd: CernVM-FS + µContextualization AUFS R/W Overlay OS + Extras Kernel

ISO Image Scratch HD CernVM Online HTTP (Amazon EC2)

Fuse AUFS cms.cern.ch SLC5

Prototype ≈1 day of work, estimate for shippable state ≈1-2 weeks

3 / 6

slide-4
SLIDE 4

Deployment I

  • VirtualBox is a free and open source hypervisor for

Windows, Linux, Mac

4 / 6

slide-5
SLIDE 5

Deployment I

  • VirtualBox is a free and open source hypervisor for

Windows, Linux, Mac Deployment option 1: WebAPI (I. Charalampidis, CERN theory group)

4 / 6

slide-6
SLIDE 6

Deployment I

  • VirtualBox is a free and open source hypervisor for

Windows, Linux, Mac Deployment option 1: WebAPI (I. Charalampidis, CERN theory group)

4 / 6

slide-7
SLIDE 7

Deployment I

  • VirtualBox is a free and open source hypervisor for

Windows, Linux, Mac Deployment option 1: WebAPI (I. Charalampidis, CERN theory group)

4 / 6

slide-8
SLIDE 8

Deployment II

Deployment option 2: as OVF/OVA bundle1

  • open specification for bundling VMs, stable since 2009
  • OVA: tarball containing hard disk image and an XML specification

1Open Virtualization Format / Open Virtual Appliance, http://www.dmtf.org/standards/ovf 5 / 6

slide-9
SLIDE 9

Deployment II

Deployment option 2: as OVF/OVA bundle1

  • open specification for bundling VMs, stable since 2009
  • OVA: tarball containing hard disk image and an XML specification
  • OVA packaging added to CernVM build process

JIRA CVM-585 1Open Virtualization Format / Open Virtual Appliance, http://www.dmtf.org/standards/ovf 5 / 6

slide-10
SLIDE 10

Deployment II

Deployment option 2: as OVF/OVA bundle1

  • open specification for bundling VMs, stable since 2009
  • OVA: tarball containing hard disk image and an XML specification
  • OVA packaging added to CernVM build process

JIRA CVM-585 1Open Virtualization Format / Open Virtual Appliance, http://www.dmtf.org/standards/ovf 5 / 6

slide-11
SLIDE 11

Deployment II

Deployment option 2: as OVF/OVA bundle1

  • open specification for bundling VMs, stable since 2009
  • OVA: tarball containing hard disk image and an XML specification
  • OVA packaging added to CernVM build process

JIRA CVM-585 1Open Virtualization Format / Open Virtual Appliance, http://www.dmtf.org/standards/ovf 5 / 6

slide-12
SLIDE 12

Fine-tuning, first test, and open issues

Fine-tuning:

  • Fine-tuning through contextualization:

preset environment variables, auto-login

JIRA CVM-587 , “getting

started” documentation, . . .

  • Ensure that data access tools are disentangled from grid dependencies

First test: produce event display format from the AOD files

JIRA CVM-588

Open issues:

  • SL5 support ends March 2017; can we provide an outdated operating

system to users outside the collaboration?

  • Should we pre-load CernVM-FS caches in order to speed up the

initial VM boot?

6 / 6