CernVM[FS] and CMS Open Data Pilot Jakob Blomer, Gerardo Ganis, Adam - - PowerPoint PPT Presentation

▶

Jul 05, 2023 156 likes •283 views

CernVM[FS] and CMS Open Data Pilot Jakob Blomer, Gerardo Ganis, Adam Huffman, Kati Lassila-Perini, Tom McCauley, Andreas Pfeiffer DPHEP Implementation Board 11. March 2014 1 / 6 CMS Open Data Pilot Purpose: Provide an easy-to-use virtual

SLIDE 1

CernVM[FS] and CMS Open Data Pilot

Jakob Blomer, Gerardo Ganis, Adam Huffman, Kati Lassila-Perini, Tom McCauley, Andreas Pfeiffer DPHEP Implementation Board

11. March 2014

1 / 6

SLIDE 2

CMS Open Data Pilot

Purpose: Provide an easy-to-use virtual machine of CMS computing environment for CMS Open Data Data:

Frozen data set
Remote data access

Initially through XrootD, eventually DPHEP portal Software:

Frozen CMS software framework (CMSSW.4.2.8.patch7)
Complete analysis environment required (compile + run)
Requires Scientific Linux 5 compatible virtual machine

Virtual machine, user interface:

Graphical environment, easy-to-install and easy-to-use
Deviate as little as possible from production CernVM

2 / 6

SLIDE 3

Scientific Linux 5 on µCernVM

Note: CernVM 2.X is based on SL5 but this technology reaches end-of-life this year due to vendor lock-in Like SL4 exercise: SL5 template installation on CernVM-FS

JIRA CVM-586

initrd: CernVM-FS + µContextualization AUFS R/W Overlay OS + Extras Kernel

ISO Image Scratch HD CernVM Online HTTP (Amazon EC2)

Fuse AUFS cms.cern.ch SLC5

Prototype ≈1 day of work, estimate for shippable state ≈1-2 weeks

3 / 6

SLIDE 4

Deployment I

VirtualBox is a free and open source hypervisor for

Windows, Linux, Mac

4 / 6

SLIDE 5

Deployment I

VirtualBox is a free and open source hypervisor for

Windows, Linux, Mac Deployment option 1: WebAPI (I. Charalampidis, CERN theory group)

4 / 6

SLIDE 6

Deployment I

VirtualBox is a free and open source hypervisor for

Windows, Linux, Mac Deployment option 1: WebAPI (I. Charalampidis, CERN theory group)

4 / 6

SLIDE 7

Deployment I

VirtualBox is a free and open source hypervisor for

Windows, Linux, Mac Deployment option 1: WebAPI (I. Charalampidis, CERN theory group)

4 / 6

SLIDE 8

Deployment II

Deployment option 2: as OVF/OVA bundle1

open specification for bundling VMs, stable since 2009
OVA: tarball containing hard disk image and an XML specification

1Open Virtualization Format / Open Virtual Appliance, http://www.dmtf.org/standards/ovf 5 / 6

SLIDE 9

Deployment II

Deployment option 2: as OVF/OVA bundle1

open specification for bundling VMs, stable since 2009
OVA: tarball containing hard disk image and an XML specification
OVA packaging added to CernVM build process

JIRA CVM-585 1Open Virtualization Format / Open Virtual Appliance, http://www.dmtf.org/standards/ovf 5 / 6

SLIDE 10

Deployment II

Deployment option 2: as OVF/OVA bundle1

open specification for bundling VMs, stable since 2009
OVA: tarball containing hard disk image and an XML specification
OVA packaging added to CernVM build process

JIRA CVM-585 1Open Virtualization Format / Open Virtual Appliance, http://www.dmtf.org/standards/ovf 5 / 6

SLIDE 11

Deployment II

Deployment option 2: as OVF/OVA bundle1

open specification for bundling VMs, stable since 2009
OVA: tarball containing hard disk image and an XML specification
OVA packaging added to CernVM build process

JIRA CVM-585 1Open Virtualization Format / Open Virtual Appliance, http://www.dmtf.org/standards/ovf 5 / 6

SLIDE 12

Fine-tuning, first test, and open issues

Fine-tuning:

Fine-tuning through contextualization:

preset environment variables, auto-login

JIRA CVM-587 , “getting

started” documentation, . . .

Ensure that data access tools are disentangled from grid dependencies

First test: produce event display format from the AOD files

JIRA CVM-588

Open issues:

SL5 support ends March 2017; can we provide an outdated operating

system to users outside the collaboration?

Should we pre-load CernVM-FS caches in order to speed up the

initial VM boot?

6 / 6