How to join XrootD Federations with dCache Plugins Karsten Schwank - - PowerPoint PPT Presentation

▶
how to join xrootd federations with dcache plugins
SMART_READER_LITE
LIVE PREVIEW

How to join XrootD Federations with dCache Plugins Karsten Schwank - - PowerPoint PPT Presentation

Feb 16, 2023 45 likes •646 views

How to join XrootD Federations with dCache Plugins Karsten Schwank Berlin, 27.5.2013 dCache Team Contents Join the CMS XrootD Federation (AAA) Join the Atlas XrootD Federation (FAX) Install the Atlas Pool Monitoring Plugin Use the

slide-1
SLIDE 1

dCache Team

How to join XrootD Federations with dCache Plugins

Karsten Schwank

Berlin, 27.5.2013

slide-2
SLIDE 2

Contents

Join the CMS XrootD Federation (AAA) Join the Atlas XrootD Federation (FAX) Install the Atlas Pool Monitoring Plugin Use the Alice-Token Plugin Requirements to use plugins Installing the XrootD-Backport Compiling the plugins (optional)

slide-3
SLIDE 3

Join the CMS XrootD Federation (AAA)

Use the CMS-TFC Plugin

https://twiki.cern.ch/twiki/bin/view/Main/DcacheXrootd

slide-4
SLIDE 4

Join the CMS XrootD Federation

slide-5
SLIDE 5

Join the CMS XrootD Federation

/path/to/lfn ?

slide-6
SLIDE 6

Joining the CMS XrootD Federation

/path/to/lfn ?

slide-7
SLIDE 7

Joining the CMS XrootD Federation

TFC: Storage.xml /path/to/lfn → /mapped/path/to/pfn

slide-8
SLIDE 8

Joining the CMS XrootD Federation

“Got it!”

slide-9
SLIDE 9

Joining the CMS XrootD Federation

Redirect: xrootd.federation.host

slide-10
SLIDE 10

Joining the CMS XrootD Federation

/path/to/lfn ?

slide-11
SLIDE 11

Joining the CMS XrootD Federation

Redirect: door.example.org

slide-12
SLIDE 12

Joining the CMS XrootD Federation

/path/to/lfn ?

slide-13
SLIDE 13

Joining the CMS XrootD Federation

cms-tfc TFC: Storage.xml /path/to/lfn → /mapped/path/to/pfn

slide-14
SLIDE 14

Redirect: pool.example.org:/path/to/mapped/pfn

Joining the CMS XrootD Federation

cms-tfc

slide-15
SLIDE 15

Joining the CMS XrootD Federation

/path/to/mapped/pfn cms-tfc

slide-16
SLIDE 16

Install the CMS-Mapping-Plugin

Build or download

xrootd4j-cms-plugin-1.0-SNAPSHOT.tar.gz

Unpack it in

/usr/local/share/dcache/plugins

zitpcx18435:/usr/local/share/dcache/plugins % ls -l total 7952 drwxr-xr-x 2 root root 4096 May 24 15:57 xrootd4j-cms-plugin-1.0-SNAPSHOT

  • rw-r--r-- 1 root root 8130504 May 24 15:56 xrootd4j-cms-plugin-1.0-SNAPSHOT.tar.gz

zitpcx18435:/usr/local/share/dcache/plugins % cd xrootd4j-cms-plugin-1.0-SNAPSHOT zitpcx18435:/usr/local/share/dcache/plugins/xrootd4j-cms-plugin-1.0-SNAPSHOT % ls -l total 8720

  • rw-r--r-- 1 karsten it 904 Oct 5 2012 default.properties
  • rw-r--r-- 1 karsten it 34520 Sep 4 2012 LICENSE.txt
  • rw-r--r-- 1 karsten it 8857794 Aug 23 2012 scala-library-2.9.2.jar
  • rw-r--r-- 1 karsten it 25963 Nov 5 2012 xrootd4j-cms-plugin-1.0-SNAPSHOT.jar

zitpcx18435:/usr/local/share/dcache/plugins/xrootd4j-cms-plugin-1.0-SNAPSHOT %

slide-17
SLIDE 17

Configure the CMS-Mapping-Plugin

In your layout file (or dcache.conf) set

xrootd/xrootdPlugins=gplazma:none,authz:cms-tfc

Configure the path or url to the rules file

xrootd.cms.tfc.path=$CMS_PATH/SITECONF/local/PhEDEx/storage.xm l

and the “entry point” protocol

xrootd.cms.tfc.protocol=root

slide-18
SLIDE 18

Sample rules file

<storage-mapping> <lfn-to-pfn protocol=”root” path-match=”.*/path/to/l(.*)” result=”root:///mapped/path/to/p$1”/> </storage-mapping> “root:///foo/bar/path/to/lfn” → “root:///mapped/path/to/pfn”

slide-19
SLIDE 19

Joining the Atlas XrootD Federation (FAX)

slide-20
SLIDE 20

Joining the Atlas XrootD Federation (FAX)

  • Way one:

Use dCache as a Posix storage with NFS 4.1 https://twiki.cern.ch/twiki/bin/view/Atlas/FAXposixStorage

  • Way two:

Use dCache as xrootd storage https://twiki.cern.ch/twiki/bin/view/Atlas/FAXxrootdStorage

  • Way three:

Use the FAX Name-to-Name Plugin https://twiki.cern.ch/twiki/bin/view/Atlas/FAXdCacheN2Nstorage

slide-21
SLIDE 21

Using dCache as Posix storage

slide-22
SLIDE 22

Using dCache as Posix storage

/path/to/gfn ?

slide-23
SLIDE 23

Using dCache as Posix storage

/path/to/gfn ?

slide-24
SLIDE 24

Using dCache as Posix storage

slide-25
SLIDE 25

Using dCache as Posix storage

“Got it!”

slide-26
SLIDE 26

Using dCache as Posix storage

Redirect: xrootd.federation.host

slide-27
SLIDE 27

Using dCache as Posix storage

/path/to/gfn ?

slide-28
SLIDE 28

Using dCache as Posix storage

slide-29
SLIDE 29

Using dCache as Posix storage

/mapped/path/to/sfn ?

slide-30
SLIDE 30

Using dCache as Posix storage

slide-31
SLIDE 31

Using dCache as XrootD storage

See https://twiki.cern.ch/twiki/bin/view/Atlas/FAXDECloud for a real life example by Günther Duckeck (LMU München)

slide-32
SLIDE 32

Using the FAX Name-to-Name Plugin

Third-party plugin by Ilija Vukotic

https://twiki.cern.ch/twiki/bin/view/Main/Ili jaVukotic

slide-33
SLIDE 33

Using the FAX Name-to-Name Plugin

slide-34
SLIDE 34

Using the FAX Name-to-Name Plugin

/path/to/gfn

slide-35
SLIDE 35

Using the FAX Name-to-Name Plugin

/path/to/gfn

slide-36
SLIDE 36

Using the FAX Name-to-Name Plugin

/path/to/gfn → /mapped/path/to/sfn

slide-37
SLIDE 37

Using the FAX Name-to-Name Plugin

“Got it!”

slide-38
SLIDE 38

Using the FAX Name-to-Name Plugin

Redirect: xrootd.federation.host

slide-39
SLIDE 39

Using the FAX Name-to-Name Plugin

/path/to/gfn

slide-40
SLIDE 40

Using the FAX Name-to-Name Plugin

Redirect: door.example.org

slide-41
SLIDE 41

Using the FAX Name-to-Name Plugin

n2n /path/to/gfn

slide-42
SLIDE 42

Using the FAX Name-to-Name Plugin

n2n /path/to/gfn → /mapped/path/to/sfn

slide-43
SLIDE 43

Using the FAX Name-to-Name Plugin

n2n Redirect: pool.example.org:/mapped/path/to/sfn

slide-44
SLIDE 44

Using the FAX Name-to-Name Plugin

n2n /mapped/path/to/sfn

slide-45
SLIDE 45

Install the Name-to-Name-Plugin

Build or download from

https://github.com/ivukotic/plugins.git

Unpack it in

/usr/local/share/dcache/plugins

slide-46
SLIDE 46

Configure the Name-to-Name Plugin

In your layout file (or dcache.conf) set

xrootd/xrootdPlugins=gplazma:none,authz:atlas-name-to- name-plugin

Configure hostname of the LFC

lfc_host=<lfc-host>

And the hostname of the dCache SRM door

srm_host=<srm-host>

slide-47
SLIDE 47

Install the Atlas Pool Monitor Plugin

Third-party plugin by Ilija Vukotic

https://twiki.cern.ch/twiki/bin/view/Main/IlijaVukotic

Exposes two monitoring streams:

  • Summary: High-Level statistics
  • Detailed: Information to each file open

So far, mostly Atlas, but there is some activity to use this also for CMS.

slide-48
SLIDE 48

Install the Atlas Pool Monitor Plugin

Build or download from

https://github.com/ivukotic/plugins.git

Unpack it in

/usr/local/share/dcache/plugins

slide-49
SLIDE 49

Configure the Atlas Pool Monitor Plugin

In your layout file (or dcache.conf) set

  • on the Pool-Nodes:

pool/xrootdPlugins=gplazma:none,authz:edu.uchicago.monitor

Configure where to send the summarized data

summary=<monitor-host>:<port>:<interval[s]>

and where to send the detailed data

detailed=<details-host>:<port>:<interval[s]>

  • on the Door-Nodes:

xrootd/xrootdPlugins=gplazma:none,authz:atlas-name-to-name-plugin pool/xrootdPlugins=gplazma:none,authz:edu.uchicago.monitor

slide-50
SLIDE 50

Using the Alice-Token Plugin

slide-51
SLIDE 51

Using the Alice-Token Plugin

In your layout file (or dcache.conf) set

xrootd/xrootdPlugins=gplazma:none,authz:alice-token

If you want gsi security:

xrootd/xrootdPlugins=gplazma:gsi,authz:alice-token

Configure the path to the keystore

xrootdAuthzKeystore=<keystore>

slide-52
SLIDE 52

52

Version Requirements

Plugin dCache 2.2+ dCache 2.4+ dCache 2.6+

xrootd4j-backport supported supported included Alice Authorization Included Included included CMS Federation with xrootd4j-backport supported supported Atlas Federation

with xrootd4j-backport

supported supported Atlas Pool Monitoring

with xrootd4j-backport with xrootd4j-backport

supported

slide-53
SLIDE 53

XrootD-Backport

Build or download xrootd4j-backport-2.4- SNAPSHOT.tar.gz Unpack it in /usr/local/share/dcache/plugins/ Restart dCache to pick it up.

slide-54
SLIDE 54

Building Plugins (optional)

Checking out source code of plugins and building them is not necessary for normal operation. However, if you are interested you can...

slide-55
SLIDE 55

Building Requirements

To build the plugins from source: Git, Java 6+, Maven2 or 3 and xrootd4j from

https://github.com/dCache/xrootd4j.git

Install the xrootd4j dependencies using

# cd xrootd4j # mvn install -am -pl xrootd4j

Take the .tar.gz from the target directory.

slide-56
SLIDE 56

Build the XrootD-Backport

Check out the sources from

https://github.com/dCache/xrootd4j-backport.git # cd xroot4j-backport # mvn package

Take the .tar.gz from the target directory. Current version depends on dcache-core-2.2.5

slide-57
SLIDE 57

Build the CMS Mapping-Plugin

Check out the sources from

https://github.com/dCache/xrootd4j-cms-plugin.git

# cd xrootd4j-cms-plugin # mvn package Take the .tar.gz from the target directory.

slide-58
SLIDE 58

58

Sources

XrootD4J:

  • https://github.com/dCache/xrootd4j.git

XrootD4J-Backport:

  • https://github.com/dCache/xrootd4j-backport.git

CMS-Namespace-Mapping:

  • https://github.com/dCache/xrootd4j-cms-plugin.git

FAX-Namespace-Mapping, Atlas-Pool-Monitoring:

  • https://github.com/ivukotic/plugins.git

Currently there is no official download location for the plugins. If you want to use them, please contact us ( support@dcache.org) or the provider of the plugin.

slide-59
SLIDE 59

59

References

  • Giacinto Donvito:

“CMS evolution on data access: xrootd remote access and data federation”, http://www.desy.de/dvsem/WS1112/donvito_talk.pdf

  • Brian Bockelmann: “Joining a dCache-based SE to the Xrootd service.”,

https://twiki.cern.ch/twiki/bin/view/Main/DcacheXrootd

  • Günther Duckeck: “Xrootd proxy setup for dCache to join FAX”,

https://twiki.cern.ch/twiki/bin/view/Atlas/FAXDECloud

  • Ilija Vukotic: “Setup xrootd/FAX services with dCache Xrootd Door”,

https://twiki.cern.ch/twiki/bin/view/Atlas/FAXdCacheN2Nstorage

  • WeiYang: “Setup xrootd/FAX services on Xrootd Storage”,

https://twiki.cern.ch/twiki/bin/view/Atlas/FAXxrootdStorage

  • Domenico Giordano, Simone Campana: “XrootD Deployment Task Force”
slide-60
SLIDE 60

60

Thank you!