ALICE Erik Edelmann erik.edelmann@csc.fi NeIC / CSC NeIC/NDGF All - - PowerPoint PPT Presentation

▶

Aug 18, 2022 133 likes •363 views

ALICE Erik Edelmann erik.edelmann@csc.fi NeIC / CSC NeIC/NDGF All hands meeting February 2013 p. 1/ Pledges: CPU 180 Fin 160 Swe Den 140 Nor NDGF 120 % of pledge 100 80 60 40 20 0 May12 Jul12 Sep12 Nov12 Jan13

SLIDE 1

ALICE

Erik Edelmann

erik.edelmann@csc.fi

NeIC / CSC

NeIC/NDGF All hands meeting February 2013 – p. 1/

SLIDE 2

Pledges: CPU

20 40 60 80 100 120 140 160 180

% of pledge

May12 Jul12 Sep12 Nov12 Jan13

Fin Swe Den Nor NDGF

NeIC/NDGF All hands meeting February 2013 – p. 2/

SLIDE 3

Pledges: CPU

20 40 60 80 100 120 140 160 180

% of pledge

May12 Jul12 Sep12 Nov12 Jan13

Fin Swe Den Nor NDGF

In 2013 the pledge increases from 12535 to 13383 kHEPSPEC06

NeIC/NDGF All hands meeting February 2013 – p. 2/

SLIDE 4

Pledges: Storage

Disk

– 2012 Pledge: 1.325 PB (NDGF-T1) + 400 TB (SNIC-T2) – Installed: 711 TB + 400 TB – In use: 617 TB + 125 TB

Tape

– 2012 Pledge: 1.761 PB – Installed: 2.4 PB (according to bdii1.ndgf.org) – In use: 216 TB

NeIC/NDGF All hands meeting February 2013 – p. 3/

SLIDE 5

Pledges: Storage

Disk

– 2012 Pledge: 1.325 PB (NDGF-T1) + 400 TB (SNIC-T2) – Installed: 711 TB + 400 TB – In use: 617 TB + 125 TB

Tape

– 2012 Pledge: 1.761 PB – Installed: 2.4 PB (according to bdii1.ndgf.org) – In use: 216 TB In 2013 disk pledge increases to 1480 TB, Tape to 2276 TB

NeIC/NDGF All hands meeting February 2013 – p. 3/

SLIDE 6

Job efficiency & storage architecture

ALICE has been infamous for bad job efficiency ...

NeIC/NDGF All hands meeting February 2013 – p. 4/

SLIDE 7

Job efficiency & storage architecture

... but it’s not that bad anymore ...

NeIC/NDGF All hands meeting February 2013 – p. 4/

SLIDE 8

Job efficiency & storage architecture

... except for NDGF

NeIC/NDGF All hands meeting February 2013 – p. 4/

SLIDE 9

Job efficiency & storage architecture

Distributed storage not necessarily a problem
but could it be made more efficient?

– Caching? – ’hints’ of where the data is located internally?

NeIC/NDGF All hands meeting February 2013 – p. 4/

SLIDE 10

SW installation: past, present and future

Past: VO-box installed onto disk shared with the WNs

NeIC/NDGF All hands meeting February 2013 – p. 5/

SLIDE 11

SW installation: past, present and future

Past: VO-box installed onto disk shared with the WNs
Present: Jobs install onto local disk using a BitTorrent based

system. – Shared disk not required anymore.

NeIC/NDGF All hands meeting February 2013 – p. 5/

SLIDE 12

SW installation: past, present and future

Past: VO-box installed onto disk shared with the WNs
Present: Jobs install onto local disk using a BitTorrent based

system. – Shared disk not required anymore.

Future: CVMFS

NeIC/NDGF All hands meeting February 2013 – p. 5/

SLIDE 13

SW installation: past, present and future

Past: VO-box installed onto disk shared with the WNs
Present: Jobs install onto local disk using a BitTorrent based

system. – Shared disk not required anymore.

Future: CVMFS

– When? ”They’ll tell us beforehand”

NeIC/NDGF All hands meeting February 2013 – p. 5/

SLIDE 14

One VO-box to rule them all?

With the ”shared disk” requirement gone, could we have only
ne VO-box that submits through ARC?

NeIC/NDGF All hands meeting February 2013 – p. 6/

SLIDE 15

One VO-box to rule them all?

With the ”shared disk” requirement gone, could we have only
ne VO-box that submits through ARC?
Probably, but do we want to?

NeIC/NDGF All hands meeting February 2013 – p. 6/

SLIDE 16

One VO-box to rule them all?

With the ”shared disk” requirement gone, could we have only
ne VO-box that submits through ARC?
Probably, but do we want to?

– Depends on what we do with storage

NeIC/NDGF All hands meeting February 2013 – p. 6/

SLIDE 17

One VO-box to rule them all?

With the ”shared disk” requirement gone, could we have only
ne VO-box that submits through ARC?
Probably, but do we want to?

– Depends on what we do with storage – Pros:

Fewer VO-boxes to keep track of.
Easier to add new clusters.
Simplified accounting (Using ARC everywhere would be

enough for this)

NeIC/NDGF All hands meeting February 2013 – p. 6/

SLIDE 18

One VO-box to rule them all?

With the ”shared disk” requirement gone, could we have only
ne VO-box that submits through ARC?
Probably, but do we want to?

– Depends on what we do with storage – Pros:

Fewer VO-boxes to keep track of.
Easier to add new clusters.
Simplified accounting (Using ARC everywhere would be

enough for this) – Cons:

We would replace something that works with something

untested.

”Political” issue: On the Alimonitor map, one nordic

country would have a huge cluster, the others nothing.

NeIC/NDGF All hands meeting February 2013 – p. 6/

SLIDE 19

Long shutdown plans

For us, mostly business as usual:

– Reprocessing of 2011 data, MC, user analysis ... ⇒ jobs running, needs access to data.

NeIC/NDGF All hands meeting February 2013 – p. 7/

SLIDE 20

Long shutdown plans

For us, mostly business as usual:

– Reprocessing of 2011 data, MC, user analysis ... ⇒ jobs running, needs access to data.

Sites may be asked to upgrade to SLC6 (”if OK with the sites”)

NeIC/NDGF All hands meeting February 2013 – p. 7/

SLIDE 21

Long shutdown plans

For us, mostly business as usual:

– Reprocessing of 2011 data, MC, user analysis ... ⇒ jobs running, needs access to data.

Sites may be asked to upgrade to SLC6 (”if OK with the sites”)
IPv6

– CERN aims to have IPv6 fully deployed by the end of LS1 (autumn 2014)

Publicly accessible services should be reachable on

dual-stack. – ALICE would like to start testing their software with IPv6 already now

Would be nice if VO-Boxes could be dual-stacked ASAP.

NeIC/NDGF All hands meeting February 2013 – p. 7/

SLIDE 22

Summary

We need more resources
We’ll have to think how we do storage and organizes VO-boxes
We’ll need IPv6.

NeIC/NDGF All hands meeting February 2013 – p. 8/