Andreas Heiss andreas.heiss@iwr.fzk.de www.gridka.de 1 Atlas 3T1 - - PowerPoint PPT Presentation

▶
andreas heiss
SMART_READER_LITE
LIVE PREVIEW

Andreas Heiss andreas.heiss@iwr.fzk.de www.gridka.de 1 Atlas 3T1 - - PowerPoint PPT Presentation

Nov 21, 2023 228 likes •385 views

Forschungszentrum Karlsruhe in der Helmholtz - Gemeinschaft Andreas Heiss andreas.heiss@iwr.fzk.de www.gridka.de 1 Atlas 3T1 Meeting, IN2P3, 22-23 May 2007 Forschungszentrum Karlsruhe in der Helmholtz - Gemeinschaft GridKa @

slide-1
SLIDE 1

Forschungszentrum Karlsruhe

in der Helmholtz - Gemeinschaft

Atlas 3T1 Meeting, IN2P3, 22-23 May 2007

1

Andreas Heiss

andreas.heiss@iwr.fzk.de www.gridka.de

slide-2
SLIDE 2

Forschungszentrum Karlsruhe

in der Helmholtz - Gemeinschaft

Atlas 3T1 Meeting, IN2P3, 22-23 May 2007

2

  • Founded 2001 as part of the

computing centre of Forschungszentrum Karlsruhe (approx. 3500 employees)

  • WLCG Tier-1 for all 4 LHC

experiments

  • supports 4 non-LHC

experiments: CDF, D0, BaBar, Compass

  • located 10km north of

Karlsruhe/Germany on the FZK (soon: KIT) campus

  • Operated by the Institute for

Scientific Computing (soon: “Steinbuch Computing Centre”)

GridKa @ Forschungszentrum Karlsruhe GridKa @ Forschungszentrum Karlsruhe

slide-3
SLIDE 3

Forschungszentrum Karlsruhe

in der Helmholtz - Gemeinschaft

Atlas 3T1 Meeting, IN2P3, 22-23 May 2007

3

GridKa-CA German certification authority Global Grid User Support (GGUS)

slide-4
SLIDE 4

Forschungszentrum Karlsruhe

in der Helmholtz - Gemeinschaft

Atlas 3T1 Meeting, IN2P3, 22-23 May 2007

4

GridKa staff

Manfred Alef

  • login nodes, batch system, cluster

Andreas Motzke - 3D databases Melanie Ernst

  • batch system, accounting,

user management Sameer Sharma - administrative things Axel Jaeger

  • technician, cluster setup, monitoring

inventory Bernhard Verstege

  • technician, cluster setup, monitoring

Marco Stanossek

  • technician, cluster setup

Felix Brak

  • student

Hans-Ulrich Hohn

  • technician, cluster setup

Qun Wang

  • student

Doris Ressmann

  • dCache

Holger Marten

  • project leader

Silke Halstenberg

  • dCache, FTS, 3D databases

(works nothing but Jos van Wezel

  • TSM, tape systems, GPFS, servers

can be blamed Stephanie Meier

  • disk systems, GPFS

for problems) Andreas Heiss

  • experiment contact, Tier-2s, FTS,

monitoring Sven Gabriel

  • site admin (gLite)

+ support by other departments Marc Hemberger

  • site admin (gLite)

(Oracle, networking, ...) Bruno Hoeft

  • LAN, WAN, firewall

Aurelie Reymund

  • LAN, WAN

Ursula Epting

  • CA, security

Ingrid Schaeffner

  • CA, VOMS, user management

Sven Herrmann

  • ROC manager DECH

Clemes Koerdt

  • ROC manager DECH, SFTs
slide-5
SLIDE 5

Forschungszentrum Karlsruhe

in der Helmholtz - Gemeinschaft

Atlas 3T1 Meeting, IN2P3, 22-23 May 2007

5

GridKa associated Tier-2 sites spread over 3 EGEE regions. GridKa associated Tier-2 sites spread over 3 EGEE regions.

(4 LHC Experiments, 5 (soon: 6) countries, >20 T2 sites)

slide-6
SLIDE 6

Forschungszentrum Karlsruhe

in der Helmholtz - Gemeinschaft

Atlas 3T1 Meeting, IN2P3, 22-23 May 2007

6

GridKa machine room GridKa machine room

(Water cooled racks for compute nodes and disks)

slide-7
SLIDE 7

Forschungszentrum Karlsruhe

in der Helmholtz - Gemeinschaft

Atlas 3T1 Meeting, IN2P3, 22-23 May 2007

7

slide-8
SLIDE 8

Forschungszentrum Karlsruhe

in der Helmholtz - Gemeinschaft

Atlas 3T1 Meeting, IN2P3, 22-23 May 2007

8

Second machine room March 2007

slide-9
SLIDE 9

Forschungszentrum Karlsruhe

in der Helmholtz - Gemeinschaft

Atlas 3T1 Meeting, IN2P3, 22-23 May 2007

9

CPUs and storage Mai 2007 CPUs and storage Mai 2007:

:

  • CPUs

( ~ 2500 cores, av. 1.43 kSI2k/core)

  • LHC experiments:

1864 kSI2k

  • non-LHC experiments:

1270 kSI2k

  • D-Grid and others:

≈ 460 kSI2k ≈ 3594 kSI2k

slide-10
SLIDE 10

Forschungszentrum Karlsruhe

in der Helmholtz - Gemeinschaft

Atlas 3T1 Meeting, IN2P3, 22-23 May 2007

10

  • disk capacity
  • LHC experiments:

878 TB (usable)

  • non-LHC experiments:

443 TB (usable) 1321 TB = 1860 TB gross + few TB on smaller systems

slide-11
SLIDE 11

Forschungszentrum Karlsruhe

in der Helmholtz - Gemeinschaft

Atlas 3T1 Meeting, IN2P3, 22-23 May 2007

11

  • Storage units of ≈20 TB and ≈90 TB
  • 2 servers connected to 1 storage controller
  • 2 (2x1 Gbit each) servers for every

20 TB/90 TB

  • dCache pool node on GPFS file system
slide-12
SLIDE 12

Forschungszentrum Karlsruhe

in der Helmholtz - Gemeinschaft

Atlas 3T1 Meeting, IN2P3, 22-23 May 2007

12

  • GRAU Datasystems

XT library

  • 5400 slots
  • 16 LTO3 drives (IBM)

(expandable to 60)

  • support for TSM
  • dCache interfaced to

TSM via TSS

2007 tape capacity 2007 tape capacity extension extension

  • tape capacity
  • LHC experiments:

1007 TB

  • non-LHC experiments:

585 TB

slide-13
SLIDE 13

Forschungszentrum Karlsruhe

in der Helmholtz - Gemeinschaft

Atlas 3T1 Meeting, IN2P3, 22-23 May 2007

13

GridKa capacity plans (WLCG Tier-1 resources only) GridKa capacity plans (WLCG Tier-1 resources only) 2007 2008 2009 2010 CPU (kSI2k) 1860 7140 11550 17390 Disk (TB) 880 3260 5150 8080 Tape (TB) 1010 3440 7510 11760

slide-14
SLIDE 14

Forschungszentrum Karlsruhe

in der Helmholtz - Gemeinschaft

Atlas 3T1 Meeting, IN2P3, 22-23 May 2007

14

Network

  • 10 Gb/s LHC OPN to CERN
  • 10 Gb/s LHC OPN to CNAF (backup link to CERN)
  • 10 Gb/s uplink to DFN/X-WIN (German research backbone)
  • 1 Gb/s uplink to BelWue (Baden-Wuerttemberg University

and research network)

  • 1Gb/s p2p link to Polish Pionier academic network (Poznań,

Warsaw, Kraków)

  • 1Gb/s p2p link to FZU Prague

To come in 2007:

  • 10 Gb/s

LHC OPN to IN2P3

  • 10 Gb/s

LHC OPN to SARA