APEL: A CPU Accounting Infrastructure for Grids Presented by Will - - PowerPoint PPT Presentation

▶
apel a cpu accounting infrastructure for grids
SMART_READER_LITE
LIVE PREVIEW

APEL: A CPU Accounting Infrastructure for Grids Presented by Will - - PowerPoint PPT Presentation

Feb 26, 2024 116 likes •256 views

APEL: A CPU Accounting Infrastructure for Grids Presented by Will Rogers Ming Jiang, Cristina Del Cano Novales, Gilles Mathieu, John Casson, Will Rogers, John Gordon e-Science Centre, STFC, United Kingdom {ming.jiang,

slide-1
SLIDE 1

APEL: A CPU Accounting Infrastructure for Grids

Presented by Will Rogers

Ming Jiang, Cristina Del Cano Novales, Gilles Mathieu, John Casson, Will Rogers, John Gordon e-Science Centre, STFC, United Kingdom {ming.jiang, cristina.del-cano-novales, gilles.mathieu, john.casson, will.rogers, john.gordon}@stfc.ac.uk

slide-2
SLIDE 2

Contents

  • The Role of CPU Accounting
  • The APEL System in Detail
  • APEL as part of EGI
  • APEL in the Future
slide-3
SLIDE 3

CPU Accounting and APEL

  • Everyone needs to know how many jobs have

run on the grid

  • This should be filtered by user, VO, region,

country, etc

  • The APEL tool collects the data
  • The information is published through the

‘Accounting Portal’ at CESGA

  • APEL deployed on EGEE in late 2005
  • 250m records, 91000 CPU years
slide-4
SLIDE 4
  • Records via APEL

– Most of EGEE

  • Records direct

– IN2P3-CC

  • Summaries only

– Gratia (OSG) – SGAS (NorduGrid) – DGAS (INFN)

Publishing Methods

slide-5
SLIDE 5
  • APEL client has two components

– APEL parser (on each CE)

  • Parses batch system log files
  • Reads CE benchmark values from site GIIS
  • Records this information into a local database

– APEL Publisher (~1 per site)

  • Combines the entries from different log files

into a full ‘Accounting Record’

  • Publishes records to a machine (at RAL, UK)

The APEL Client

slide-6
SLIDE 6

The APEL Server

Central Repositor y Front End Flexible Archiver Sites Portal

Job records Summaries

slide-7
SLIDE 7

Region B

– APEL (Parser + Publisher) installed at all sites – Regional Accounting Server – Sites publish to Regional Archiver – Regional Accounting Server publishes summaries to Central Accounting Server

Region A

– APEL (Parser + Publisher) installed at all sites – No Regional Accounting Server – Sites publish directly to Central Accounting Server

EGI

CENTRAL ARCHIVER CENTRAL DATABAS E CENTRAL ACCOUNTING PORTAL

APEL APEL

REGION A

APEL APEL

REGION B

REGIONAL ARCHIVER REGIONAL DATABASE REGIONAL PORTAL

slide-8
SLIDE 8

Region D

– Own accounting tool – Own accounting system – Region to publish individual records to the Central Accounting System

Region C

– Own accounting tool – Own accounting system – Region to publish summaries to the Central Accounting System

EGI

CENTRAL ARCHIVER CENTRAL DATABAS E CENTRAL ACCOUNTING PORTAL

REGIONAL DB

OTHER TOOL

REGION C

OTHER TOOL OTHER TOOL

REGION D

slide-9
SLIDE 9

EGI

slide-10
SLIDE 10
  • Replacement of RGMA with ActiveMQ

– A more reliable mechanism – Network of brokers at CERN

  • Redesign of central system

– Easier to manage – Distributable

Roadmap

slide-11
SLIDE 11

Roadmap

  • Distribution of APEL accounting system

to regions

– Keeping a central accounting repository – Working with the Accounting Portal

  • Other improvements:

– Well-defined interface with other accounting tools – Standardisation

slide-12
SLIDE 12

APEL Home http://goc.grid.sinica.edu.tw/gocwiki/ApelHome Accounting Portal http://www3.egee.cesga.es/gridsite/accounting/CESGA/ egee_view.html

For more:

  • Talk to us!
  • e-mail: will.rogers@stfc.ac.uk;

apel-support@jiscmail.ac.uk