STAR and PHENIX Amol Jaikar Production STAR Production - - PowerPoint PPT Presentation

▶
star and phenix
SMART_READER_LITE
LIVE PREVIEW

STAR and PHENIX Amol Jaikar Production STAR Production - - PowerPoint PPT Presentation

Nov 10, 2023 442 likes •646 views

STAR and PHENIX Amol Jaikar Production STAR Production BirdView (Monitoring framework) Index PHENIX Production OSG Exploration 2 ST STAR Production BirdView RAW dataset(DAQ) to MuDst conversion Monitoring system

slide-1
SLIDE 1

STAR and PHENIX Production

Amol Jaikar

slide-2
SLIDE 2

Index

2

  • Production
  • BirdView

(Monitoring framework) STAR

  • Production
  • OSG Exploration

PHENIX

slide-3
SLIDE 3

ST STAR

3

Production

RAW dataset(DAQ) to MuDst conversion MuDst to PicoDst conversion

BirdView

Monitoring system Notification system Workflow management

slide-4
SLIDE 4

Production

4

RAW dataset to MuDst conversion MuDst to PicoDst conversion Nightly jobs

slide-5
SLIDE 5

RAW TO MUDST

  • Current Framework
  • Consist of 4 steps
  • Database insertion
  • Extract runnumber information
  • File creation
  • Submission
  • New Framework
  • Consist of 2 steps
  • Files creation
  • Submission

5

Log extraction framework Parameter Old New Execution Time 12 ~ 19 min 2.37 ~ 3.5 min Parse files 8 ~ 32 148 ~ 162 Code length 2140 721 Language Perl Python

slide-6
SLIDE 6

BirdVi View

  • Monitoring System
  • Production job’s monitoring

system

  • Nightly job’s performance

monitoring

  • Fault identification system
  • Notification System
  • Notification of an event
  • Workload management
  • Add or remove Nightly jobs
  • Launch test and production

jobs

6

slide-7
SLIDE 7

MuDst to PicoDst Conversion

7

slide-8
SLIDE 8

Current Production

8

slide-9
SLIDE 9

Nightly Job Monitoring

9

slide-10
SLIDE 10

Nightly Job monitoring

10

slide-11
SLIDE 11

Dataset comparison

11

slide-12
SLIDE 12

Dataset w.r.t. Library

12

slide-13
SLIDE 13

32 bit to 64 bit conversion

13

slide-14
SLIDE 14

32 bit to 64 bit conversion

14

slide-15
SLIDE 15

32 bit to 64 bit conversion

15

slide-16
SLIDE 16

PHE PHENIX IX

16

Production OSG exploration

slide-17
SLIDE 17

Pr Production

  • Current framework
  • Insert à Insertion of information into the database
  • Create à Creation of job submission files
  • Submission à Submission to CRS framework
  • Current Dataset
  • 2016 AuAu 200 GeV

17

Number of jobs Current status 215832 Processing succeeded 144 Processing failed 19 MD5 mismatch

slide-18
SLIDE 18

OSG Exploration

  • Creation of account
  • Creation of sPHENIX project under OSG - Done
  • Creation of account to access the resources - Done
  • Execution of sample jobs
  • With specific requirement (e.g. 4 GB memory) - Done
  • With singularity image - in progress
  • To a specific site - in progress
  • Library integration with OSG CVMFS
  • Requested to RCF regarding this - in process

18

slide-19
SLIDE 19

Future work

19

  • BirdView deployment
  • Database optimization
  • Framework optimization
  • Continue production

STAR

  • OSG exploration
  • Continue production

PHENIX

slide-20
SLIDE 20

Thank you

Amol Jaikar