Highlights from the art Users' Meeting, the FIFE workshop, and the LArSoft Usability Workshop Tom Junk DUNE Software and Computing General Meeting June 27, 2016
First an Announcement: ProtoDUNE Science Workshop@CERN • June 28 to June 30 • Indico Page: https://indico.fnal.gov/conferenceDisplay.py?confId=12042 • Chairs: Jarek Nowak, Donna Naples, Thomas Kutter, Cheng- Ju Lin, Dorota Stefan • A line on the overview page says you need a LightWeight CERN account to use Vidyo. Checking this – Vidyo allows organizers to invite non-registered participants too. 2 June 27, 2016 Tom Junk | Workshop Highlights
art Users' Meeting Highlights • June 17, 2016. Indico page https://indico.fnal.gov/conferenceOtherViews.py?view=standard&confId=12068 • New art Fetures – Chris Green. FHiCL Features: Kyle Knoepfel - ROOT upgraded to V6 Now in LArSoft major release 6 (still only in release candidates). LArSoft v06_00_00_rc3 depends on art v1_18_05 and root v6_04_06. - New art flags to turn on printing of available modules and descriptions - new executable: fhicl-dump which interprets FHiCL documents (a fcl file and all of its includes) and prints out the intepreted parameter sets - FHiCL parameter validation (see Kyle's talk) - FHiCL parameters can now be protected from being overwritten - cetskelgen executable replaces artmod . Makes example module code - Failure of a producer to put its promised data product collection is now an error. Be sure to put at least an empty collection 3 June 27, 2016 Tom Junk | Workshop Highlights
art Users' Meeting Highlights • gallery – accessing art -formatted files without art – Marc Paterno - API's for C++, Python, ROOT macros - lightweight - You open the file, you initiate the event loop - does not provide features for writing art ROOTfiles – write your own trees or histograms or other output 4 June 27, 2016 Tom Junk | Workshop Highlights
art Users' Meeting Highlights • Nice talk on Deep Learning in NOvA from Alexander Radovic • Look at the developing with Spack talk from Patrick Gartung - OS X versions 10.11 (El Capitan) onwards disable DYLD_LIBRARY_PATH if System Integrity Protection (SIP) is turned on, breaking CET-built programs. - Spack is the Supercomputer package manager (LLNL) - uses rpaths instead of (DY)LD_LIBRARY_PATH - Runs on SLF*, Ubuntu, OS X; builds ROOT and G4 - Needs some development to port current cmake files to run with it for art-based programs 5 June 27, 2016 Tom Junk | Workshop Highlights
FIFE Workshop Highlights • June 20-21, 2016. indico page https://indico.fnal.gov/conferenceTimeTable.py?confId=12120#201 60620 Roadmap – Mike Kirby 6 June 27, 2016 Tom Junk | Workshop Highlights
SC-PMT Process SC-PMT Slides SC-PMT : Tape Usage and Requests Tape media and library cost is ~ $30 / TB ($30K / PB) (T10KD, 8.5TB/tape) • Table below shows *addition* of: • FY16 16 PB $480K • FY17 17 PB $510K • FY18 29 PB $870K Expt Current Use FY16 Addition FY17 Addition FY18 Addition Annie - 100 100 100 Tape is a major cost! Captain-Minerva - - 50 1,000 CDF - 4 4 4 But needs are not CHIPS - 100 100 100 easily predicted COUPP 30 - - - DES - 600 1,200 1,200 DUNE 29 1,000 500 10,000 g-2 - 2,000 3,000 3,000 Much of this originates from Holometer - 50 50 50 protoDUNEs at CERN LArIAT 4 25 25 25 MicroBoone 2,700 6,217 5,865 7,305 at 200 MB/s rate Minerva 1,040 1,600 1,800 2,100 Minos 518 200 100 - Mu2e 317 250 250 250 Nova 5,237 4,000 4,000 4,000 Margaret Votava SBND - 25 25 25 Seaquest 100 - 100 - Stu Fuess Grand Total 9,975 16,171 17,169 29,159 June 27, 2016 Tom Junk | Workshop Highlights 7
GP Grid Processing requests: Large memory or multi-core as single slot Margaret Votava Stu Fuess Last year’s SC-PMT 2016 Capacity 2015 Capacity Tom Junk | Workshop Highlights June 27, 2016 8
FY16: How much computing so far M. Votava Over 83M wall clock hours 9 June 27, 2016 Tom Junk | Workshop Highlights
Running jobs - offsite only M. Votava 10 June 27, 2016 Tom Junk | Workshop Highlights
Let’s make the world a better place – Margaret Votava Girl Scout Law I will do my best to … use resources wisely, … make the world a better place, …. 11 June 27, 2016 Tom Junk | Workshop Highlights
OSG:What’s out there? Tanya Levshina Many OSG sites allow opportunistic use • of spare cycles: – 231M hours across all VOs and all sites in the past year – 42M by mu2e alone – Most permit the Fermilab VO (any offsite jobs submitted via jobsub) Individual experiments with collaborating • institutions that have grid sites: Mostly ATLAS/CMS sites either on OSG or EGI – June 2015-June 2016 In most cases accessible via the same OSG – Opportunistic use by all VOs interface 230,982,728 hours Considered dedicated resources for that – experiment Most cases not by the entire Fermilab VO – Allocation-based HPC (supercomputers) • Also can be accessible via OSG – Currently limited to two (NSF) sites – 12 June 27, Tom Junk | Workshop Highlights 2016
OSG: General opportunistic Tanya Levshina • Currently 18 OSG sites support the generic Fermilab VO – ATLAS (4) – CMS (9) – university HPC clusters (5) • What to expect on these sites – All will have CVMFS – Multiple sites are now offering access to CVMFS/StashCache (useful for flux files access) – Most sites offer ~2GB RAM/core and ~35GB disk space but expect some variation – Most sites offer multicore slots: a way to get large memory jobs in. Most sites allow to request up to 8 cores. – Some of these sites are very large: Syracuse (SU-OG) will rival all of GPGrid at times just in opportunistic OSG running 13 June 27, Tom Junk | Workshop Highlights 2016
OSG: Preemption Tanya Levshina • Most sites will preempt – Owner VOs can claim a slot back at any time – Your job will restart elsewhere if this occurs • Most sites do not offer any specific quota for Fermilab VO jobs – All opportunistic VOs are treated on the same footing 14 June 27, Tom Junk | Workshop Highlights 2016
FIFEMON • Talk by Ken Retzke • http://fifemon.fnal.gov • Use your Services username and password • Use it! It's very intuitive. Batch jobs, CPU, on-site, off-site • Dashboards can be bookmarked. A little too easy to get sidetracked onto another experiments' pages. 15 June 27, 2016 Tom Junk | Workshop Highlights
POMS • See Marc Mengel's talk • A tool developed for the OPOS group to help them manage job submission and bookkeeping for multiple experiments. • With OPOS being phased out, SCD is working to make POMS available directly to experiments • Many features in Marc's talk look as if they overlap with features provided by Herb Greenlee's project.py 16 June 27, 2016 Tom Junk | Workshop Highlights
Best-Practices Presentations • Too many to summarize here. The slides end up being vital documentation moving forwards - Running on the OSG: Two talks by Ken Herner - Job Submissin with jobsub_client: Dennis Box - dCache – Dmitry Litvinsev (see especially access using XRootD instructions and tips) - SAM – Robert Illingworth - FTS – Mike Diesburg - sam4users Penghei Ding 17 June 27, 2016 Tom Junk | Workshop Highlights
LArSoft Usability Workshop Highlights • June 22-23, 2016. Indico page https://indico.fnal.gov/conferenceOtherViews.py?view=standard&confId=11857 Highlights New features and efforts talk: Gianluca • Help with Associations: lar::PtrMaker (more readable than CreateAssn()) • Incremental Improvements to build system • Lots of work put into CI tests • Examples • Documentation 18 June 27, 2016 Tom Junk | Workshop Highlights
LArSoft Workshop Highlights • Recommended talks on Code Review (Rob Kutchke, Erica Snider) • See also Robert Hatcher's detailed view of GENIE and GENIEHelper in nutools • Very Useful how-to-profile talk from Chris Jones – how to use igprof (I watched Mike Wallbank profile his BlurredCluster module in minutes by copying and pasting commands out of Chris's talk given immediately before). • Expect more code reviews in the future – In LBNE we had them as part of the requirements docuemnt, which is now copied into the Computing Model, DocDB 914 19 June 27, 2016 Tom Junk | Workshop Highlights
Extras 20 June 27, 2016 Tom Junk | Workshop Highlights
Igor Mandrichenko 21 June 27, 2016 Tom Junk | Workshop Highlights
Igor Mandrichenko 22 June 27, 2016 Tom Junk | Workshop Highlights
Recommend
More recommend
