uni lu hpc school 2019
play

Uni.lu HPC School 2019 PS4b: Monitoring & Profiling II: - PowerPoint PPT Presentation

Dec 29, 2023 •128 likes •668 views

Uni.lu HPC School 2019 PS4b: Monitoring & Profiling II: Advanced Performance engineering Uni.lu High Performance Computing (HPC) Team V. Plugaru, X. Besseron University of Luxembourg (UL), Luxembourg http://hpc.uni.lu V. Plugaru, X.

  1. Uni.lu HPC School 2019 PS4b: Monitoring & Profiling II: Advanced Performance engineering Uni.lu High Performance Computing (HPC) Team V. Plugaru, X. Besseron University of Luxembourg (UL), Luxembourg http://hpc.uni.lu V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 1 / 32 �

  2. Latest versions available on Github : UL HPC tutorials: https://github.com/ULHPC/tutorials UL HPC School: http://hpc.uni.lu/hpc-school/ PS4b tutorial sources: ulhpc-tutorials.rtfd.io/en/latest/debugging/advanced/ V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 2 / 32 �

  3. Introduction Summary 1 Introduction 2 Debugging and profiling tools 3 Conclusion V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 3 / 32 �

  4. Introduction Foreword So we have some news... V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 4 / 32 �

  5. Introduction Foreword V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 4 / 32 �

  6. Introduction Foreword V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 4 / 32 �

  7. Introduction Foreword V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 4 / 32 �

  8. Introduction Foreword V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 4 / 32 �

  9. Introduction Foreword V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 4 / 32 �

  10. Introduction Foreword V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 4 / 32 �

  11. Introduction Foreword V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 4 / 32 �

  12. Introduction Foreword V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 4 / 32 �

  13. Introduction Foreword V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 4 / 32 �

  14. Introduction Foreword V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 4 / 32 �

  15. Introduction Foreword V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 4 / 32 �

  16. Introduction MeluXina National Supercomputer MeluXina - coming in 2020 10 PetaFlop supercomputer Modular architecture covering a wide variety of needs High performance network & storage for HPC, BigData & AI V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 5 / 32 �

  17. Introduction MeluXina National Supercomputer MeluXina - coming in 2020 10 PetaFlop supercomputer Modular architecture covering a wide variety of needs High performance network & storage for HPC, BigData & AI What this means for you Algorithms and applications must be run at scale Code development will play a large role Need to use different computing elements and memory hierarchy → will play a critical role in your application performance ֒ V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 5 / 32 �

  18. Introduction Main Objectives of this Session This session is meant to show you some of the various tools you have at your disposal on the UL HPC platform to: Theorize Model understand and solve development & runtime problems Develop understand and improve application performance Compute Simulate Experiment Analyze V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 6 / 32 �

  19. Introduction Main Objectives of this Session This session is meant to show you some of the various tools you have at your disposal on the UL HPC platform to: Theorize Model understand and solve development & runtime problems Develop understand and improve application performance During the session we will (also): Compute Simulate discuss what happens when an application runs out of Experiment memory and how to discover how much memory it actually requires. Analyze see debugging tools that help you understand why your code is crashing . see profiling tools that show the bottlenecks of your code - and how to improve it. V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 6 / 32 �

  20. Introduction Main Objectives of this Session This session is meant to show you some of the various tools you have at your disposal on the UL HPC platform to: Theorize Model understand and solve development & runtime problems Develop understand and improve application performance During the session we will (also): Compute Simulate discuss what happens when an application runs out of Experiment memory and how to discover how much memory it actually requires. Analyze see debugging tools that help you understand why your code is crashing . see profiling tools that show the bottlenecks of your code - and how to improve it. Knowing what to do when you experience a problem is half the battle. V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 6 / 32 �

  21. Debugging and profiling tools Summary 1 Introduction 2 Debugging and profiling tools 3 Conclusion V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 7 / 32 �

  22. Debugging and profiling tools Tools at your disposal (I) Common tools used to understand problems Common tools at a glance: → htop : process/thread live CPU & memory utilization, affinity ֒ → strace : understand what system calls a process is making & ֒ where it gets ‘stuck’ → gdb : general purpose debugger ֒ → valgrind : memory debugging and profiling ֒ SLURM scheduler built-in tools and utilities: → sstat : running job and jobstep statistics ֒ → sacct : historic job and jobstep statistics ֒ → seff : postmortem CPU/memory utilization and efficiency ֒ Some times simple tools help you solve big issues. V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 8 / 32 �

  23. Debugging and profiling tools Tools at your disposal (II) HPC specific tools - Arm (prev. Allinea) Arm DDT (part of Arm Forge) → Visual debugger for C, C++, Fortran & Python // code ֒ Arm MAP (part of Arm Forge) → Visual profiler for C, C++, Fortran & Python ֒ Arm Performance Reports → Application characterization tool ֒ V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 9 / 32 �

  24. Debugging and profiling tools Tools at your disposal (II) HPC specific tools - Arm (prev. Allinea) Arm DDT (part of Arm Forge) → Visual debugger for C, C++, Fortran & Python // code ֒ Arm MAP (part of Arm Forge) → Visual profiler for C, C++, Fortran & Python ֒ Arm Performance Reports → Application characterization tool ֒ Arm tools are licensed license check integrated in SLURM: scontrol show license ask for licenses at job submission with e.g. srun -L forge:16 2019 software set being prepared, check new tools with module load swenv/default-env/devel && module avail V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 9 / 32 �

  25. Debugging and profiling tools Tools at your disposal (III) HPC specific tools - Intel Intel Advisor → Vectorization + threading advisor: check blockers and opport. ֒ Intel Inspector → Memory and thread debugger: check leaks/corrupt., data races ֒ Intel Trace Analyzer and Collector → MPI communications profiler and analyzer: evaluate patterns ֒ Intel VTune Amplifier → Performance profiler: CPU/FPU data, mem. + storage accesses ֒ V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 10 / 32 �

  26. Debugging and profiling tools Tools at your disposal (III) HPC specific tools - Intel Intel Advisor → Vectorization + threading advisor: check blockers and opport. ֒ Intel Inspector → Memory and thread debugger: check leaks/corrupt., data races ֒ Intel Trace Analyzer and Collector → MPI communications profiler and analyzer: evaluate patterns ֒ Intel VTune Amplifier → Performance profiler: CPU/FPU data, mem. + storage accesses ֒ Intel tools are licensed All come as part of Intel Parallel Studio XE - Cluster edition! V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 10 / 32 �

  27. Debugging and profiling tools Tools at your disposal (IV) HPC specific tools - Scalasca & friends Scalasca → Study behavior of // apps. & identify optimization opport. ֒ Score-P → Instrumentation tool for profiling, event tracing, online analysis. ֒ Extra-P → Automatic performance modeling tool for // apps. ֒ V. Plugaru, X. Besseron & Uni.lu HPC Team (University of Luxembourg) Uni.lu HPC School 2019/ PS4b 11 / 32 �

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Fo Form One Information Day nd No 2 nd November 2019 7/11/2019 1 1 2 SCHOOL CONTEXT SCHOOL

Fo Form One Information Day nd No 2 nd November 2019 7/11/2019 1 1 2 SCHOOL CONTEXT SCHOOL

11/7/19 Fo Form One Information Day nd No 2 nd November 2019 7/11/2019 1 1 2 SCHOOL CONTEXT SCHOOL CONTEXT Area of school: around 28000 sq meters History of the school In the form of a quadrangle: North Wing Founded by the

422 views • 7 slides
BOND MAY 2019 DEVINE INDEPENDENT SCHOOL DISTRICT JOHN J. CIAVARRA ELEMENTARY SCHOOL DEVINE

BOND MAY 2019 DEVINE INDEPENDENT SCHOOL DISTRICT JOHN J. CIAVARRA ELEMENTARY SCHOOL DEVINE

BOND MAY 2019 DEVINE INDEPENDENT SCHOOL DISTRICT JOHN J. CIAVARRA ELEMENTARY SCHOOL DEVINE INTERMEDIATE SCHOOL DEVINE MIDDLE SCHOOL DEVINE HIGH SCHOOL March 25, 2019 School Board Scott Sostarich - Superintendent Nancy Pepper President

647 views • 31 slides
The State of the School 2019-2020 Parents & School as Partners One School Mission and

The State of the School 2019-2020 Parents & School as Partners One School Mission and

The State of the School 2019-2020 Parents & School as Partners One School Mission and Philosophy Strategic Planning Branding Curriculum development Finances Policies, procedures, and practices Strengths Mission People Reputation

454 views • 31 slides
I MPACT OF COVID-19 ON 2019-2020 S CHOOL Y EAR Presentations as scheduled in 2019-2020: 144

I MPACT OF COVID-19 ON 2019-2020 S CHOOL Y EAR Presentations as scheduled in 2019-2020: 144

D ONATE L IFE E DUCATORS 2020-2021 School Program O VERVIEW Impact of COVID-19 on 2019-2020 School Year Changes for this school year Overview of the School Outreach Program Expectations and training process for Donate Life

937 views • 26 slides
School Councils Sept. 25, 2019 1 2 Tonights Agenda 7:00 p.m. Welcome, introductions,

School Councils Sept. 25, 2019 1 2 Tonights Agenda 7:00 p.m. Welcome, introductions,

Council of School Councils Sept. 25, 2019 1 2 Tonights Agenda 7:00 p.m. Welcome, introductions, housekeeping 7:05 p.m. System updates Budget 2019-20 High school engagement School support model Bullying review

538 views • 34 slides
2019 2020 School Year Calendar 2019 2020 School Year Calendar Survey March 27, 2019,

2019 2020 School Year Calendar 2019 2020 School Year Calendar Survey March 27, 2019,

2019 2020 School Year Calendar 2019 2020 School Year Calendar Survey March 27, 2019, through April 5, 2019 Available in English and Spanish Objectives: Do respondents want to add four days to the end of the school year,

438 views • 15 slides
Date Time Meetings Place November 12, 2019 6:00 pm All Committees & Special Meeting

Date Time Meetings Place November 12, 2019 6:00 pm All Committees & Special Meeting

School Board Meeting Agenda October 22, 2019 Page 1 of 9 C OATESVILLE AREA SCHOOL DISTRICT SCHOOL BOARD MEETING AGENDA Coatesville Area Senior High School Auditorium OCTOBER 22, 2019 - 7:00 PM OPENING ACTIVITIES 1. CALL TO ORDER 2. READING OF

375 views • 9 slides
The Hidden Side of Transracial Adoptees POCC 2019: December 6, 2019 Tina Fox The Park School,

The Hidden Side of Transracial Adoptees POCC 2019: December 6, 2019 Tina Fox The Park School,

The Hidden Side of Transracial Adoptees POCC 2019: December 6, 2019 Tina Fox The Park School, MA Amanda Friedman Miss Porter's School, CT PRESENTERS Matt Goldman Burgundy Farm Country Day School, VA Jenny Hammond Deerfield Academy, MA

691 views • 21 slides
Back to School Night & State of the School Address September 10 & 12, 2019 St. Rita

Back to School Night & State of the School Address September 10 & 12, 2019 St. Rita

Back to School Night & State of the School Address September 10 & 12, 2019 St. Rita School Mission St. Rita School inspires students in pre-kindergarten through grade eight to achieve academic excellence in a safe, nurturing, and

496 views • 24 slides
FRAMINGHAM HIGH SCHOOL SPACE NEEDS STUDY 2019 UPDATE SCHOOL COMMITTEE PRESENTATION MAY 1, 2019

FRAMINGHAM HIGH SCHOOL SPACE NEEDS STUDY 2019 UPDATE SCHOOL COMMITTEE PRESENTATION MAY 1, 2019

FRAMINGHAM HIGH SCHOOL SPACE NEEDS STUDY 2019 UPDATE SCHOOL COMMITTEE PRESENTATION MAY 1, 2019 TBA ARCHITECTS, INC. 43 BRADFORD ST. CONCORD, MA 01742 WWW.TBAARCHITECTS.COM JUSTIN HUMPHREYS, AIA, PRINCIPAL Framingham High School Space Needs

922 views • 14 slides
2019 School of Education Associate Instructor Orientation Dr. Kathryn Engebretson School of

2019 School of Education Associate Instructor Orientation Dr. Kathryn Engebretson School of

2019 School of Education Associate Instructor Orientation Dr. Kathryn Engebretson School of Education Michael Valliant , Director Service-Learning Program, CITL August 16, 2019 Agenda 1. Outcomes 2. Guiding question 3. Features of

300 views • 26 slides
School Selection Process Admission, August 2019 What is the School Selection Process? The School

School Selection Process Admission, August 2019 What is the School Selection Process? The School

School Selection Process Admission, August 2019 What is the School Selection Process? The School Selection Process allows students entering all grades (K-12), to apply to School District of Philadelphia Schools ONLY (including different

395 views • 27 slides
2019-2020 School Year Budget Planning School Board Work Session May 1, 2019 Presentation

2019-2020 School Year Budget Planning School Board Work Session May 1, 2019 Presentation

2019-2020 School Year Budget Planning School Board Work Session May 1, 2019 Presentation Objectives Provide a Legislative Update Discuss Updated Revenue and Expenditure Assumptions Review Budget Reduction Considerations SPS Budget

494 views • 14 slides
Brunswick School Department 2019 Budget Presentation Region Ten Technical High School

Brunswick School Department 2019 Budget Presentation Region Ten Technical High School

Brunswick School Department 2019 Budget Presentation Region Ten Technical High School Merrymeeting Adult Education School Administration System wide Administration/Business Office/School Board Professional Development Debt Service Curriculum

232 views • 22 slides
Lionville Middle School 2019-2020 Course Selection Night January 30, 2019 2 Lionville Middle

Lionville Middle School 2019-2020 Course Selection Night January 30, 2019 2 Lionville Middle

Lionville Middle School 2019-2020 Course Selection Night January 30, 2019 2 Lionville Middle School Administrative Team Principal Mr. Jonathan Ross Assistant Principals Dr. David Wiedlich Mr. Travis Orth 3 Pupil Services Team School

475 views • 35 slides
Ro Rousseau McClellan Montessori School 91 State of the School, September 2019 Ov Overvi view

Ro Rousseau McClellan Montessori School 91 State of the School, September 2019 Ov Overvi view

Ro Rousseau McClellan Montessori School 91 State of the School, September 2019 Ov Overvi view 2 A School Profile 1 School Data B Focus Area Goals and Strategies C 2 D Quarterly Data Professional Development Update E 3 F Family

497 views • 28 slides
(Hierarchical) Identity-Based Encryption from Affine Message Authentication Crypto 2014 , Olivier

(Hierarchical) Identity-Based Encryption from Affine Message Authentication Crypto 2014 , Olivier

(Hierarchical) Identity-Based Encryption from Affine Message Authentication Crypto 2014 , Olivier Blazy Eike Kiltz Jiaxin Pan Horst Grtz Institute for IT Security Ruhr-University Bochum 1 Introduction 2 Affine MAC 3 From Affine MAC to IBE 4

880 views • 58 slides
CCA-Secure Keyed-Fully Homomorphic Encryption Junzuo Lai, Robert H. Deng, Changshe Ma, Kouichi

CCA-Secure Keyed-Fully Homomorphic Encryption Junzuo Lai, Robert H. Deng, Changshe Ma, Kouichi

Introduction CCA-Secure Keyed-Fully Homomorphic Encryption Junzuo Lai, Robert H. Deng, Changshe Ma, Kouichi Sakurai and Jian Weng 1 / 26 Introduction Outline Background Related Work CCA-Secure Keyed-Fully Homomorphic Encryption Conclusion

686 views • 26 slides
HPS, A New Microarchitecture: Rationale and Introduction Yale N. Patt, Wen-mei Hwo, and Michael

HPS, A New Microarchitecture: Rationale and Introduction Yale N. Patt, Wen-mei Hwo, and Michael

HPS, A New Microarchitecture: Rationale and Introduction Yale N. Patt, Wen-mei Hwo, and Michael Shebanow Big Picture Three levels of paralellism Big -- threads Medium -- the compiler Small -- hardware Their focus Myopic,

317 views • 8 slides
Microarchitectural Attacks and Heterogenous Cloud Computing By Daniel Moghimi PhD Candidate

Microarchitectural Attacks and Heterogenous Cloud Computing By Daniel Moghimi PhD Candidate

Microarchitectural Attacks and Heterogenous Cloud Computing By Daniel Moghimi PhD Candidate Worcester Polytechnic Institute (WPI) @danielmgmi Outline Data Dependency SPOILER: Speculative Load Hazards Boost Rowhammer and Cache Attacks

663 views • 28 slides
Research vs Scholarship Yale Patt The University of Texas at Austin 80-in-2019, UPC, Barcelona

Research vs Scholarship Yale Patt The University of Texas at Austin 80-in-2019, UPC, Barcelona

Research vs Scholarship Yale Patt The University of Texas at Austin 80-in-2019, UPC, Barcelona July 2, 2019 What I want to do today Visions of the future Research or Scholarship Before I do any of that, Uris slide The slide

369 views • 9 slides
AFP and HPS Forward Proton Projects Marek Taevsk Institute of Physics, Academy of

AFP and HPS Forward Proton Projects Marek Taevsk Institute of Physics, Academy of

AFP and HPS Forward Proton Projects Marek Taevsk Institute of Physics, Academy of Sciences, Prague, Czech rep. LISHEP 2011, Rio de Janeiro - 09/07 2011 History Physics with AFP/HPS Movable Beam pipe Tracking and Timing detectors 1

348 views • 32 slides
Caches Out-of-order execution Data flow model Samira Khan Superscalar processor March

Caches Out-of-order execution Data flow model Samira Khan Superscalar processor March

3/21/17 Agenda Logistics Review from last lecture Caches Out-of-order execution Data flow model Samira Khan Superscalar processor March 21, 2017 Caches Final Exam AN AN IN-OR ORDER PIPELINE Integer add Combined

310 views • 13 slides
Physical Posters as Gateways to Context-aware Services for Mobile Devices Enrico Rukzio,

Physical Posters as Gateways to Context-aware Services for Mobile Devices Enrico Rukzio,

WMCSA 2004 December 2nd, Low Wood, Lake Windermere (UK) Physical Posters as Gateways to Context-aware Services for Mobile Devices Enrico Rukzio, Albrecht Schmidt, Heinrich Hussmann Media Informatics Group, University of Munich 1/18 Enrico

457 views • 19 slides

More recommend