Analysis report exam ination w ith Cube Bert W esarg Technische - PowerPoint PPT Presentation

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Analysis report exam ination w ith Cube Bert W esarg Technische Universität Dresden

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Cube  Parallel program analysis report exploration tools  Libraries for XML+ binary report reading & writing  Algebra utilities for report processing  GUI for interactive analysis exploration  Requires Qt4/ 5  Originally developed as part of the Scalasca toolset  Now available as a separate component  Can be installed independently of Score-P , e.g., on laptop or desktop  Latest release: Cube 4.3.2 (June 2015) PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 2

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Analysis presentation and exploration  Representation of values (severity matrix) Call path on three hierarchical axes  Performance property (metric) Property  Call path (program location)  System location (process/ thread)  Three coupled tree browsers Location  Cube displays severities  As value: for precise comparison  As color: for easy identification of hotspots  Inclusive value when closed & exclusive value when expanded  Customizable via display modes PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 3

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING I nclusive vs. exclusive values  Inclusive  Information of all sub-elements aggregated into single value  Exclusive  Information cannot be subdivided further int foo() { int a; a = 1 + 1; bar(); Exclusive Inclusive a = a + 1; return a; } PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 4

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Perform ance analysis steps  Reference preparation for validation  Program instrumentation  Summary measurement collection  Summary experiment scoring  Summary measurement collection with filtering  Summary analysis report examination  Event trace collection  Event trace examination & analysis PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 5

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING NPB-MZ-MPI / BT sum m ary analysis report exam ination  Interactive exploration % cube scorep_bt-mz_W_4x4_sum_filtered/profile.cubex with Cube or TAU ParaProf [CUBE GUI showing summary analysis report] (covered later) PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 6

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Analysis presentation What kind of How is it Where is it in the performance distributed across source code? metric? the processes/threads? In what context? PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 7

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Analysis report exploration ( opening view ) PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 8

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Metric selection Selecting the “Time” metric shows total execution time PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 9

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Expanding the system tree Distribution of selected metric for call path by process/thread PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 10

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Expanding the call tree Distribution of selected metric across the call tree Collapsed: inclusive value Expanded: exclusive value PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 11

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Selecting a call path Selection updates metric values shown in columns to the right PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 12

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Source-code view via context m enu Right-click opens context menu PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 13

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Source-code view Note : This feature depends on file and line number information provided by the instrumentation, i.e., it may not always be available PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 14

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Flat profile view Select flat view tab, expand all nodes, and sort by exclusive value PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 15

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Box plot view Box plot shows distribution across the system; with min/max/avg/median/quartiles PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 16

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Alternative display m odes Data can be shown in various percentage modes PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 17

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING I m portant display m odes  Absolute  Absolute value shown in seconds/ bytes/ counts  Selection percent  Value shown as percentage w.r.t. the selected node “on the left“ (metric/ call path)  Peer percent (system tree only)  Value shown as percentage relative to the maximum peer value PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 18

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Multiple selection Select multiple nodes with Ctrl-click PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 19

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Context-sensitive help Context-sensitive help available for all GUI items PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 20

VIRTUAL INSTITUTE – HIGH PRODUCTIVITY SUPERCOMPUTING Cube: Further inform ation  Parallel program analysis report exploration tools  Libraries for XML report reading & writing  Algebra utilities for report processing  GUI for interactive analysis exploration  Available under 3-clause BSD open-source license  Documentation & sources:  http: / / www.scalasca.org  User guide also part of installation:  ` cube-config --cube-dir` / share/ doc/ CubeGuide.pdf  Contact:  mailto: scalasca@fz-juelich.de PERFORMANCE ENGINEERING WITH SCORE-P AND VAMPIR, PASSAU, SEPTEMBER 15, 2015 21