t t - - PowerPoint PPT Presentation
t t trtr r s Prr ss s t s
✷ ✴ ✷✹
✷ ✴ ✷✹
✷ ✴ ✷✹
✷ ✴ ✷✹
✷ ✴ ✷✹
P❛r❛❧❧❡❧ s✐♠✉❧❛t✐♦♥ ♦❢ s✉♣❡rs❝❛❧❛r s❝❤❡❞✉❧✐♥❣✱ ❍❛✉❣❡♥✱ ❑✉r③❛❦✱ ❨❛r❑❤❛♥✱ ❉♦♥❣❛rr❛✳ ■❈PP ✷✵✶✹✳ ❚❤❡ ◗❘ ❢❛❝t♦r✐③❛t✐♦♥ ♦❢ ❛ ♠❛tr✐① ✭s✐③❡✿ ✸✾✻✵❀ t✐❧❡s s✐③❡✿ ✶✽✵✮ ❚❤❡ ◗❯❆❘❑ s❝❤❡❞✉❧❡r✿ ✹✽ ❝♦r❡s ✭♦♥❡ ♥♦❞❡✮✳ ❚❤❡ ❈❤♦❧❡s❦② ❢❛❝t♦r✐③❛t✐♦♥ ♦❢ ❛ ♠❛tr✐① ✭s✐③❡✿ ✹✼✵✹✵❀ t✐❧❡s s✐③❡✿ ✾✻✵✮ ❚❤❡ ✏▼P■✲❆✇❛r❡✑ ❉▼❉❆❙ s❝❤❡❞✉❧❡r ♦❢ ❙t❛rP❯✰▼P■✿ ✷ ♥♦❞❡s ✇✐t❤ ✹ ❝♦r❡s ❛♥❞ ✹ ●P❯s ❡❛❝❤✳ ✸ ✴ ✷✹
P❛r❛❧❧❡❧ s✐♠✉❧❛t✐♦♥ ♦❢ s✉♣❡rs❝❛❧❛r s❝❤❡❞✉❧✐♥❣✱ ❍❛✉❣❡♥✱ ❑✉r③❛❦✱ ❨❛r❑❤❛♥✱ ❉♦♥❣❛rr❛✳ ■❈PP ✷✵✶✹✳ ❚❤❡ ◗❘ ❢❛❝t♦r✐③❛t✐♦♥ ♦❢ ❛ ♠❛tr✐① ✭s✐③❡✿ ✸✾✻✵❀ t✐❧❡s s✐③❡✿ ✶✽✵✮ ❚❤❡ ◗❯❆❘❑ s❝❤❡❞✉❧❡r✿ ✹✽ ❝♦r❡s ✭♦♥❡ ♥♦❞❡✮✳ ❚❤❡ ❈❤♦❧❡s❦② ❢❛❝t♦r✐③❛t✐♦♥ ♦❢ ❛ ♠❛tr✐① ✭s✐③❡✿ ✹✼✵✹✵❀ t✐❧❡s s✐③❡✿ ✾✻✵✮ ❚❤❡ ✏▼P■✲❆✇❛r❡✑ ❉▼❉❆❙ s❝❤❡❞✉❧❡r ♦❢ ❙t❛rP❯✰▼P■✿ ✷ ♥♦❞❡s ✇✐t❤ ✹ ❝♦r❡s ❛♥❞ ✹ ●P❯s ❡❛❝❤✳ ✸ ✴ ✷✹
✹ ✴ ✷✹
❚✐❧❡❞ ❈❤♦❧❡s❦② ❋❛❝t♦r✐③❛t✐♦♥ ❙❚❋✿ ❙❡q✉❡♥t✐❛❧ ❚❛s❦ ❋❧♦✇ ✭s✐♥❣❧❡✲t❤r❡❛❞❡❞ ❛♣♣❧✐❝❛t✐♦♥ ❝♦❞❡✮
for (k = 0; k < N; k++) { DPOTRF(RW,A[k][k]); for (i = k+1; i < N; i++) DTRSM(RW,A[i][k], R,A[k][k]); for (i = k+1; i < N; i++) { DSYRK(RW,A[i][i], R,A[i][k]); for (j = k+1; j < i; j++) DGEMM(RW,A[i][j], R,A[i][k], R,A[j][k]); } }
dpotrf 0 dtrsm 0 dtrsm 0 dtrsm 0 dtrsm 0 dsyrk 0 dgemm 0 dgemm 0 dgemm 0 dsyrk 0 dgemm 0 dgemm 0 dsyrk 0 dgemm 0 dsyrk 0 dpotrf 1 dtrsm 1 dtrsm 1 dtrsm 1 dsyrk 1 dgemm 1 dgemm 1 dsyrk 1 dgemm 1 dsyrk 1 dpotrf 2 dtrsm 2 dtrsm 2 dsyrk 2 dgemm 2 dsyrk 2 dpotrf 3 dtrsm 3 dsyrk 3 dpotrf 4
✺ ✴ ✷✹
❚✐❧❡❞ ❈❤♦❧❡s❦② ❋❛❝t♦r✐③❛t✐♦♥ ❙❚❋✿ ❙❡q✉❡♥t✐❛❧ ❚❛s❦ ❋❧♦✇ ✭s✐♥❣❧❡✲t❤r❡❛❞❡❞ ❛♣♣❧✐❝❛t✐♦♥ ❝♦❞❡✮
for (k = 0; k < N; k++) { DPOTRF(RW,A[k][k]); for (i = k+1; i < N; i++) DTRSM(RW,A[i][k], R,A[k][k]); for (i = k+1; i < N; i++) { DSYRK(RW,A[i][i], R,A[i][k]); for (j = k+1; j < i; j++) DGEMM(RW,A[i][j], R,A[i][k], R,A[j][k]); } }
dpotrf 0 dtrsm 0 dtrsm 0 dtrsm 0 dtrsm 0 dsyrk 0 dgemm 0 dgemm 0 dgemm 0 dsyrk 0 dgemm 0 dgemm 0 dsyrk 0 dgemm 0 dsyrk 0 dpotrf 1 dtrsm 1 dtrsm 1 dtrsm 1 dsyrk 1 dgemm 1 dgemm 1 dsyrk 1 dgemm 1 dsyrk 1 dpotrf 2 dtrsm 2 dtrsm 2 dsyrk 2 dgemm 2 dsyrk 2 dpotrf 3 dtrsm 3 dsyrk 3 dpotrf 4
✺ ✴ ✷✹
❚✐❧❡❞ ❈❤♦❧❡s❦② ❋❛❝t♦r✐③❛t✐♦♥ ❙❚❋✿ ❙❡q✉❡♥t✐❛❧ ❚❛s❦ ❋❧♦✇ ✭s✐♥❣❧❡✲t❤r❡❛❞❡❞ ❛♣♣❧✐❝❛t✐♦♥ ❝♦❞❡✮
for (k = 0; k < N; k++) { DPOTRF(RW,A[k][k]); for (i = k+1; i < N; i++) DTRSM(RW,A[i][k], R,A[k][k]); for (i = k+1; i < N; i++) { DSYRK(RW,A[i][i], R,A[i][k]); for (j = k+1; j < i; j++) DGEMM(RW,A[i][j], R,A[i][k], R,A[j][k]); } }
dpotrf 0 dtrsm 0 dtrsm 0 dtrsm 0 dtrsm 0 dsyrk 0 dgemm 0 dgemm 0 dgemm 0 dsyrk 0 dgemm 0 dgemm 0 dsyrk 0 dgemm 0 dsyrk 0 dpotrf 1 dtrsm 1 dtrsm 1 dtrsm 1 dsyrk 1 dgemm 1 dgemm 1 dsyrk 1 dgemm 1 dsyrk 1 dpotrf 2 dtrsm 2 dtrsm 2 dsyrk 2 dgemm 2 dsyrk 2 dpotrf 3 dtrsm 3 dsyrk 3 dpotrf 4
✺ ✴ ✷✹
❚✐❧❡❞ ❈❤♦❧❡s❦② ❋❛❝t♦r✐③❛t✐♦♥ ❢r♦♠ ❙t❛rP❯✰▼P■ ✈✐s✉❛❧✐③❡❞ ✇✐t❤ ❱✐❚❊✳ ✻ ✴ ✷✹
✼ ✴ ✷✹
✽ ✴ ✷✹
✽ ✴ ✷✹
static plots interactive
Cleanups Filtering Statistics Visualization
Execution/Tracing (FXT)
❊①tr❡♠❡❧② s✐♠♣❧✐✜❡❞ ♣❡r❢♦r♠❛♥❝❡ ❛♥❛❧②s✐s ✇♦r❦✢♦✇ ✭s❡❡ ♦✉r ♣❛♣❡r ❛t ❱P❆ ✷✵✶✻✮✳
✾ ✴ ✷✹
static plots interactive
Cleanups Filtering Statistics Visualization
Execution/Tracing (FXT)
❊①tr❡♠❡❧② s✐♠♣❧✐✜❡❞ ♣❡r❢♦r♠❛♥❝❡ ❛♥❛❧②s✐s ✇♦r❦✢♦✇ ✭s❡❡ ♦✉r ♣❛♣❡r ❛t ❱P❆ ✷✵✶✻✮✳
✾ ✴ ✷✹
dpotrf 0 dtrsm 0 dtrsm 0 dtrsm 0 dtrsm 0 dsyrk 0 dgemm 0 dgemm 0 dgemm 0 dsyrk 0 dgemm 0 dgemm 0 dsyrk 0 dgemm 0 dsyrk 0 dpotrf 1 dtrsm 1 dtrsm 1 dtrsm 1 dsyrk 1 dgemm 1 dgemm 1 dsyrk 1 dgemm 1 dsyrk 1 dpotrf 2 dtrsm 2 dtrsm 2 dsyrk 2 dgemm 2 dsyrk 2 dpotrf 3 dtrsm 3 dsyrk 3 dpotrf 4
✶✵ ✴ ✷✹
dpotrf 0 dtrsm 0 dtrsm 0 dtrsm 0 dtrsm 0 dsyrk 0 dgemm 0 dgemm 0 dgemm 0 dsyrk 0 dgemm 0 dgemm 0 dsyrk 0 dgemm 0 dsyrk 0 dpotrf 1 dtrsm 1 dtrsm 1 dtrsm 1 dsyrk 1 dgemm 1 dgemm 1 dsyrk 1 dgemm 1 dsyrk 1 dpotrf 2 dtrsm 2 dtrsm 2 dsyrk 2 dgemm 2 dsyrk 2 dpotrf 3 dtrsm 3 dsyrk 3 dpotrf 4
✶✵ ✴ ✷✹
▲❛r❣❡ ♠❛tr✐① ✭s✐③❡✿ ✻✵×✻✵❀ t✐❧❡s s✐③❡✿ ✾✻✵✮✳ ▼❡❞✐✉♠ ✭s✐③❡✿ ✶✷×✶✷✮
ready 62725 CPE 2149 ABE 59464 0.39% 0.55% 0.63% 0.69% 0.86% 0.96% 1.01% 0.94% 0.96% 0.96% 1.00% 0.89% 0.91% 0.93% 0.99% 0.95% 0.99% 0.95% 0.99% 1.08% 1.02% 1.10% 1.04% 1.04% 1.04% 5.90% 1.90% 2.00% submitted CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11 CPU12 CPU13 CPU14 CPU15 CPU16 CPU17 CPU18 CPU19 CPU20 CPU21 CPU22 CPU23 CPU24 CUDA0 CUDA1 CUDA2 20 40 60 500 1000 20000 40000 60000 10000 20000 30000 Resources k iteration dgemm dpotrf dsyrk dtrsm Idle/Sleeping 20000 40000 60000 Time [ms] # tasks dgemm dpotrf dsyrk dtrsm 5000 10000 15000 20000 20 40 60 500 1000 1500 500 1000 1500 CPU CUDA # of tasks 730 CPE 368 ABE 434 CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11 CPU12 CPU13 CPU14 CPU15 CPU16 CPU17 CPU18 CPU19 CPU20 CPU21 CPU22 CPU23 CPU24 CUDA0 CUDA1 CUDA2 200 400 600
Time [ms] Resources dgemm dpotrf dsyrk dtrsm Idle/Sleeping Critical Paths 1 2
✶✶ ✴ ✷✹
❉❡♥s❡ ❝❤♦❧❡s❦② ❢❛❝t♦r✐③❛t✐♦♥ ♦❢ ❧❛r❣❡ ♠❛tr✐① ✭s✐③❡✿ ✻✵×✻✵❀ t✐❧❡s s✐③❡✿ ✾✻✵✮✳ ✶✷ ✴ ✷✹
❉❡♥s❡ ❝❤♦❧❡s❦② ❢❛❝t♦r✐③❛t✐♦♥ ♦❢ ❧❛r❣❡ ♠❛tr✐① ✭s✐③❡✿ ✻✵×✻✵❀ t✐❧❡s s✐③❡✿ ✾✻✵✮✳ ✶✷ ✴ ✷✹
❉❡♥s❡ ❝❤♦❧❡s❦② ❢❛❝t♦r✐③❛t✐♦♥ ♦❢ ❧❛r❣❡ ♠❛tr✐① ✭s✐③❡✿ ✻✵×✻✵❀ t✐❧❡s s✐③❡✿ ✾✻✵✮✳
■❞❧❡♥❡ss✿ ≈ ✶✪ ❢♦r ❈P❯s✱ ≈ ✷✕✻✪ ❢♦r ●P❯s ❆❇❊ ✐s ≈ ✺✪ ❧❡ss t❤❛♥ t♦t❛❧ ♠❛❦❡s♣❛♥ ❚❛s❦ r❡♣❛rt✐t✐♦♥ ✐s ♥♦t ♦♣t✐♠❛❧
✶✷ ✴ ✷✹
❉❡♥s❡ ❝❤♦❧❡s❦② ❢❛❝t♦r✐③❛t✐♦♥ ♦❢ ❧❛r❣❡ ♠❛tr✐① ✭s✐③❡✿ ✻✵×✻✵❀ t✐❧❡s s✐③❡✿ ✾✻✵✮✳ ✶✸ ✴ ✷✹
❉❡♥s❡ ❝❤♦❧❡s❦② ❢❛❝t♦r✐③❛t✐♦♥ ♦❢ ❧❛r❣❡ ♠❛tr✐① ✭s✐③❡✿ ✻✵×✻✵❀ t✐❧❡s s✐③❡✿ ✾✻✵✮✳
▲❡✈❡❧ ♦❢ ♣❛r❛❧❧❡❧✐s♠✿ ♠❛①✐♠✉♠ ♦❢ ✸✵ ✐t❡r❛t✐♦♥s ≈ ✹✵s
✶✸ ✴ ✷✹
❉❡♥s❡ ❝❤♦❧❡s❦② ❢❛❝t♦r✐③❛t✐♦♥ ♦❢ ❧❛r❣❡ ♠❛tr✐① ✭s✐③❡✿ ✻✵×✻✵❀ t✐❧❡s s✐③❡✿ ✾✻✵✮✳ ✶✹ ✴ ✷✹
❉❡♥s❡ ❝❤♦❧❡s❦② ❢❛❝t♦r✐③❛t✐♦♥ ♦❢ ❧❛r❣❡ ♠❛tr✐① ✭s✐③❡✿ ✻✵×✻✵❀ t✐❧❡s s✐③❡✿ ✾✻✵✮✳
❉❆● tr❛✈❡rs❛❧ ✐s ❞❡♣t❤✲✜rst✳
✶✹ ✴ ✷✹
✶✺ ✴ ✷✹
CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11 CPU12 CPU13 CPU14 CPU15 CPU16 CPU17 CPU18 CPU19 CPU20 CPU21 CPU22 CPU23 CPU24 CUDA0 CUDA1 CUDA2 Resources 20 40 60 k iteration 5000 10000 15000 20000 # tasks 66965 CPE 2201 ABE 59748 0.7% 0.9% 1.0% 0.9% 0.9% 1.0% 1.0% 0.8% 1.0% 1.0% 1.0% 0.9% 0.9% 1.0% 1.3% 1.3% 1.2% 1.3% 1.4% 1.4% 1.6% 1.5% 1.6% 1.4% 1.6% 20.6% 20.2% 19.9% 62725 CPE 2149 ABE 59464 0.4% 0.6% 0.6% 0.7% 0.9% 1.0% 1.0% 0.9% 1.0% 1.0% 1.0% 0.9% 0.9% 0.9% 1.0% 1.0% 1.0% 0.9% 1.0% 1.1% 1.0% 1.1% 1.0% 1.0% 1.0% 5.9% 1.9% 2.0% 60987 CPE 2146 ABE 58452 1.1% 1.3% 1.2% 1.3% 1.3% 1.5% 1.4% 1.4% 1.5% 1.5% 1.3% 1.4% 1.2% 1.3% 1.5% 1.5% 1.5% 1.5% 1.4% 1.5% 1.5% 1.5% 1.4% 1.4% 1.5% 4.0% 2.2% 2.2% 20 40 60 500 1000 1500 500 1000 1500 5000 10000 15000 20000 20 40 60 500 1000 1500 500 1000 1500 5000 10000 15000 20000 20 40 60 500 1000 1500 500 1000 1500 20000 40000 60000 20000 40000 60000 20000 40000 60000 dgemm dpotrf dsyrk dtrsm Idle/Sleeping 20000 40000 60000 20000 40000 60000 20000 40000 60000 Time [ms] CPU CUDA CPU CUDA CPU CUDA CPU CUDA CPU CUDA CPU CUDA CPU CUDA CPU CUDA CPU CUDA CPU CUDA CPU CUDA CPU CUDA 64061 CPE 2114 ABE 60004 12.5% 12.8% 12.3% 11.6% 13.5% 13.6% 14.6% 14.3% 12.0% 11.6% 11.2% 3.2% 2.7% 3.1% 3.7% 3.8% 3.1% 2.6% 3.7% 4.0% 4.1% 3.7% 2.9% 3.9% 3.0% 3.6% 2.2% 2.6% 60174 CPE 2159 ABE 59017 1.0% 0.8% 1.1% 1.3% 1.3% 1.5% 1.5% 1.7% 1.7% 1.8% 1.8% 1.8% 1.9% 2.0% 2.0% 2.1% 2.3% 2.3% 2.3% 2.2% 2.3% 2.3% 2.5% 2.5% 2.4% 2.5% 1.1% 0.9% 59577 CPE 2160 ABE 57603 0.9% 1.3% 0.9% 1.0% 1.0% 0.9% 1.0% 1.1% 0.9% 0.9% 1.0% 1.0% 0.9% 1.1% 1.1% 1.0% 1.2% 1.0% 1.2% 1.0% 1.1% 1.1% 1.2% 0.9% 0.9% 3.2% 1.4% 1.4% CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11 CPU12 CPU13 CPU14 CPU15 CPU16 CPU17 CPU18 CPU19 CPU20 CPU21 CPU22 CPU23 CPU24 CUDA0 CUDA1 CUDA2 20 40 60 20000 40000 60000 20000 40000 60000 20000 40000 60000 20000 40000 60000 20000 40000 60000 20000 40000 60000 Time [ms] Resources k iteration dgemm dpotrf dsyrk dtrsm Idle/Sleeping 5000 10000 15000 20000 20 40 60 500 1000 1500 500 1000 1500 5000 10000 15000 20000 20 40 60 500 1000 1500 500 1000 1500 5000 10000 15000 20000 20 40 60 500 1000 1500 500 1000 1500 CPU CUDA CPU CUDA CPU CUDA CPU CUDA CPU CUDA CPU CUDA CPU CUDA CPU CUDA CPU CUDA CPU CUDA CPU CUDA CPU CUDA # tasks
✶✺ ✴ ✷✹
❙♠❛❧❧ ✭s✐③❡✿ ✶✷×✶✷✮
730 CPE 368 ABE 434 CPU0 CPU1 CPU2 CPU3 CPU4 CPU5 CPU6 CPU7 CPU8 CPU9 CPU10 CPU11 CPU12 CPU13 CPU14 CPU15 CPU16 CPU17 CPU18 CPU19 CPU20 CPU21 CPU22 CPU23 CPU24 CUDA0 CUDA1 CUDA2 200 400 600 Time [ms] Resources dgemm dpotrf dsyrk dtrsm Idle/Sleeping Critical Paths 1 2
✶✻ ✴ ✷✹
✶✼ ✴ ✷✹
✶✼ ✴ ✷✹
✶✽ ✴ ✷✹
✶✽ ✴ ✷✹
✶✾ ✴ ✷✹
❈❤♦❧❡s❦② ✺✵×✺✵❀ ✐♥ ✷ ♥♦❞❡s ✇✐t❤ ✼ ❝♦r❡s ✰ ✹ ●P❯s ❡❛❝❤✳ ✷✵ ✴ ✷✹
❋✐rst ✶✳✺ s❡❝♦♥❞s ♦❢ t❤❡ ❡①❡❝✉t✐♦♥✿ s❡❡ t❤❡ ❞❡❧❛②❡❞ st❛rt✳ ✷✵ ✴ ✷✹
❆❢t❡r ✜①✐♥❣ t❤❡ ♣r♦❜❧❡♠ ✭✷ ♥♦❞❡s ✇✐t❤ ✹ ❝♦r❡s ✰ ✹ ●P❯s ❡❛❝❤✮✳ ✷✵ ✴ ✷✹
❱✐s✉❛❧ ❝♦♠♣❛r✐s♦♥✿ s❡❡ t❤❡ ❝♦rr❡s♣♦♥❞✐♥❣ ♠❛❦❡s♣❛♥ r❡❞✉❝t✐♦♥✳ ✷✵ ✴ ✷✹
P ❂ ✶ ✷✶ ✴ ✷✹
P ❂ ✷ ✷✶ ✴ ✷✹
P ❂ ✹ ✷✶ ✴ ✷✹
P ❂ ✽ ✷✶ ✴ ✷✹
dag.dot paje.trace pj_dump pj_dump dot2csv dag.csv paje.state.csv paje.variable.csv paje.link.csv Experiment StarPU+MPI Preprocess bash paje.hierarchy.csv ZERO read_csv
y_coordin. tree_filter left_join dfstate read_csv dfvariable read_csv dflink read_csv dfdag left_join CPB Node ABE Idleness Reading R ST Iteration Ready filter Submitted
GFlops GPU Band. MPI Band. Plotting R Master sync read_csv
Org-Mode Workflow Arrange R
✷✷ ✴ ✷✹
✷✸ ✴ ✷✹
✷✸ ✴ ✷✹
✷✸ ✴ ✷✹
✷✹ ✴ ✷✹