Parallel Visualization and Analysis with ParaView on a Cray XT4 - - PowerPoint PPT Presentation

▶
parallel visualization and analysis with paraview on a
SMART_READER_LITE
LIVE PREVIEW

Parallel Visualization and Analysis with ParaView on a Cray XT4 - - PowerPoint PPT Presentation

Oct 26, 2022 179 likes •346 views

Parallel Visualization and Analysis with ParaView on a Cray XT4 John Patchett, Los Alamos National Laboratory James Ahrens, Los Alamos National Laboratory Sean Ahern, Oak Ridge National Laboratory David Pugmire, Oak Ridge National

slide-1
SLIDE 1

CUG 2009 Compute the Future 1

Operated by Los Alamos National Security, LLC for NNSA

U N C L A S S I F I E D

Parallel Visualization and Analysis with ParaView on a Cray XT4

John Patchett, Los Alamos National Laboratory James Ahrens, Los Alamos National Laboratory Sean Ahern, Oak Ridge National Laboratory David Pugmire, Oak Ridge National Laboratory

slide-2
SLIDE 2

CUG 2009 Compute the Future 2

Operated by Los Alamos National Security, LLC for NNSA

U N C L A S S I F I E D

Introduction

  • Cray supercomputers

getting bigger and faster

  • Data becoming larger and

more plentiful

  • Users can be at distance
  • Connections to the

supercomputer can be fast or slow

  • Interactive remote viz with

ParaView

slide-3
SLIDE 3

CUG 2009 Compute the Future 3

Operated by Los Alamos National Security, LLC for NNSA

U N C L A S S I F I E D

Previous Work

  • 2 papers at CUG last year

– Large Scale Visualization on the Cray XT3 Using ParaView – Parallel Analysis and Visualization on Cray Compute Node Linux

  • ParaView had been built on both the

Cray XT3 and an IBM BlueGene

slide-4
SLIDE 4

CUG 2009 Compute the Future 4

Operated by Los Alamos National Security, LLC for NNSA

U N C L A S S I F I E D

Approach

  • Intelligently guess a theoretical performance
  • read from lustre
  • Isosurface
  • Render
  • Composite
  • Send to Client
slide-5
SLIDE 5

CUG 2009 Compute the Future 5

Operated by Los Alamos National Security, LLC for NNSA

U N C L A S S I F I E D

Reading

  • Lustre
  • Large number of cores might be slow
  • Low number of cores might be slow
  • We performed very little work on this

– Set stripe size to 1MB – Set stripe Count to 32

slide-6
SLIDE 6

CUG 2009 Compute the Future 6

Operated by Los Alamos National Security, LLC for NNSA

U N C L A S S I F I E D

Rendering

  • OSMesa

– Offscreen GL

  • Parallel Rendering

– Requires Compositing – Trivially Parallel

slide-7
SLIDE 7

CUG 2009 Compute the Future 7

Operated by Los Alamos National Security, LLC for NNSA

U N C L A S S I F I E D

Compositing

  • Binary Swap
  • ICE-T
  • Network Intensive
  • Scales well
slide-8
SLIDE 8

CUG 2009 Compute the Future 8

Operated by Los Alamos National Security, LLC for NNSA

U N C L A S S I F I E D

Composite Timings

slide-9
SLIDE 9

CUG 2009 Compute the Future 9

Operated by Los Alamos National Security, LLC for NNSA

U N C L A S S I F I E D

Sending

  • Jaguar to LANL

– Between 10 and 11 Mbps – 1.4 MB/s (downhill, wind at back)

  • Time to send

– Function of image size (Render Window Size) – Don’t need to send Z buffer – Somewhat hard to measure

slide-10
SLIDE 10

CUG 2009 Compute the Future 10

Operated by Los Alamos National Security, LLC for NNSA

U N C L A S S I F I E D

ParaView

  • Open source model
  • Entities using/developing

– Laboratories

  • ANL, NCSA, EVL
  • LANL, LLNL, SNL
  • CEA, CHCH
  • ARL

– Universities

Stanford, UNC, Utah

– Commercial companies

  • GE, DuPont
  • Past agency funding

– NSF, NIH, DOE, DOD

  • Thousands of downloads / users
slide-11
SLIDE 11

CUG 2009 Compute the Future 11

Operated by Los Alamos National Security, LLC for NNSA

U N C L A S S I F I E D

Interactive vs. Batch

  • Work Flow Issue
  • Write script, submit, look at image or
  • animation. Wait. Look at Results.

– Repeat

  • Open ParaView, load data, apply filters,

move, change your mind, change your mind again.

– Continue interacting

slide-12
SLIDE 12

CUG 2009 Compute the Future 12

Operated by Los Alamos National Security, LLC for NNSA

U N C L A S S I F I E D

Building ParaView

  • Cross Compiling with Cmake

– ToolChain File – Answer file for “try run”

  • XT4 Socket Support

– Very good for interactivity

  • Native Paraview

– make pvHostTools

slide-13
SLIDE 13

CUG 2009 Compute the Future 13

Operated by Los Alamos National Security, LLC for NNSA

U N C L A S S I F I E D

Running ParaView

  • Get an allocation

– Find out process0 hostname – Start a PV server

  • Start new ssh tunnel with port

forwarding to process0.

  • Start local client

– Connect to localhost

slide-14
SLIDE 14

CUG 2009 Compute the Future 14

Operated by Los Alamos National Security, LLC for NNSA

U N C L A S S I F I E D

Results

slide-15
SLIDE 15

CUG 2009 Compute the Future 15

Operated by Los Alamos National Security, LLC for NNSA

U N C L A S S I F I E D

Scaling

  • Rendering

– Render Window Size and geometry

  • Compositing

– Render Window Size

  • Sending

– Render Window Size

slide-16
SLIDE 16

CUG 2009 Compute the Future 16

Operated by Los Alamos National Security, LLC for NNSA

U N C L A S S I F I E D

Conclusion

  • Remote Distance Visualization works

with Jaguar as the visualization Server

  • Scales Well
  • Could be better

– qsub should give an estimate till allocation

  • More visualization users would help

drive further work.