Chicagoland Computational Cosmology Salman Habib High Energy - - PowerPoint PPT Presentation

▶
chicagoland computational cosmology
SMART_READER_LITE
LIVE PREVIEW

Chicagoland Computational Cosmology Salman Habib High Energy - - PowerPoint PPT Presentation

Jun 19, 2023 555 likes •705 views

Chicagoland Computational Cosmology Salman Habib High Energy Physics Division Mathematics and Computer Science Division Argonne National Laboratory habib@anl.gov Monday, June 13, 2011 Overview Primary Target: Cosmological signatures of

slide-1
SLIDE 1

Chicagoland Computational Cosmology

Salman Habib High Energy Physics Division Mathematics and Computer Science Division Argonne National Laboratory habib@anl.gov

Monday, June 13, 2011

slide-2
SLIDE 2

Overview

  • Primary Target: Cosmological signatures
  • f physics beyond the Standard Model,

plus ‘ancillary science’

  • Structure Formation Probes: Exploit

nonlinear regime of structure formation

  • Discovery Science: Derive signatures
  • f new physics, search for new

cosmological probes

  • Precision Predictions: Aim to

produce the best predictions and error estimates/distributions for structure formation probes (rough analogy with lattice QCD)

  • Design and Analysis: Advance

‘Science of Surveys’; contribute to major ‘Dark Universe’ missions: BOSS, DES, LSST , BigBOSS, DESpec --

LSST on Cerro Pachon MC2/HPM

Monday, June 13, 2011

slide-3
SLIDE 3
  • Dark Energy: Properties of DE

equation of state, modifications of GR, other models? Sky surveys, terrestrial experiments

  • Dark Matter: Direct/Indirect

searches, clustering properties, constraints on model parameters Sky surveys, targeted observations, terrestrial experiments

  • Inflation: Probing primordial

fluctuations, CMB polarization, non- Gaussianity Sky surveys

  • Neutrino Sector: CMB, linear and

nonlinear matter clustering Sky surveys, terrestrial experiments

ROSAT (X-ray) WMAP (microwave) Fermi (gamma ray) SDSS (optical)

Explosion of information from sky maps: Precision cosmology requires detailed modeling, simulations, and inverse analysis

Cosmological Probes of New Physics

Monday, June 13, 2011

slide-4
SLIDE 4
  • Fundamental Science
  • Beyond the Cosmological Standard Model
  • Precision Predictions for Cosmological Probes
  • Survey Science
  • Interpretation of data from surveys (DES, SPT

, --)

  • Design of future surveys (DESpec, LSST

, --)

  • Simulation database accessible by local and external community
  • High Performance Computing and Data-Intensive Supercomputing

(DISC)

  • HPC: Petascale to Exascale at Argonne
  • High-throughput computing at Fermilab
  • Data-oriented science at Computation Institute
  • Education and Outreach
  • Student and post-doc involvement
  • Opportunities for cross-disciplinary collaborations

Chicagoland Opportunities: We Have it All!

JK HF AP SB

Mira DES

Monday, June 13, 2011

slide-5
SLIDE 5

Chicagoland: Computational Capabilities

JK HF AP SB

  • Complementary Simulation Codes
  • Coverage of gravity and hydrodynamics and ‘sub-grid’ physics
  • Adaptive Refinement Tree (ART) at UofC/Fermilab
  • Hardware Accelerated Cosmology Codes (HACC) framework at Argonne
  • FLASH at UofC in collaboration with Argonne
  • Data-Intensive Computing
  • Grid computing at all three institutions
  • Petascale Active Data Store (PADS) at CI
  • High-speed data transfers available locally
  • Next-Generation Computational Platforms and Associated Computer

Science

  • IBM BG/Q Mira (10 PF

, 750 TB) coming to Argonne in 2012

  • Remote and in situ visualization/analysis

Monday, June 13, 2011

slide-6
SLIDE 6

Chicagoland: Computational Capabilities

JK HF AP SB

  • Example: High-throughput data transfer
  • Globus Online (CI) used for transferring 22 TB of data from LANL to ANL
  • Data will be used to build a pilot public cosmology simulation database

5 Gb/s 9.00am 12.00am 3.00pm Data transfers on May 23/24

Monday, June 13, 2011

slide-7
SLIDE 7
  • Cosmology is Multi-Disciplinary: Modern

cosmology needs physics, astronomy, computer science, engineering, statistics, --

  • Cosmology is Diverse: Many avenues for

people to contribute in different ways

  • Precision Cosmology as Big Science: Small

and large team efforts: ‘HEP style science’

  • Leadership Computing: Cosmology is one field

that can and must exploit next-generation supercomputing (‘science at scale’)

  • Large Data Sets: Simulations and observations

are driving a new approach to data-centric science (potentially good connection with HEP data efforts)

  • National/International Collaborations:

National Labs as collaboration/science hubs

Cosmology: An Argonne View

BG/Q ANL TCS

Monday, June 13, 2011

slide-8
SLIDE 8

New Faces at Argonne

HEP/MCS staff: Salman Habib Katrin Heitmann HEP post-docs: Suman Bhattacharya [joint with UofC] Sanghamitra Deb Juliana Kwan Adrian Pope [ANL Named Fellow] Amol Upadhye [ANL Director’s Fellow] ALCF post-doc: Hal Finkel [Mira ESP] ALCF student: Brittney Bullis [Mira ESP] Work very closely with local/area theorists,

  • bservers, experimentalists, and computer

scientists --

JK HF SD AP BB AU SB

Monday, June 13, 2011

slide-9
SLIDE 9

Hardware-Accelerated Cosmology Code (HACC) Framework

  • Architecture Challenge: HPC is rapidly

evolving (clusters/BG/CPU+GPU/MIC --)

  • Code for the Future: Melds optimized

performance, low memory footprint, embedded analysis, and scalability

  • Implementation: Long/short-range force

matching with spectral force-shaping (long-range=PM, short-range=PP , tree)

  • Key Features: Hybrid particle/grid

design, particle overloading, spectral

  • perators, mixed-precision, node-level

‘plug-ins’, ~50% of peak Flops

  • Cross-Platform: Designed for all current

and future supercomputing platforms

  • Embedded Analysis: High performance

with low I/O and storage requirement

Perfect scaling on Roadrunner, 64 billion particle hi-res run now completing Mira 10 PFlops ‘Titan’ 20 PFlops Roadrunner 2 PFlops

Habib et al. 2009, Pope et al. 2010

Monday, June 13, 2011

slide-10
SLIDE 10

Status and Near-Term Outlook

  • HACC: Up and running on GPU and

Cell accelerated hardware

  • ESP on Mira: 150M CPU hours, tree

implementation almost completed, full-time post-doc and student

  • Hydrodynamics: HACC optimal for

particle-in-cell approach, algorithm development initiated, aim to complete by Mira arrival

  • HACC and Large Datasets:

Simulations and mocks need to be where the data is -- ANL provides state of the art resources via ALCF

Roadrunner view (halos) of the Universe at z=2 from a 64 billion particle run Mock catalog for SDSS luminous red galaxies (orange) and satellite galaxies (green), in coll. with M. White

BOSS Ly-alpha simulation SDSS LRG mock catalog

Monday, June 13, 2011

slide-11
SLIDE 11

Ultimate Vision for a Large-Scale Effort

  • Clean up ‘Discovery Space’: Robust

theory with subtle signals

  • Precision Cosmic Calibration at

Scale: ‘All Sky’ solution of the cosmic inverse problems in the nonlinear regime

  • Cosmology Simulations at the

Exascale: Next-generation computing and beyond as essential theoretical and analysis tools

  • Large Data: Simulation &
  • bservational datastreams: Archiving,

serving, quality assurance, (joint) analyses

  • Simulation/Data/Analysis: Cross-

platform, multi-source, analysis and interrogation frameworks

SDSS LRG mock catalog

Observation Feed

Science Results!

Monday, June 13, 2011

slide-12
SLIDE 12

Chicagoland Planning

JK HF AP SB

  • Progress on Report
  • Boroad science case made and targets identified
  • Scale of computations understood (previous studies and white papers --)
  • Software and algorithmic development requirements identified (driven by

next-generation hardware mix and expected ‘data deluge’)

  • Boundary Conditions
  • DOE/NNSA exascale co-design initiative future murky (progress too slow?)
  • DOE HEP has initiated a new planning exercise for computational cosmology
  • Need to get inputs from surveys (DES, LSST

, --), increase interaction level

  • Possible cross-agency collaboration (DOE, NSF

, --)

  • Timescale for Report and Suggested Actions
  • Need to initiate/continue and investigate local science collaborations and

interactions in detail (seminar series, regular task force meetings)

  • Input from dynamic ‘boundary conditions’ and SWOT/competition analysis
  • Continue work on report, final version with recommendations in the fall

Monday, June 13, 2011

slide-13
SLIDE 13

Collaborations and Projects

Kev Abazajian, Jim Ahrens, Ujjaini Alam, Debbie Bard, Sergei Bashinsky, Andrew Benson, Gary Bernstein, Joe Bernstein, Derek Bingham, Rahul Biswas, Anna Cabre, Jordan Carlson, Joanne Cohn, Andrew Connolly, David Daniel, Nehal Desai, Scott Dodelson, Tim Eifler, Gus Evrard, Patricia Fasel, Hume Feldman, Wu Feng, Josh Frieman, David Higdon, Tracy Holsclaw, Chung-Hsing Hsu, Bhuvnesh Jain, Steve Kahn, Lloyd Knox, Savvas Koushiappas, Steve Kuhlmann, Earl Lawrence, Herbie Lee, Adam Lidz, Zarija Lukic, Chris Miller, Charles Nakhleh, Mike Norman, Alex Pang, Uliana Popov, Darren Reed, Paul Ricker, Robert Ryne, Bruno Sanso, Paul Sathre, Michael Schneider, Sergei Shandarin, Alex Szalay, Tony Tyson, Licia Verde, Alexei Vikhlinin, Christian Wagner, Mike Warren, Martin White, Brian Williams, Tim Williams, Jon Woodring, ---

Monday, June 13, 2011