Scientific Computing II Parallel Methods Jens Saak and Martin K - - PowerPoint PPT Presentation
Scientific Computing II Parallel Methods Jens Saak and Martin K ohler Summer Term 2017 OVGU Magdeburg Computational Methods in Systems and Control Theory (CSC) Max Planck Institute for Dynamics of Complex Technical Systems Preface
Parallel Methods Jens Saak and Martin K¨
Summer Term 2017 OVGU Magdeburg Computational Methods in Systems and Control Theory (CSC) Max Planck Institute for Dynamics of Complex Technical Systems
Preface
Jens Saak Scientific Computing II 2/348
Jens Saak Scientific Computing II 3/348
Parallel Computing Basics
What is a Parallel Computer?
Characterization
A parallel computer is a collection of processing elements communicating and cooperating for the fast solution of a large problem.
Jens Saak Scientific Computing II 4/348
Parallel Computing Basics
Basic Types of Parallelism
modern operating systems simulate parallel execution by time slicing
Jens Saak Scientific Computing II 5/348
Parallel Computing Basics
Basic Types of Parallelism
modern operating systems simulate parallel execution by time slicing
Computations executed on single unit with exclusive memory each
Jens Saak Scientific Computing II 5/348
Parallel Computing Basics
Basic Types of Parallelism
modern operating systems simulate parallel execution by time slicing
Computations executed on single unit with exclusive memory each
Several computational units share a common main memory.
Jens Saak Scientific Computing II 5/348
Parallel Computing Basics
Common Pitfalls in Parallel Computing
Most errors and misunderstandings in parallel computing are related to one of the following issues: race conditions,
Jens Saak Scientific Computing II 6/348
Parallel Computing Basics
Common Pitfalls in Parallel Computing
Most errors and misunderstandings in parallel computing are related to one of the following issues: race conditions, execution order based accuracy issues,
Jens Saak Scientific Computing II 6/348
Parallel Computing Basics
Common Pitfalls in Parallel Computing
Most errors and misunderstandings in parallel computing are related to one of the following issues: race conditions, execution order based accuracy issues, deadlocks,
Jens Saak Scientific Computing II 6/348
Parallel Computing Basics
Common Pitfalls in Parallel Computing
Most errors and misunderstandings in parallel computing are related to one of the following issues: race conditions, execution order based accuracy issues, deadlocks, data interdependence,
Jens Saak Scientific Computing II 6/348
Parallel Computing Basics
Common Pitfalls in Parallel Computing
Most errors and misunderstandings in parallel computing are related to one of the following issues: race conditions, execution order based accuracy issues, deadlocks, data interdependence, blocking problems on hardware level.
Jens Saak Scientific Computing II 6/348