Moving HPC into the Mainstream Addressing the challenges of - - PowerPoint PPT Presentation

Moving HPC into the Mainstream

Addressing the challenges of Mainstream HPC

WHO’S ON THE PANEL

Jon Collins / The Register Nick Curcuru / MasterCard Onur Celebioglu / Dell EMC Bryan Betts / Freeform Dynamics

AGENDA

• HPC coming into the mainstream
• HPC challenges – security and beyond
• Making HPC part of the solution
• Starting out with HPC

THE DEFINITION OF HPC IS EX EXPANDING AND ACCEL ELER ERATI TING

Traditional HPC

Computationally-intensive modeling and simulation

• Computer-aided design

(CAD/CAM/CAE)

• Weather forecasting
• Oil exploration

High Performance Data Analytics

Analyzing big data for rapid insights, real-time results, predictive analytics

• Personalized medicine
• Fraud detection
• Machine Learning

Data-centric HPC

• Genomics
• Financial modeling
• Signal processing

ON PREMISE HYBRID CLOUD PUBLIC CLOUD

MASTERCARD – MOVING THE ANALYSIS CLOSER TO THE TRANSACTION

Business need

Turning 2.2B global cards 160M transactions/hour, 52B transactions / year into intelligence with 1.9M rules applied to those transactions.

Benefits

• Understand how, when and where customers buy leading

to predictive analytics

• Increased security and fraud protection via analyzing

customer purchasing patterns, affinities and rhythms using machine learning

• Expand business with anonymized data re: share of wallet compared to

competition, average ticket and frequency to identify marketing opportunities and measure return on investment

Solution

MasterCard worked with Dell and Cloudera to build a secure, PCI-certified Hadoop cluster. MasterCard's Enterprise Data Hub fully conforms to the PCI- DSS V 2.0 security standards so it can host PCI datasets and integrate with other systems.

“Data privacy and protection is a top priority for MasterCard. As we maximize the most advanced technologies from partners and vendors, they must meet the rigorous security standards we’ve set.”

Gary VonderHaar, Chief Technology Officer, Architecture, MasterCard

Research

HPC BECOMING PART OF MAINSTREAM IT

EXPANDING THE BOUNDARIES OF WHAT’S POSSIBLE

Life sciences Manufacturing High-performance data analytics Oil and gas Financial services

Quickly adopting systems for complex scientific analysis Accelerating time-to-insight for drug design, cancer research, agriculture, forensics, genomics and bioinformatics Optimizing the performance of software with systems specifically designed for CAE Exploring the possibilities of machine learning, deep learning and AI with benchmarked and optimized HDPA configurations. Fueling the algorithms that revolutionize oil and gas research by precisely pinpointing elusive oil and gas reserves Helping customers process trades and transactions faster, determine risks and

• pportunities

LOTS OF HPC ACTIVITY – BUT ONLY A MINORITY ARE FULLY HPC-READY

Do you have HPC/supercomputing in production yet, or are you moving in that direction?

In production Currently implementing Investigating No activity Unsure

Where relevant, how ready are your existing IT systems to handle evolving compute-intensive requirements over the next 3 years?

Fully Partially Not very Nothing in place

HPC CHALLENGES AND SOLUTIONS – SECURITY, GOVERNANCE AND BEYOND

• NYSE offers best and worst examples
• Most transactions now machine based
• Avalanche effects
• Data types and risk factors
• Customer-facing information
• Governance and compliance
• Heal thyself – HPC’s role in security and

governance

• Anomaly detection
• Early warning

DELL EMC TAKES A UNIQUE APPROACH TO HPC

• Dell EMC is only

company in the world with an end- to-end HPC portfolio

• Three focus areas:

Advancing HPC – from the workgroup to TOP500 Democratizing HPC – enabling small and medium businesses Optimizing HPC – ensuring balanced price/performance

1 2 3

MODULAR APPROACH – CONCEPTUAL ANALYTICS COMPONENTS USE

TECHNOLOGY FOUNDATION

HADOOP ENVIRONMENT HARDWARE/INFRASTRUCTURE

DATA MANAGEMENT AND GOVERNANCE

BUSINESS RULES TECHNICAL ENFORCEMENT

USE CASE 1 USE CASE 2 USE CASE 3

…

DATA INGESTION/ ENGINEERING DATA ANALYTICS APPLICATION AND PROCESS INTEGRATION DATA INGESTION/ ENGINEERING DATA ANALYTICS APPLICATION AND PROCESS INTEGRATION DATA INGESTION/ ENGINEERING DATA ANALYTICS APPLICATION AND PROCESS INTEGRATION

COMMERCIAL PRODUCT OPEN SOURCE PREFERENCE

FOCUS ON FLEXIBILITY; SUBJECT TO CHANGE FROM USE CASE TO USE CASE FOCUS ON STANDARDS; STABLE ACROSS USE CASES

DATA STORE DATA STORE DATA STORE

STARTING OUT WITH HPC – THINK BIG, START SMALL, SCALE FAST

• Understand workloads, business processes and use cases – existing and

possible

• Build business case based on NPV, not ROI
• Create picture of available data – internal and external, collection methods
• Culture change– new solutions require new skills and attitudes
• Data governance – HPC can be part of solution (e.g. ‘toxic’ data combinations)
• Management impact and constraints

DELL EMC HPC INNOVATION LAB

Work directly with Dell EMC HPC experts to test drive cutting-edge HPC technologies, and test and tune systems prior to purchase Typical HPC Innovation Lab projects While the list of potential projects is virtually limitless, common projects include:

• Cluster comparisons
• System parameter sweeps
• Graphics processing unit (GPU) test comparisons
• Efficiency tuning
• HPC network testing
• HPC storage system optimization

CLOSING THOUGHTS AND FURTHER READING

Dell EMC HPC Innovation lab http://reg.cx/2v8f Dell EMC main HPC page www.dell.com/hpc Dell EMC HPC Innovation lab blogs/best practices www.hpcatdell.com

Thank you for watching