High Performance Computing Cluster 1 1 HPCC Hardware 20 Compute - - PowerPoint PPT Presentation

high performance computing cluster
SMART_READER_LITE
LIVE PREVIEW

High Performance Computing Cluster 1 1 HPCC Hardware 20 Compute - - PowerPoint PPT Presentation

High Performance Computing Cluster 1 1 HPCC Hardware 20 Compute nodes, 560 cores with room to expand All Nodes: Xeon Broadwell CPUs (2.6 GHz) 28 cores per node Infiniband EDR (Infinite Bandwidth) (Enhanced Data


slide-1
SLIDE 1

1 1

High Performance Computing Cluster

slide-2
SLIDE 2

2 2

20 Compute nodes, 560 cores with room to expand – All Nodes:

  • Xeon Broadwell CPUs (2.6 GHz)
  • 28 cores per node
  • Infiniband EDR

– (Infinite Bandwidth) (Enhanced Data Rate) (100 Gb/s)

– Login Node: 1

  • 64 GB DDR4 2400 MHz RAM

– (DDR = Double Data Rate)

  • 4TB local hard drive array

– Compute Nodes: 17

  • 96 GB DDR4 2400 MHz RAM
  • 120 GB SATAII SSD (Solid State Drive)

– Application Compute Nodes: 3

  • 96 GB DDR4 2400 MHz RAM
  • 4 TB local hard drive + SSD as above

– File Server:

  • 128GB DDR4 2400MHz RAM
  • 6TB drive array for OS
  • 55 TB data drive array (accessible to all nodes)
  • Infiniband EDR

HPCC Hardware

slide-3
SLIDE 3

3 3

  • OS:

– Linux RedHat v7

  • Compilers:

– GNU Compiler

  • Program compilers and libraries

– Intel Parallel Studio XE 2016

  • Latest Intel toolkit for high performance applications
  • NetCDF, HDF5

– Network Common Data Form

  • Programming interface to scientific data files

– HDF5

  • Hierarchical Data Format – used to store image data
  • WRF-ARW v3.8.1

– Weather model (Atmospheric simulation system)

  • Scheduler:

– TORQUE – Adaptive Computing

  • Provides control over batch jobs and distributed computing resources
  • Utopus Applications to be installed

– R2 Renewable Generation Forecast Models – Energy Demand Forecast Model – Weather Insights for Environment (WISE) – Transactive Energy Management

HPCC Software

slide-4
SLIDE 4

4 4

HPCC Analytics

  • Vermont Weather Analytics Center

– Weather Visualization – WISE (Weather InSights Environment) – Demand Forecasting – Renewable Forecasting

  • OSIsoft Plant Information (PI)

– Integrate asset data with maintenance applications – Predictive analysis on Telecom systems

  • Utilize idle processing time for other
  • pportunities
slide-5
SLIDE 5

5 5 GOAL S Ke y T ask Planne d T ime line

  • Infr

a str uc tur e T r a nsition

VE L CO Ope ra tio na l Infra struc ture : De e p T hunde r + De ma nd F

  • re c a sting +

Re ne wa b le F

  • re c a sting + file

upda te s to VE L CO se rve r

  • Se r

ve r Cle a nup (no pla nne d impa c t to Ope r a tiona l Runs): F

e b 24th – Ma rc h 10th: Re mo ve a ny so urc e fro m DT se rve r, te st / va lida te DT a nd do wnstre a m mo de ls. Pre pa re fo r mo ve

  • Se r

ve r Shutdown: 13th Ma r c h: Bring do wn De e p T

hunde r se rve r a fte r 0z run;

  • Se r

ve r Move : 13th Ma rc h

  • VE

L CO se r ve r br ing up a t the ne w da ta c e nte r : 14th Ma rc h - 19th Ma rc h: n/ w

se tup; fire wa ll se tup; IP a ddre ss se tup; Re c o nfig ure the se rve rs

  • F

ir st Run of DT : 20th Ma r c h*

Ye llo w Zo ne Infra struc ture : Opus Infra struc ture + Opus Applic a tio ns (SE DA + PL M)

  • Se r

ve r Re build: 1st Ma r c h – 8th Ma rc h: Ne w L

ic e nse s ne e de d fo r a ll s/ w. Opus pla tfo rm re b uild

  • Ye llow Zone Build: 12th Ma rc h – 20thth Ma r

c h: n/ w se tup; fire wa ll se tup; IP a ddre ss

se tup

  • We e kly T

r a c k Me e ting T r a nsition

We e kly tra c k me e ting s; disc ussio ns a nd R&D

  • 2 We e k T

r a nsition – No tr a c k me e ting s: 27th F e b – 13th Ma rc h: Mo ve to te mpo ra ry

spa c e ; Se tup n/ w, da ta c e nte r a c c e ss. Se tup pho ne s a nd c o nfe re nc e line s; Se tup e ma il ids a nd la pto ps. Co mple te UI jo ining fo rma litie s

  • Post T

r a nsition: 14th Ma r c h: We e kly tra c k me e ting s o n sc he dule

  • We e kly PM Me e ting : As pla nne d; T

a run to jo in the te a m to he lp ma na g e the Uto pus ta sks a nd suppo rt L lo yd.

  • T

r a c k s/ w De live r y

S/ W de ve lo pme nt pla ns fo r e a c h o f the fo ur tra c ks

  • Impa c t on S/ W de ve lopme nt a nd de live r

y: 6st Ma r c h - 10th Apr il: Alig n a nd

se g me nt a ll IP a nd s/ w pe r UI sta nda rd (re mo ving IBM he a de rs, ma na g ing lic e nse d s/ w, se tting up a c c e ss to s/ w). Se tup ne w de v-o ps e nviro nme nt with ne w o pe ra ting syste m, ne w s/ w, UI he a de rs e tc . All s/ w de ve lo pme nt pla ns will mo ve b y 5 we e ks.

  • VE

L CO Infr a str uc tur e buildout

Se tting up VE L CO h/ w fo r De e p T hunde r + do wnstre a m a na lytic s

  • Sta rt e ffo rt fro m 21th Ma r

c h. Se e de ta ils o n the T

ra c k 4 time line

Utopus Transition Plan: VELCO

*Utopus and IBM Deep Thunder team will make every effort to complete the task sooner Effort Start Date Effort End Date