1 1
High Performance Computing Cluster 1 1 HPCC Hardware 20 Compute - - PowerPoint PPT Presentation
High Performance Computing Cluster 1 1 HPCC Hardware 20 Compute - - PowerPoint PPT Presentation
High Performance Computing Cluster 1 1 HPCC Hardware 20 Compute nodes, 560 cores with room to expand All Nodes: Xeon Broadwell CPUs (2.6 GHz) 28 cores per node Infiniband EDR (Infinite Bandwidth) (Enhanced Data
2 2
20 Compute nodes, 560 cores with room to expand – All Nodes:
- Xeon Broadwell CPUs (2.6 GHz)
- 28 cores per node
- Infiniband EDR
– (Infinite Bandwidth) (Enhanced Data Rate) (100 Gb/s)
– Login Node: 1
- 64 GB DDR4 2400 MHz RAM
– (DDR = Double Data Rate)
- 4TB local hard drive array
– Compute Nodes: 17
- 96 GB DDR4 2400 MHz RAM
- 120 GB SATAII SSD (Solid State Drive)
– Application Compute Nodes: 3
- 96 GB DDR4 2400 MHz RAM
- 4 TB local hard drive + SSD as above
– File Server:
- 128GB DDR4 2400MHz RAM
- 6TB drive array for OS
- 55 TB data drive array (accessible to all nodes)
- Infiniband EDR
HPCC Hardware
3 3
- OS:
– Linux RedHat v7
- Compilers:
– GNU Compiler
- Program compilers and libraries
– Intel Parallel Studio XE 2016
- Latest Intel toolkit for high performance applications
- NetCDF, HDF5
– Network Common Data Form
- Programming interface to scientific data files
– HDF5
- Hierarchical Data Format – used to store image data
- WRF-ARW v3.8.1
– Weather model (Atmospheric simulation system)
- Scheduler:
– TORQUE – Adaptive Computing
- Provides control over batch jobs and distributed computing resources
- Utopus Applications to be installed
– R2 Renewable Generation Forecast Models – Energy Demand Forecast Model – Weather Insights for Environment (WISE) – Transactive Energy Management
HPCC Software
4 4
HPCC Analytics
- Vermont Weather Analytics Center
– Weather Visualization – WISE (Weather InSights Environment) – Demand Forecasting – Renewable Forecasting
- OSIsoft Plant Information (PI)
– Integrate asset data with maintenance applications – Predictive analysis on Telecom systems
- Utilize idle processing time for other
- pportunities
5 5 GOAL S Ke y T ask Planne d T ime line
- Infr
a str uc tur e T r a nsition
VE L CO Ope ra tio na l Infra struc ture : De e p T hunde r + De ma nd F
- re c a sting +
Re ne wa b le F
- re c a sting + file
upda te s to VE L CO se rve r
- Se r
ve r Cle a nup (no pla nne d impa c t to Ope r a tiona l Runs): F
e b 24th – Ma rc h 10th: Re mo ve a ny so urc e fro m DT se rve r, te st / va lida te DT a nd do wnstre a m mo de ls. Pre pa re fo r mo ve
- Se r
ve r Shutdown: 13th Ma r c h: Bring do wn De e p T
hunde r se rve r a fte r 0z run;
- Se r
ve r Move : 13th Ma rc h
- VE
L CO se r ve r br ing up a t the ne w da ta c e nte r : 14th Ma rc h - 19th Ma rc h: n/ w
se tup; fire wa ll se tup; IP a ddre ss se tup; Re c o nfig ure the se rve rs
- F
ir st Run of DT : 20th Ma r c h*
Ye llo w Zo ne Infra struc ture : Opus Infra struc ture + Opus Applic a tio ns (SE DA + PL M)
- Se r
ve r Re build: 1st Ma r c h – 8th Ma rc h: Ne w L
ic e nse s ne e de d fo r a ll s/ w. Opus pla tfo rm re b uild
- Ye llow Zone Build: 12th Ma rc h – 20thth Ma r
c h: n/ w se tup; fire wa ll se tup; IP a ddre ss
se tup
- We e kly T
r a c k Me e ting T r a nsition
We e kly tra c k me e ting s; disc ussio ns a nd R&D
- 2 We e k T
r a nsition – No tr a c k me e ting s: 27th F e b – 13th Ma rc h: Mo ve to te mpo ra ry
spa c e ; Se tup n/ w, da ta c e nte r a c c e ss. Se tup pho ne s a nd c o nfe re nc e line s; Se tup e ma il ids a nd la pto ps. Co mple te UI jo ining fo rma litie s
- Post T
r a nsition: 14th Ma r c h: We e kly tra c k me e ting s o n sc he dule
- We e kly PM Me e ting : As pla nne d; T
a run to jo in the te a m to he lp ma na g e the Uto pus ta sks a nd suppo rt L lo yd.
- T
r a c k s/ w De live r y
S/ W de ve lo pme nt pla ns fo r e a c h o f the fo ur tra c ks
- Impa c t on S/ W de ve lopme nt a nd de live r
y: 6st Ma r c h - 10th Apr il: Alig n a nd
se g me nt a ll IP a nd s/ w pe r UI sta nda rd (re mo ving IBM he a de rs, ma na g ing lic e nse d s/ w, se tting up a c c e ss to s/ w). Se tup ne w de v-o ps e nviro nme nt with ne w o pe ra ting syste m, ne w s/ w, UI he a de rs e tc . All s/ w de ve lo pme nt pla ns will mo ve b y 5 we e ks.
- VE
L CO Infr a str uc tur e buildout
Se tting up VE L CO h/ w fo r De e p T hunde r + do wnstre a m a na lytic s
- Sta rt e ffo rt fro m 21th Ma r
c h. Se e de ta ils o n the T
ra c k 4 time line
Utopus Transition Plan: VELCO
*Utopus and IBM Deep Thunder team will make every effort to complete the task sooner Effort Start Date Effort End Date