General Specification The hardware specification for the high - - PDF document

EECS Department 1122 Volunteer Blvd., Suite 413 Knoxville, TN 37996-3450

October 1, 2008 Silvio Migliori Funzione Centrale Informatica Lungotevere Thaon di Revel, n. 76 00196 Roma Dear Silvio, This is a note on the current status of the Central Supercomputer at ENEA CRESCO as of October 1st, 2008

General Specification

The hardware specification for the high performance computer system has three basic section. Section 1 (Grande Memoria)

• 42 Node SMP IBM x3850‐M2
• with 4 socket Xeon Quad‐Core Tigerton E7330
• 32/64 GByte RAM per node
• (2.4GHz/ 1066MHz/6MB L2)
• 9.6Gflop/s per core
• A total of 672 core Intel Tigerton

Section 2 (Alto Parallelismo)

• 256 node blades IBM HS21
• with 2 socket Xeon Quad‐Core Clovertown E5345
• 16 GB RAM per node
• (2.33GHz/1333MHz/8MB L2)
• 9.32Gflop/s per core

University Distinguished Professor Innovative Computing Laboratory Electrical Engineering and Computer Science Department The University of Tennessee dongarra@cs.utk.edu

Jack Dongarra

• A total of 2048 core Intel Clovertown

Section 3 (Special)

• 4 node blades IBM QS21 with 2 socket Cell BE Processors 3.2 Ghz each.
• 6 node IBM x3755, 8 Core AMD 8222 with FPGA VIRTEX5
• 4 node IBM x 3755, 8 core AMD 8222 with NVIDIA Quadro FX 4500 X2
• 4 Nodi windows 8 core 16 Byte RAM
• Networking
• Infiniband 4X to interconnect all nodes of the systems.
• Software
• LINUX and Windows support
• Middleware

OpenAFS LSF GPFS

• Benchmarks
• Standard benchmarks such as HPL and HPCC Benchmarks runs
• File system
• 120 TB raw with 96 TB RAID6
• 3 GB/s transfer
• File system GPFS at 2GB/s

General Comments on the New System

CRESCO (Centro Computazionale di RicErca sui Sistemi Complessi, Computational Research Center for Complex Systems) is an ENEA Project, co-funded by the Italian Ministry of Education, University and Research (MIUR). The CRESCO project, located in the Portici ENEA Center, aims to develop a High Performance Computing infrastructure which will be mainly devoted to the study

• f Complex Systems. There are three major components:
• The implementation of innovative solutions in topic of computing system architectures and

GRID computing for the activities of advanced R&D in ENEA, requiring the use of high performance computational resources.

• The study of biologic objects from a "systemic" point of view and the study of natural

systems (animal and social communities) according to paradigm of complex systems;

• The study of technological complex systems and their mutual interactions and the creation
• f suitable tools for the modeling, simulating and control processes.

Funding for the facility is at the level of about 9 Million Euros and comes from the Ministero dell’Università e della Ricerca. The Project has participation from 18 partners between University, Agencies of Research, and Industry. The supercomputer facility has a peak performance of about 24 TeraFlop/s, and today is placed at position 180 on the Top500 list of Supercomputers. The inauguration of the Central Supercomputer at ENEA CRESCO took place on May 6th, 2008. The systems and configurations specified are an important addition to computing in ENEA, Italy, and the EC in general. The overall procedure for implementing and installation of the system was well executed and the facility has been installed and currently undergoing final testing before

• acceptance. It is clear that the careful planning in both the hardware and software components of the

computing facility as well as the necessary human infrastructure to support the systems has paid off with the smooth installation and startup of the facility. In addition, ENEA has put in place the physical infrastructure needed to house the system, and has selected a computing system that can perform well on a broad range of applicability in science and engineering. The CRESCO center has quickly come up and is in operation for a small set of important users. These users are engaged in state of the art research. Three of the researchers presented their results at a workshop at ENEA Portici on September 30, 2008.

• Massimo Celino talked about “New Materials and Complex Molecules: From The Design To

Your Computer”. He looked at a study of Mg‐MgH2 interface using Car‐Parrinello molecular dynamics code on ENEA‐GRID.

• F.R. Picchia, talked about “High Performance Computing for Developing Advanced Energy

Technologies”

• Adriana Carillo, discussed “High Resolution Mediterranean Climate Simulations: Present and

Future Scenarios.” Each talked presented research obtained from the used of the CRESCO system. In addition there were a number of presentations made by various projects in the ENEA CRESCO

• effort. The Projects have as its objectives the achievement at the ENEA Research Center of Portici,

an important calculation multidisciplinary study of complex systems and biological technology, combined with facilities for processing, storing and displaying 3D data Centers located at ENEA Brindisi and Trisaia. In terms of applications and scientific content, the project focuses on the following lines of areas:

• Activity 1
• The deployment of innovative solutions in the field of architecture computing

systems and GRID computing for R & D edge at ENEA requiring the use of computational resources extremely important.

• On the infrastructure project envisages the creation of a platform for calculation of

absolute excellence capable of providing a power of the TeraFLOPS, with a new class

• f innovative features GRID.

Talks were presented by:

• S. Pierattini: Tools and Solutions for 3D Graphics Developed in CRESCO
• P. Palazzari: Efficient use of FPGA on CRESCO, Porting the MIT Global Circulation

Model on the CellBE Processor.

• S. Raia: Innovative Tools for ENEA GRID
• Activity 2
• The study of biological objects from a "systemic" (in silico cell) and the study of

natural systems (community and social animals) as the paradigm of complex systems. A talk were presented by:

• G. Aprea: Estimating Kinetic Parameters of Metabolic Networks
• Activity 3
• The study of complex technological systems and their mutual interactions, and

implementation of appropriate tools for modeling, simulation and control. Talks were presented by:

• M. Minichino: Study and Analysis of Complex Networks and their Implementations

are ENEA‐GRID

• S. Di Blasi: Network Simulator 2 ‐ Installation is ENEA‐GRID and Main Applications
• S. De Porcellinis: Federating Environment Testbed for Critical Infrastructure

Simulation

• M. Pollino: ISIS – Territorial Information for the Protection Of Infrastructure and

Elsewhere

Recomm Ensuring successfu ENEA ha Although credible v project m ENEA m the high p – It as w b te em E sh – A in th ad pr – It th th th

• – C

h Sincerely Jack Dong University mendations: g usage by ap ul usage of th as assembled h there are ri vendor, IBM management must play a pr performance t is recomme s any others will use the re e required to echnological mpowered to ENEA compu hould be pro As an integra ntegrate, and he existing u ddressing us roblems. t is also reco he year or ea he developm he science an f the comput CRESCO sho ands-on tuto y, garra y Distinguish pplication is hese system d a strong te isks associat M in this case principles. roactive role e computing ended that EN selected to u esources pro

• make full u

l areas that a

• engage the

uting resourc

• vided to hel

al part of any d extend the user commun ser issues tha

• mmends tha

arly next yea ment of the co nd engineeri ting resourc

• uld offer cla
• rials on port

hed Professo the next step

• s. The appro

chnical team ed with any

• e. ENEA ha

e in helping g system. Tw NEA engage use the ENE

• vided by EN

use of the EN are not repres e leading res ces through lp users adap y advanced c existing use

• nity. Consult

at are not cov at the ENEA

• ar. This work
• mputing tec

ng applicatio es. asses and sem ting and opt

• r

p and will be

• ach being t

m that is capa project of th as put into pl the scientific wo actions are e each princ EA computin NEA and wh NEA system sented, the E earchers in t the appropri pt their appli cyberinfrastru r service and ting and train vered by doc A host an ann kshop should chnologies n

• ns that are

minars on hi imizing code e the most c taken by EN able of execu his scope and lace a manag c and engine e suggested: ipal investig ng system, to hat level of te

• ms. Were imp

ENEA mana these areas, iate mechani ications for t ucture, CRE d support inf ning are the cumentation nual worksho d be focused needed to sup taking advan igh performa e for the EN ritical issue NEA is techni uting the pro d complexity gement appr eering comm : gator of the H

• determine h

echnical and portant scien gement shou encouraging

• isms. Course

the new syst ESCO should frastructure t primary me n or that are r

• p, beginnin

d on identifyi pport HPC c ntage of or c ance scientif NEA superco facing the ically sound

• ject.

y, such as pi

• ach based o

munities prep HPC system, how their pr d other suppo ntific and uld be explic g them to app es and trainin tems. d plan to lev to meet the n chanisms fo related to sy g towards th ing and furth computing as could take ad fic computin

• mputer.

d and the icking a

• n sound

pare for , as well rojects

• rt will

citly ply for ng erage, needs of

• r

stems he end of hering s well as dvantage ng and