What is beowulf? Mythical Old-English hero who defeats Grendel, the - - PowerPoint PPT Presentation

▶
what is beowulf
SMART_READER_LITE
LIVE PREVIEW

What is beowulf? Mythical Old-English hero who defeats Grendel, the - - PowerPoint PPT Presentation

Feb 14, 2023 212 likes •651 views

Beowulf Clusters Rober obert Whit hitten en Jr Jr What is beowulf? Mythical Old-English hero who defeats Grendel, the green dragon Movie starring a CG-animated Angelina Jolie Cluster architecture 2 U. S. Department Of Energy 2

slide-1
SLIDE 1

Beowulf Clusters

Rober

  • bert Whit

hitten en Jr Jr

slide-2
SLIDE 2

2

What is beowulf?

  • Mythical Old-English hero who defeats

Grendel, the green dragon

  • Movie starring a CG-animated Angelina Jolie
  • Cluster architecture
  • U. S. Department Of Energy 2
slide-3
SLIDE 3

3

Beowulf cluster history

  • 1993 - Becker & Sterling started Beowulf project
  • 1994 – Becker & Sterling constructed a 16 node

cluster

  • 1996 – DOE and NASA demonstrate beowulf

cluster that surpasses 1GFlop/s

  • 1997 – Caltech demonstrates beowulf cluster that

surpasses 10GFlop/s

  • Present – beowulf clusters are used at many

universities, industries, and government sites

  • U. S. Department Of Energy 3
slide-4
SLIDE 4

4

What is a beowulf cluster?

  • Collection of stand-alone computer networked

together

  • Network equipment to connect computers
  • Software

– Operating system software – Application software – Communication software (MPI, OpenMP)

4

slide-5
SLIDE 5

5

Hardware

  • Any old computer will do

– Laptops – Desktops – Playstation 3s ??

  • Network

– Switches / hubs – Cable – Ethernet adapters (most computer already have this, including the PS3)

  • U. S. Department Of Energy 5
slide-6
SLIDE 6

6

TOPOLOGY

Network Topologies

BUS STAR EXTENDED STAR Wireless RING MESH

Reference: www.teach-ict.com/, uva.ulb.ac.be/

slide-7
SLIDE 7

7

Star Topology

  • Ethernet
  • IEEE 802.3
  • CSMA / CD
  • Switch vs. Hub
  • Broadcast vs. Cut-Through
  • Cable: CAT V, UTP, RJ45
slide-8
SLIDE 8

8

Model for Networking

OSI Model – Developed by ISO O Open I International S System S Standards I Interconnect O Organization

slide-9
SLIDE 9

9

OSI Model

Layer Name Mnemonic 7 Application All 6 Presentation People 5 Session Seem 4 Transport To 3 Network Need 2 Data-Link Data 1 Physical Processing

slide-10
SLIDE 10

10

Data Flow

Reference: http://catalyst.washington.edu/help/computing_fundamentals/networking/img/osi_model.jpg

slide-11
SLIDE 11

11

The Model - Examples

Layer Description

  • 7. Application

HTTP, FTP, SMTP, POP3, HTTPS

  • 6. Presentation

Data Representation : ASCII

  • 5. Session

Starts and Stops the Session (Logon / Logoff)

  • 4. Transport

TCP – reliable / Handshake Transmission Control Protocol UDP – unreliable (streaming data – mp3) User Datagram Protocol

  • 3. Network

IP – Internet Protocol , Router, Best Path Selection

  • 2. Data-Link

MAC (Media Access Control) Sub layer – Ethernet Switch LLC (Logical Link Control) Sub layer

  • 1. Physical

Wire , Cable, The bits going across the wire, The NIC

slide-12
SLIDE 12

12

Basic Network Diagram

slide-13
SLIDE 13

13

TCP/IP: Addressing Scheme

IP = Internet Protocol Protocol is What? Set of Rules

  • 1. Dotted Decimal Notation
  • 2. No Decimal Number can be >255
  • 3. Must Have Subnet Mask
  • 4. Broken Down into Classes based on High
  • rder of bits in the first octet.
slide-14
SLIDE 14

14

Dotted Decimal Notation

Example of IP address: 192.16.32.5 255.255.255.0 IP SM Dotted . Decimal . Notation . Rule Remember – 4 Octets , a Decimal number that represents the value of an 8 bit Binary number

slide-15
SLIDE 15

15

No Number can be 255

Sample IP Address: 192.16.32.5 255.255.255.0 IP SM

27 128 + 26 64 + 25 0 + 24 0 + 23 0 + 22 0 + 21 0 + 20 0 = 192 1 1 27 128 + 26 64 + 25 32 + 24 16 + 23 8 + 22 4 + 21 2 + 20 1 = 255 1 1 1 1 1 1 1 1

The first Octets = 192 & 255 What is 192 in Binary? What is 255 in Binary?

slide-16
SLIDE 16

16

IP Address Classes

Class 1st Octet High Order Of Bits Number Bits Used for Network Default Subnet Mask Class A 1-126 00000001 01111110 8 255.0.0.0 Class B 128 - 191 10000000 10111111 16 255.255.0.0 Class C 192 -223 11000000 11011111 24 255.255.255.0 Class D 224 - 239 11100000 11101111 Reserved

slide-17
SLIDE 17

17

SAMPLE IP Address:

Sample IP Address: 192.16.32.5 255.255.255.0

N H

By Performing a Binary AND Function IP Address AND Subnet Mask

11000000.00010000.00100000.00000101 11111111.11111111.11111111.00000000 11000000.00010000.00100000.00000000 192 . 16. 32. 0

slide-18
SLIDE 18

18

Sample IP Address:

11000000.00010000.00100000.00000101 11111111.11111111.11111111.00000000 11000000.00010000.00100000.00000000 192 . 16. 32. 0 192.16.32.0 = Network ID 192.16.32.255 = Broadcast ID 192.16.32. 1 – 254 = Host Addresses

slide-19
SLIDE 19

19

MAC Mini Network

slide-20
SLIDE 20

20

MAC Mini Network

Keyboard Mouse Monitor Ethernet Power

slide-21
SLIDE 21

21

MAC Mini Network

slide-22
SLIDE 22

22

Steps to Configuring the MAC Mini’s

1) Create Accounts

  • a. Name Machine
  • b. User Name
  • c. Password

3) Configure IP Address 2) System Preferences

  • a. File Sharing
  • b. Remote Sharing
  • c. Energy Saver off
  • d. Firewall off
slide-23
SLIDE 23

23

Configure System – Set hostname

Click on Sharing Name: ARC1, ARC2, etc

slide-24
SLIDE 24

24

Configure System – Add user

Click on Accounts Click on lock to unlock Click on +

slide-25
SLIDE 25

25

Configure IP Address

Click on Network Click on Ethernet

slide-26
SLIDE 26

26

Configure IP Address

Machine ¡ IP ¡Address ¡ Subnet ¡Mask ¡ ARC1 ¡ 172.30.220.1 ¡ 255.255.255.0 ¡ ARC2 ¡ 172.30.220.2 ¡ 255.255.255.0 ¡ ARC3 ¡ 172.30.220.3 ¡ 255.255.255.0 ¡ ARC4 ¡ 172.30.220.4 ¡ 255.255.255.0 ¡ ARC5 ¡ 172.30.220.5 ¡ 255.255.255.0 ¡ ARC6 ¡ 172.30.220.6 ¡ 255.255.255.0 ¡

slide-27
SLIDE 27

27

Server vs. Nodes

In the next steps, we will first setup the Server (ARC1) . Then to setup the nodes all we need to do is a secure copy to the nodes.

slide-28
SLIDE 28

28

Configure a node

  • 1. Setup Host Files
  • 2. Setup SSH
  • 3. Install & Configure GCC
  • 4. Install & Configure

MPICH

  • 5. Configure MPI to work

with SSH

  • 6. Test SSH, GCC and MPI
slide-29
SLIDE 29

29

Setup Host Files

cd to root (cd /) Type: sudo pico /etc/hosts

slide-30
SLIDE 30

30

Setup Host Files

Add the following at the bottom of the file: 172.30.220.1 ARC1 172.30.220.2 ARC2 172.30.220.3 ARC3 172.30.220.4 ARC4 172.30.220.5 ARC5 172.30.220.6 ARC6

slide-31
SLIDE 31

31

Setting up SSH

What is SSH? Why do we Need it?

SSH Encryrpti

  • n

Port 22

slide-32
SLIDE 32

32

Setting up SSH

We will be modifying 3 files:

  • 1. /etc/ssh_config
  • 2. /etc/sshd_config
  • 3. /etc/hosts.equiv
slide-33
SLIDE 33

33

Setting up SSH

Type: sudo pico /etc/ ssh_config host * HostbasedAuthenticat ion yes EnableSSHKeysign yes

slide-34
SLIDE 34

34

Setting up SSH

Type: sudo pico /etc/sshd_config HostbasedAuthentication yes

slide-35
SLIDE 35

35

Setting up SSH

Type: sudo pico /etc/hosts.equiv Add the following hostnames: ARC1 ARC2 ARC3 ARC4 ARC5 ARC6

slide-36
SLIDE 36

36

Install and Configure MPICH

What is MPICH? Why do we Need MPICH?

Reference: http://en.wikipedia.org/wiki/MPICH

slide-37
SLIDE 37

37

Download MPICH

http://www.mcs.anl.gov/research/projects/mpich2/downloads/ index.php?s=downloads

slide-38
SLIDE 38

38

Install MPICH

Type:

cd /arc_share/mpich1.2.7p1 ./configure - -with-device=ch_p4 – prefix=/usr/local/mpich-1.2.5/ch_p4 -rsh=ssh

slide-39
SLIDE 39

39

slide-40
SLIDE 40

40

Building the Cluster

Modify the file that contains our hosts: cd /arc_share/mpich-1.2.7p1/util/machines/ sudo pico machines.freebsd_ppc Change the list to ARC1 through ARC6 and remove the .local Ctrl o to write Ctrl x to exit

slide-41
SLIDE 41

41

Machines File

slide-42
SLIDE 42

42

Questions?

  • U. S. Department Of Energy 42

http://www.nccs.gov

  • U. S. Department Of Energy 42

Oak Ridge National Laboratory