Grid5000 network topology use cases Aur elien CEDEYN Pascale - - PowerPoint PPT Presentation

▶
grid 5000 network topology use cases
SMART_READER_LITE
LIVE PREVIEW

Grid5000 network topology use cases Aur elien CEDEYN Pascale - - PowerPoint PPT Presentation

Jun 27, 2023 262 likes •931 views

Grid5000 network topology use cases Aur elien CEDEYN Pascale PRIMET INRIA Laboratoire de lInformatique du Parall elisme/RESO FRANCE October 15, 2007 Aur elien CEDEYN Pascale PRIMET (INRIA) Grid5000 network topology use

slide-1
SLIDE 1

Grid’5000 network topology use cases

Aur´ elien CEDEYN Pascale PRIMET

INRIA Laboratoire de l’Informatique du Parall´ elisme/RESO FRANCE

October 15, 2007

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 1 / 16

slide-2
SLIDE 2

1

Grid5000 overview Presentation Grid5000 general map Grid5000 usage Networking tools User community

2

Grid5000 graphical network description General view Site view Problems of this kind of representation Users needs Admin needs

3

Conclusion

4

More informations

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 2 / 16

slide-3
SLIDE 3

1

Grid5000 overview Presentation Grid5000 general map Grid5000 usage Networking tools User community

2

Grid5000 graphical network description General view Site view Problems of this kind of representation Users needs Admin needs

3

Conclusion

4

More informations

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 3 / 16

slide-4
SLIDE 4

Presentation

The main purpose of Grid’5000 is to serve as an experimental testbed for research in Grid Computing. Allow Grid experiments France wide in

Application Programming Environment Application runtime Grid or P2P Middleware Operating System Networking

17 laboratories involved 9 sites hosting one or more cluster per site 500 to 1000 cpus per site 10Gb/s interconnection

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 4 / 16

slide-5
SLIDE 5

Grid5000 general map

Overview

9 sites Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 5 / 16

slide-6
SLIDE 6

Grid5000 general map

Overview

9 sites Backbone 10Gb/s : RENATER (national research and education network) Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 5 / 16

slide-7
SLIDE 7

Grid5000 general map

Overview

9 sites Backbone 10Gb/s : RENATER (national research and education network) Dedicated VLAN on RENATER Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 5 / 16

slide-8
SLIDE 8

Grid5000 usage

The main particularity of Grid’5000 is the ability for users to deploy their

  • wn system on the resources they reserve.

Grid’5000 provide two tools to manage this :

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 6 / 16

slide-9
SLIDE 9

Grid5000 usage

The main particularity of Grid’5000 is the ability for users to deploy their

  • wn system on the resources they reserve.

Grid’5000 provide two tools to manage this : OAR

The reservation tool on Grid’5000 Accurate reservation capability (CPU/Core/Switch reservation) Can be used with the kadeploy system

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 6 / 16

slide-10
SLIDE 10

Grid5000 usage

The main particularity of Grid’5000 is the ability for users to deploy their

  • wn system on the resources they reserve.

Grid’5000 provide two tools to manage this : OAR

The reservation tool on Grid’5000 Accurate reservation capability (CPU/Core/Switch reservation) Can be used with the kadeploy system

Kadeploy

Environment deployment system Each user can make his own environment Total control of the reserved resources

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 6 / 16

slide-11
SLIDE 11

Networking tools

RENATER Monitoring tools Grid5000 infrastructure description Nagios Ganglia SFlow (Only at lyon)

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 7 / 16

slide-12
SLIDE 12

Networking tools : Renater status

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 7 / 16

slide-13
SLIDE 13

Networking tools : Renater SNMP stats

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 7 / 16

slide-14
SLIDE 14

Networking tools : Grid5000 graphical network description

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 7 / 16

slide-15
SLIDE 15

Networking tools : Grid5000 Nagios

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 7 / 16

slide-16
SLIDE 16

Networking tools : Grid5000 Ganglia

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 7 / 16

slide-17
SLIDE 17

Networking tools : Grid5000 SFlow

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 7 / 16

slide-18
SLIDE 18

User community

Application Users

RENATER Monitoring tools

Grid/Network ser- vices developpers Researcher and experimenters

Administrators

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 8 / 16

slide-19
SLIDE 19

User community

Application Users

RENATER Monitoring tools Grid5000 infrastructure description

Grid/Network ser- vices developpers Researcher and experimenters

Administrators

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 8 / 16

slide-20
SLIDE 20

User community

Application Users

RENATER Monitoring tools Grid5000 infrastructure description

Grid/Network ser- vices developpers

Grid5000 infrastructure description

Researcher and experimenters

Administrators

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 8 / 16

slide-21
SLIDE 21

User community

Application Users

RENATER Monitoring tools Grid5000 infrastructure description

Grid/Network ser- vices developpers

Grid5000 infrastructure description Ganglia

Researcher and experimenters

Administrators

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 8 / 16

slide-22
SLIDE 22

User community

Application Users

RENATER Monitoring tools Grid5000 infrastructure description

Grid/Network ser- vices developpers

Grid5000 infrastructure description Ganglia

Researcher and experimenters

RENATER Monitoring tools

Administrators

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 8 / 16

slide-23
SLIDE 23

User community

Application Users

RENATER Monitoring tools Grid5000 infrastructure description

Grid/Network ser- vices developpers

Grid5000 infrastructure description Ganglia

Researcher and experimenters

RENATER Monitoring tools Grid5000 infrastructure description

Administrators

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 8 / 16

slide-24
SLIDE 24

User community

Application Users

RENATER Monitoring tools Grid5000 infrastructure description

Grid/Network ser- vices developpers

Grid5000 infrastructure description Ganglia

Researcher and experimenters

RENATER Monitoring tools Grid5000 infrastructure description Ganglia

Administrators

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 8 / 16

slide-25
SLIDE 25

User community

Application Users

RENATER Monitoring tools Grid5000 infrastructure description

Grid/Network ser- vices developpers

Grid5000 infrastructure description Ganglia

Researcher and experimenters

RENATER Monitoring tools Grid5000 infrastructure description Ganglia Nagios

Administrators

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 8 / 16

slide-26
SLIDE 26

User community

Application Users

RENATER Monitoring tools Grid5000 infrastructure description

Grid/Network ser- vices developpers

Grid5000 infrastructure description Ganglia

Researcher and experimenters

RENATER Monitoring tools Grid5000 infrastructure description Ganglia Nagios SFlow

Administrators

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 8 / 16

slide-27
SLIDE 27

User community

Application Users

RENATER Monitoring tools Grid5000 infrastructure description

Grid/Network ser- vices developpers

Grid5000 infrastructure description Ganglia

Researcher and experimenters

RENATER Monitoring tools Grid5000 infrastructure description Ganglia Nagios SFlow

Administrators

RENATER Monitoring tools Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 8 / 16

slide-28
SLIDE 28

User community

Application Users

RENATER Monitoring tools Grid5000 infrastructure description

Grid/Network ser- vices developpers

Grid5000 infrastructure description Ganglia

Researcher and experimenters

RENATER Monitoring tools Grid5000 infrastructure description Ganglia Nagios SFlow

Administrators

RENATER Monitoring tools Grid5000 infrastructure description Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 8 / 16

slide-29
SLIDE 29

User community

Application Users

RENATER Monitoring tools Grid5000 infrastructure description

Grid/Network ser- vices developpers

Grid5000 infrastructure description Ganglia

Researcher and experimenters

RENATER Monitoring tools Grid5000 infrastructure description Ganglia Nagios SFlow

Administrators

RENATER Monitoring tools Grid5000 infrastructure description Ganglia Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 8 / 16

slide-30
SLIDE 30

User community

Application Users

RENATER Monitoring tools Grid5000 infrastructure description

Grid/Network ser- vices developpers

Grid5000 infrastructure description Ganglia

Researcher and experimenters

RENATER Monitoring tools Grid5000 infrastructure description Ganglia Nagios SFlow

Administrators

RENATER Monitoring tools Grid5000 infrastructure description Ganglia Nagios Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 8 / 16

slide-31
SLIDE 31

1

Grid5000 overview Presentation Grid5000 general map Grid5000 usage Networking tools User community

2

Grid5000 graphical network description General view Site view Problems of this kind of representation Users needs Admin needs

3

Conclusion

4

More informations

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 9 / 16

slide-32
SLIDE 32

General view

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 10 / 16

slide-33
SLIDE 33

Site view

Provide

Global links connexion Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 11 / 16

slide-34
SLIDE 34

Site view

Provide

Global links connexion Links capacity 1Gb/s 10Gb/s 2Gb/s Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 11 / 16

slide-35
SLIDE 35

Site view

Provide

Global links connexion Links capacity 1Gb/s 10Gb/s 2Gb/s Switch/Router connexion Switch/Routeur type Vendor name Optional : IP address Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 11 / 16

slide-36
SLIDE 36

Site view

Provide

Global links connexion Links capacity 1Gb/s 10Gb/s 2Gb/s Links medium Copper Optical Switch/Router connexion Switch/Routeur type Vendor name Optional : IP address Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 11 / 16

slide-37
SLIDE 37

Site view

Provide

Global links connexion Links capacity 1Gb/s 10Gb/s 2Gb/s Links medium Copper Optical Switch/Router connexion Switch/Routeur type Vendor name Optional : IP address Logical description Nodes/Frontends name Nodes network Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 11 / 16

slide-38
SLIDE 38

Problems of this kind of representation

Really static representation

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 12 / 16

slide-39
SLIDE 39

Problems of this kind of representation

Really static representation Graphical based representation

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 12 / 16

slide-40
SLIDE 40

Problems of this kind of representation

Really static representation Graphical based representation

Can not show all information

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 12 / 16

slide-41
SLIDE 41

Problems of this kind of representation

Really static representation Graphical based representation

Can not show all information Compatibility problems

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 12 / 16

slide-42
SLIDE 42

Problems of this kind of representation

Really static representation Graphical based representation

Can not show all information Compatibility problems

Heavy synchronisation work

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 12 / 16

slide-43
SLIDE 43

Users needs

Which devices they cross

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 13 / 16

slide-44
SLIDE 44

Users needs

Which devices they cross Links status

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 13 / 16

slide-45
SLIDE 45

Users needs

Which devices they cross Links status Oriented links

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 13 / 16

slide-46
SLIDE 46

Users needs

Which devices they cross Links status Oriented links

Bidirectional links

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 13 / 16

slide-47
SLIDE 47

Users needs

Which devices they cross Links status Oriented links

Bidirectional links Unidirectional links

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 13 / 16

slide-48
SLIDE 48

Users needs

Which devices they cross Links status Oriented links

Bidirectional links Unidirectional links

Weight of edges

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 13 / 16

slide-49
SLIDE 49

Users needs

Which devices they cross Links status Oriented links

Bidirectional links Unidirectional links

Weight of edges

links capacity

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 13 / 16

slide-50
SLIDE 50

Users needs

Which devices they cross Links status Oriented links

Bidirectional links Unidirectional links

Weight of edges

links capacity links latency

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 13 / 16

slide-51
SLIDE 51

Users needs

Which devices they cross Links status Oriented links

Bidirectional links Unidirectional links

Weight of edges

links capacity links latency

Multiview of the network

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 13 / 16

slide-52
SLIDE 52

Users needs

Which devices they cross Links status Oriented links

Bidirectional links Unidirectional links

Weight of edges

links capacity links latency

Multiview of the network

Hardware view

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 13 / 16

slide-53
SLIDE 53

Users needs

Which devices they cross Links status Oriented links

Bidirectional links Unidirectional links

Weight of edges

links capacity links latency

Multiview of the network

Hardware view Transport view

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 13 / 16

slide-54
SLIDE 54

Users needs

Which devices they cross Links status Oriented links

Bidirectional links Unidirectional links

Weight of edges

links capacity links latency

Multiview of the network

Hardware view Transport view Application view (user space)

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 13 / 16

slide-55
SLIDE 55

Users needs

Which devices they cross Links status Oriented links

Bidirectional links Unidirectional links

Weight of edges

links capacity links latency

Multiview of the network

Hardware view Transport view Application view (user space)

Filter the different information

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 13 / 16

slide-56
SLIDE 56

Admin needs

All connexions (compute network, admin network, etc...)

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 14 / 16

slide-57
SLIDE 57

Admin needs

All connexions (compute network, admin network, etc...) Localisation of the resources

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 14 / 16

slide-58
SLIDE 58

Admin needs

All connexions (compute network, admin network, etc...) Localisation of the resources Hardware representation

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 14 / 16

slide-59
SLIDE 59

Admin needs

All connexions (compute network, admin network, etc...) Localisation of the resources Hardware representation Routing path

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 14 / 16

slide-60
SLIDE 60

Admin needs

All connexions (compute network, admin network, etc...) Localisation of the resources Hardware representation Routing path Accurate scheme : All information about the hardware is interesting (router vendor, nodes type)

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 14 / 16

slide-61
SLIDE 61

Admin needs

All connexions (compute network, admin network, etc...) Localisation of the resources Hardware representation Routing path Accurate scheme : All information about the hardware is interesting (router vendor, nodes type) Easy and dynamic representation describing hard/soft modification

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 14 / 16

slide-62
SLIDE 62

Admin needs

All connexions (compute network, admin network, etc...) Localisation of the resources Hardware representation Routing path Accurate scheme : All information about the hardware is interesting (router vendor, nodes type) Easy and dynamic representation describing hard/soft modification Ability to modify the informations in real time.

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 14 / 16

slide-63
SLIDE 63

Conclusion

Admin and users Network graphical view Query tools

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 15 / 16

slide-64
SLIDE 64

Conclusion

Admin and users Network graphical view Query tools Application developers and researcher API to directly access the network description

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 15 / 16

slide-65
SLIDE 65

Conclusion

Admin and users Network graphical view Query tools Application developers and researcher API to directly access the network description Projects that need such of representation Bulk Data Transfer Service (BDTS) Virtualisation and Reconfiguration Service (SRV) HiperCal/HiperNet : Virtual Cluster/Virtual Network Overlay High Speed Transport To Service (HSTTS)

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 15 / 16

slide-66
SLIDE 66

More informations

Grid5000 https://www.grid5000.fr OAR http://oar.imag.fr Kadeploy http://kdeploy.imag.fr

Aur´ elien CEDEYN Pascale PRIMET (INRIA) Grid’5000 network topology use cases October 15, 2007 16 / 16