[PPT] - Contents 1. CARRIOCAS Challenges and Project presentation Cliquez PowerPoint Presentation

SLIDE 1

Grid vs. Cloud Computing and Why This Should Concern the Optical Networking Community

OFC/NFOEC 2009

« Virtualizing and Scheduling Network resource for

Emerging IT services: the CARRIOCAS approach »

Pascale Vicat-Blanc Primet (INRIA) Dominique Verchère (Alcatel-Lucent Bell Labs) March 23rd 2009 Optical Fiber Communication Conference and Exposition & the National Fiber Optic Engineers Conference

CAlcul Réparti sur Réseau Internet Optique à CApacité Surmultipliée*

* Distributed/Grid Computing services delivered by Internet Optical Networks with Ultra-high transmission Capacities

Vx/N&N/E/09/xxx

SLIDE 2

2

Cliquez pour modifier le style du titre Contents

1. CARRIOCAS Challenges and Project presentation
2. Efficient Network architecture combining capacity and flexibility
3. Scheduling, Reconfiguration & Virtualization (SRV) service
4. CARRIOCAS Pilot Network and Experimentations
5. Conclusion

SLIDE 3

3

Cliquez pour modifier le style du titre

CARRIOCAS Challenges

To research, design and implement a ultra-high bit rate

network reconfigurable according to grid applications connectivity requirements

Transmission capacity 40Gbit/s per wavelength*
Enhanced application-network interactions with SRV
Guarantied network service deliveries in function of

Application QoS requirements.

To develop new Services & Usages
collaborative engineering on virtual prototypes
Computing Intensive Simulation Applications
interactive visualization
To specify new business models of services

integrating IT access and connectivity

The 40Gb/s transponder prototypes have been successfully deployed on Bruyères-le-ChâtelSaclay and SaclayClamart links, performance are at nominal level.

SLIDE 4

4

Cliquez pour modifier le style du titre

Academia SME’s Industrials

CARRIOCAS Partnership

Financial partners:

Application Computing Networking Optics

Oct 2006-Sept 2009

LIST

SLIDE 5

5

Cliquez pour modifier le style du titre

Relative Cost comparisons over 2007 - 2012

0.5 1 1.5 2 2.5 3 3.5 4 4.5 5 5.5 6 2007 2008 2009 2010 2011 2012

Year

Router over Photonic X-Connect Carrier Ethernet Switch over Photonic X-Connect Router over SDH X-Connect Carrier Ethernet Switch over SDH X-Connect Router over WDM Carrier Ethernet Switch over WDM

0.00
5.00
10.00
15.00
20.00
25.00
30.00
35.00
40.00

Tbps

Traffic Evolution

Network Traffic flow characterizations «Data Grid» generated by large
rganizations (companies and institutions) users (clients) and datacenters

(IT resource providers)

CARRIOCAS Service optimized Optical Network dimensioning and sizing

(°) (*)

Carrier Grade Ethernet Switch over SDH X-Connect(°)
TSS over ROADM: CARRIOCAS based architecture (*)
Layer 2 (Carrier Grade Ethernet) and Layer 1 (WDM) reconfiguration capabilities
Most Scalable Solution absorbing the increases of data grid traffic demands

SLIDE 6

6

Cliquez pour modifier le style du titre

UNI

Edge Nodes Provider Edge Node

(G)MPLS controlled Network UNI

Provider Node (P) P P P PE PE Picture Walls (Visualization Resources) Scientific Instruments/Sensors (Acquisition Resources) Usage SLA

Service Storefront

CPU Resources Storage Resources Specific Software (AppsResources) Service Integrator & Presentation Provider SLA

Network Service Management (S.R.V.)

Bio-informatics Scientists High Energy Physic engineers

!! !!

IT infrastructures

!! !! Telecom Infrastructure Operator Grid Service Provider

Provider Edge Node (PE) Car Designers – Manufacturers

Datacenter Operators Customers (Enterprises)

CE Customer Edge node (CE) CE P P

Towards Virtualized Infrastructures and «Extended Service Providers»

Connectivity Services

SLIDE 7

7

Cliquez pour modifier le style du titre

CARRIOCAS services suited for Grid Applications

V1 : Connectivity services
Requirements: to guarantee Quality of Experiences for grid application users
Adaptive connections configurations with QoS guarantee (bandwidth, latency,

availability …) negotiated according to Grid Application workflow needs

Technology enabler: GMPLS, PCE, Timed based Network management
V2 : Full Virtualized services
Requirements: To integrate grid resources management for executing

the Grid Application workflows

Selection, reservation and interconnection of Computational, Storage

and Visualization Centers which may come from 3rd party resource infrastructure providers (e.g. datacenters, HPC-centers)

Co-selection and cross-optimization of network and grid (application)

resources

Technology enablers: WSRF, and network protocols

+ VXDL & VXcore (INRIA),

SLIDE 8

8

Cliquez pour modifier le style du titre

One Data flows can be mapped on one EVC allocated on dedicated WDM

Binding of VISUPIPE flows (jobs) and Carrier Grade Networks services (resources)

Automatic Switched Optical Network

Transport Service Switch

(Ingress ROADM) OCh

[PSC,WDM] TE-link TSS Add/Drop Ports

OCh

TSS Add/Drop Ports

Transport Service Switch

PSC

(Egress ROADM)

PSC TE Link ⇔ WDM FA-LSP Automatic end-to-end Ethernet Virtual Circuit provisioning

[WDM,WDM] TE-link [WDM,WDM] TE-link [WDM, PSC] TE-link PSC

WDM LSP

Dynamic mapping (CE-VLAN) Mapping (CE-VLAN

3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D 3D

Data Source Cluster File System Data transformation: Volumetric transfer function, Surface construction Filtering Rendering Display

Raw data Transformed data Filtered data Frame buffer

24 Mpixels x 32 bits x 30 images/s x 2 for stereo = 46,08 Gb/s
Low latency requirements for interactivity
Visualization pipeline partitioning and mapping on Grid IT Resources

SLIDE 9

9

Cliquez pour modifier le style du titre

Consultation Network

Res. Scheduler

Timed TED Requests / Reponses Cds Management : Read / Write

Scheduled

PCE

Planning tools TED Synchronization/ Alimentation NMS Resource inventory NE NE NE NE NE A B D E IGP-TE

NE NE NE NE NE A B C 2 3

Service Provider ’s Carrier Network Ai

n /

u

t

= 20Gbps B i

n /

u

t

= 4 0Gbps Ci

n /

u

t

= 20Gbps

NE A B C

B i

n /o u t =40Gbps

Service Provider ’s Carrier Network Ai

n /o u t =20Gbps

C i

n /o u t =20Gbps

Business vie Service view Network view Element view

NE NE NE A B C

Service Provider ’s Carrier Network A

i n /

u

t

= 20Gbps Bi

n /

u

t

= 40Gbps C i

n /

u

t

= 2 0Gbps

NE NE NE NE NE A B C

Service Provider ’s Carrier Network Ai

n /

u

t

= 20Gbps B i

n /

u

t

= 4 0Gbps C i

n /

u

t

= 2 0Gbps

Connection inventory NetConf. Transport Networks Commercial Filters (policies) Consultation Network

Res. Scheduler

Timed TED Requests / Reponses Cds Management : Read / Write

Scheduled

PCE

Planning tools TED Synchronization/ Alimentation NMS Resource inventory NE NE NE NE NE A B D E IGP-TE

NE NE NE NE NE A B C 2 3

Service Provider ’s Carrier Network Ai

n /

u

t

= 20Gbps B i

n /

u

t

= 4 0Gbps Ci

n /

u

t

= 20Gbps

NE A B C

B i

n /o u t =40Gbps

Service Provider ’s Carrier Network Ai

n /o u t =20Gbps

C i

n /o u t =20Gbps

Business vie Service view Network view Element view

NE NE NE A B C

Service Provider ’s Carrier Network A

i n /

u

t

= 20Gbps Bi

n /

u

t

= 40Gbps C i

n /

u

t

= 2 0Gbps

NE NE NE NE NE A B C

Service Provider ’s Carrier Network Ai

n /

u

t

= 20Gbps B i

n /

u

t

= 4 0Gbps C i

n /

u

t

= 2 0Gbps

Connection inventory NetConf. Transport Networks Commercial Filters (policies)

9

SRV position in Telecom Network

Scheduled Management Components of Network Resources Network Management Function Layer Connectivity Services (v1) Virtualized Services (v2) Scheduling, Reconfiguration & Virtualisation

S.R.V. Service Negotiation Service Negotiation Shared Information / Data Model Shared Information / Data Model Service Selection Composition Service Selection Composition Resource abstraction / Virtualization Resource abstraction / Virtualization Policies Policies Service Publication / Notification Service Publication / Notification Patterns (WSLA) Patterns (WSLA) Contracts Contracts Scheduling Scheduling Processes Processes S.R.V. Service Negotiation Service Negotiation Shared Information / Data Model Shared Information / Data Model Service Selection Composition Service Selection Composition Resource abstraction / Virtualization Resource abstraction / Virtualization Policies Policies Service Publication / Notification Service Publication / Notification Patterns (WSLA) Patterns (WSLA) Contracts Contracts Scheduling Scheduling Processes Processes

SRV

SLIDE 10

10

Cliquez pour modifier le style du titre

CARRIOCAS Demonstration platform

CARRIOCAS pilot network demonstrates advanced network service functions and proving their concepts through an emulation platform Feasibility of automated network management and control with dynamic delivery of Telecom network services to end users: e.g. company customers. The first steps are focused on Connectivity services managed through a well defined Service Management System (SRV) described. Each connectivity service is designed with specific attributes including:

Service Access points (UNI), throughput (x Gbps), end-to-end latency (y ms), time interval [T1,T2]

GMPLS based control protocols, Timed based PCE, Network Resource Scheduler with Carrier Switches and Wavelength Cross-connects as connection services are based

n Ethernet Virtual Circuit over Wavelength connections:
Provisioned: through NMS with automated network Operations through MTOSI 2.0 (triggered by SRV)
Signaled: RSVP-TE provides dynamic E2E guaranteed QoS on two routing areas

SLIDE 11

11

Cliquez pour modifier le style du titre Service Activation Interface : SRV-NRS

Connection Service Component Activation: EVC Services
SRV  NRS (phase 1): Timed EVPLINE, EVPLAN, E-TREE provisioning
TE management  Connection Provisioned Monitoring NRS  SRV-DB
Background and periodic process (from Network States)
Downward information: SRV  NRS
Connectivity topology is an Ethernet Service graph
Access points: location,
Bandwidth (pipes)
Latency on the links
Commands for new connectivity services
Feasibility
Reservation
Provision
Activation
Upward information: NRS  SRV
Connection status:
Reserved / Available
Provisioned / Unprovisioned
Activated (i.e. used) / De-activated
Shared Info/Data Model based on MTOSI 2.0 / TMF
SCAI: Resource facing Interfaces (Connection data model)

SLIDE 12

12

Cliquez pour modifier le style du titre

Connection Services Connectivity Services

Ethernet  MPLS-TP over WDM Network architecture referencing :
Reconfigurable-OADM based WDM transmission: 1626LM (with 40 Gbps)
Carrier Grade Ethernet based Transport Networks: 1850TSS
Network Configurations based on Management: 1350-OMS service functions
Large Scale Distributed Applications (Grid Applications):
Computing and Storage Service on Demand (Ter@tec): LUSTRE CFS Application
Instruments: Industrial (Remote Visualization): EDF Picture Walls

References on Experimentation plans

1626LM

Network Network Controller Controller Network Controller Network Controller Network Network Controller Controller Network Network Controller Controller

Univ. Orsay

(PoP 2) EDF Clamart (PoP 1) CEA-Saclay (PoP 3) CEA Ter@tec (PoP 4)

Grid Application Client / Server Application Client

Visual. Server

Network Management Systems Network Management Systems (1353NM (1353NM – – 1354BM-Ethernet) 1354BM-Ethernet)

HPC + Storage Servers

Application Client Storage Server

High-Capacity transmission λ: nx10 Gb/s

10Gb/s Interfaces (Ethernet frame aggregation ove

1626LM Ethernet Switch (Customer Equipment) 1850 TSS-320 (Provider Edge)

Transmissions: λ: 4x10 Gb/s  40 Gb/s

Negotiation protocol Negotiation protocol (e.g. WS-agreement based) (e.g. WS-agreement based) Advertisement protocol Advertisement protocol (e.g. WS-notification based) (e.g. WS-notification based)

North Bound Interface North Bound Interface South Bound Interface South Bound Interface

Scheduling Reconfiguration & Virtualization (SRV) service Scheduling Reconfiguration & Virtualization (SRV) service Scheduling Reconfiguration & Virtualization (SRV) service Scheduling Reconfiguration & Virtualization (SRV) service

Ethernet Switch (Customer Equipment) A1850 TSS-320 (PE) 1626LM 1626LM PE CE CE PE link 1 l i n k 3 link 2 l i n k 4

Requests Requests Delivery Delivery

SLIDE 13

13

Cliquez pour modifier le style du titre

CARRIOCAS Network Pilot and test bed configuration

4x10 GEth. Access

Deployment phase 1 (10Gb/s): June 2007 Deployment phase 2 (40Gb/s): June 2008

Lambda 1 à 10G omnibus Lambda 2 à 10G Lambda 3 à 10G Lambda 4 à 10G Lambda 5 à 40G

Légende

Saclay

Bruyères Le Châtel

Orsay Clamart

Trib 40G prototypes fournis gracieusement par Alcatel dans SP1 durant la vie du projet 4 x 10GEth.

Transport Service Switch

Carrier Grade Ethernet with T-MPLS capabilitie

Nx10 Gbps Transmission

Local monitoring

Network Management

1850 TSS 1626 LM

Ter@tec

storage storage Super-computers Picture wall Issy les Moulineaux

1354BM 1353NM

4 x 10GEth. 4 x 10GEth. 4 x 10GEth.

Local monitoring

40 Gbps Transmission

SLIDE 14

14

Cliquez pour modifier le style du titre

Towards Network Centric Cloud Computing

Respond to strong demands by Organizations on accessing High-

Performance IT services remotely through WAN with strict QoS:

Grid  Cloud Computing towards Utility Computing
Service optimized Transport Networks & Data Grid Facilities will be

built on different requirements to offer e-science services

Depending if Public or Private owned infrastructures
Needs to coordinate our efforts for standardizations
SRV v1 software, developed by INRIA, automates:
Support for different network services offered by multilayer networks (Lx-VPN)
Mapping of applications/users requirements over connectivity services
Fine grain Dynamic Bandwith Requests scheduling
Connection service Reconfiguration  Optimization  X-optimization
Standardization efforts at ETSI (Grid TC) led by BT and Alcatel-

Lucent with contributions from BT, FT, Telefónica, Nokia-Siemens,

close follow-up at Open Grid Forum (through Phosphorus collaboration)

SLIDE 15

15

Cliquez pour modifier le style du titre

Special thanks to PHOSPHORUS and G-Lambda projects for their stimulating and valuable interactions

Questions ?

Many Thanks to CARRIOCAS-SP2 Colleagues for their contributions French Ministry of Industry, Essonnes, Haut-de-Seines and Paris General Council for their supports on CARRIOCAS project http://www.carriocas.org

SLIDE 16

16

Cliquez pour modifier le style du titre CARRIOCAS Network Environment

Emulated Platform is based on CARRIOCAS network pilot architecture*
Two Routing Areas (1 per switching layer): (i) CGEthernet (ii)

Wavelength

5 PoP emulated, each PoP is
Carrier Switch (Ethernet-switching capable) + PXC (Lambda-switching capable)
10 Node controllers (5+5): RSVP-TE + OSPF-TE
2 Path Computing Engines (1 per layer): PCEP, OSPF-TE
1 NMS: performs resource inventory at L2 and L1
Dynamic Ethernet LSP establishments
5 EVPLINE services
1 EVPLAN service (4 locations)
Static Wavelength LSP characterized by
Capacity: 3x10Gbps, 1x30Gbps,

1x40Gbps

Latency: 1ms ≤ t ≤ 10 ms

UNI λ / GMPLS

LSR1 Wavelength connection 1

OADM node

CORE LSR2 Routing Area 1 Routing Area 0

Wavelength X-Connect

Intermediate edge node Ingress node Egress node

Ethernet LSP 2

Virtual Topology

Carrier Grade Ethernet Network services

Ethernet LSP 1

W a v e l e n g t h c

n

n e c t i

n

2 * Mais contient des fonctions supplémentaires

SLIDE 17

17

Cliquez pour modifier le style du titre

5 point-to-point Ethernet LSP (E_LSP): E_LSP(ERO,BW(Gbps),delay(ms))
E_LSP_1 ({AB},5,1); E_LSP_2 ({ABC},10,5); E_LSP_3 ({A↔C},40,1); E_LSP_4 ({AC

D},20,10); E_LSP_5 ({A↔B↔E},15,5);

1 point-to-multipoint Ethernet LSP:
E_LSP_ 6({tree_1},10,10);

MTOSI Commands (over HTTP/SOAP - AXIS) NRS Agent

Network Management System

6Network configuration implementation (1/2)

SRV

SRV-DB

S-PCE Service Scheduling

TE-Link DB

S-PCE

TE-Link DB

PCC XML NetConf RPCs PCEP Commands (RPCs) RSVP-TE + OSPF-TE LSRs Layer 2 Switch Capable (51) RSVP-TE + OSPF-TE LSRs Lambda Switch Capable (150)

TE-link TE-link

PMSER algorithm LSR_A LSR_D LSR_E LSR_B LSR_C LSR_1 LSR_3 LSR_2 LSR_4 LSR_5

C B D E A

tree_1

SLIDE 18

18

Cliquez pour modifier le style du titre

Network configuration implementation (2/2)

5 wavelength LSPs (L_LSP): L_LSP(ERO, BW(Gbps)
L_LSP_1 ({1 ↔ 4},10); L_LSP_2 ({1 ↔(4)↔ 3},30); L_LSP_3 ({1↔(5)↔ 2},40); L_LSP_4 ({2

↔ 3},10); L_LSP_5 ({1 ↔ 5},15);

Scenarios – Connectivity services managed by SRV
T0=1 (January 1st) , T1=55 (February 24th), duration=nb of slots (1 time_slot = ½ day),

e.g. duration = 60 (30 days)

5 ms 10 ms 1 ms 5 ms 100ms 5 ms e2e delay (ms) 15 / 10 30 / 10 5 / 1 20 / 10 10 / 5 38.4 / 30 Gbps

Max. Throughput/

Guaranteed BW. 99.99% 99.9 % 99.999% 99.999% 99.999% 99.999% Service availability Application_id (information) T1/duration End-points Tele-Call-Conf 30 / 16

C{A,E,D}

Data Storage 35 / 12 D  C Video- Streaming 38 / 6 E  D Ultra-high

perf. Visu

24/20 A ↔ D Back-up Storage 26/60 AB Ultra-high

perf. Visu Coll.

23/10 A ↔ B

T1-ε T2 = T1 + duration T2+ε T0