Implementation of a new Optical Platform in X-WiN Peter - - PowerPoint PPT Presentation

Implementation of a new Optical Platform in X-WiN

Peter Kaufmann/DFN TERENA Network Architects Workshop

• 22. November 2012

Agenda

• Reasons & Requirements
• Results
• Status of Implementation

Page 2

Reasons & Requirements (1)

Why change?

• Capacity: Less than 50% of our lambdas are in use!
• Upgrade towards 40/100G only with new h/w
• Current equipment is approaching end of life (from 2006)

(investments into old h/w not usefull)

Most important

• Operational inflexibilities very annoying


– as lambdas has to be changed – as more native lambda services are provided/added – as transponders are dedicated/configured for each connection

Page 3

Reasons & Requirements (2)

Add flexibility

• Transparent lambdas between any core nodes (no OEO)
• Protected lambdas
• Easy and quick channel setup
– rapid service delivery
–

flexible use of transponders
– ability to reroute lambdas easily in case of serious link problems

• Optical switching facilities at fiber junctions
• Sub-Lambda switching facilities (OTN) (due to 10/100)

Page 4

Reasons & Requirements (3)

But also: Increase transport capacity

• compensate traffic growth
• native 100G/channel capability for our most demanding

users

Page 5

Reasons & Requirements (4)

New optical transmission system

• About 80 lambdas
• Support for native 10G & 100G services
• Transparent lambdas between any core nodes (~1000km reach)
• ROADM: directionless & colorless (not fully contentionless, no flexgrid),

integrated OTN-Switching

• Migration philosophy


– On top of current fiber infrastructure (only few add. fibers) – 100G transponders where needed, when needed – Smooth migration, no operational „shut down“

Seite 6

Results

• Call for tender (non open, 2 stages): November 2011

– After stage one, reduction to „some serious“ participants

• Acceptance of tender: 10. May 2012
• Winner

– ECI Telecom, http://www.ecitele.com – Israelien company, founded 1961 – about 2500 employes – New player in „NREN environment“

• Contract & order for migration: 14. May 2012
• Product family „Apollo“

– Optimized Multilayer Transport (OMLT) – integrated DWDM-/Switching-equipment – DFN: OPT9624 at all core nodes (plus OPT9608 for some clients)

Seite 7

Results: ECI OPT96xx „Apollo“

Seite 8

OPT9624/48 for Metro Core and Core/Regional/LH

 24/48 universal I/O slots  Tbit/s Universal Switch:

ODU X-connect/Packet Switching

 Flexible configuration:

Photonics, ODU-XC, Packet switching

OPT9608 for Metro Edge

 8 universal I/O slots  Flexible configuration: standalone WDM,

100G MPLS switching capacity

OPT9604 for Metro Edge

 4 universal I/O slots  50G MPLS switching capacity

OPT9603 for Metro access and In-Line amplifier Artemis

 OPT9603 - 2U height with 3 universal slots  Artemis: passive cages

Quelle: ECI Telecom

Results: Fiber set-up

• High Capacity

– 88 Lambdas per Fiber – Bandwidth up to 100 Gbit/s per Lambda

• Flexible Routing of Connections

– Reconfigurable Optical Add-Drop Multiplexer (ROADM) – Colourless/Directionless Add-Drop – Tunable Transponder

• Switching Functions

– Optional: 1Tbit/s Switching-Fabric per Node – Currently: Usage as ODU Cross-Connect – Future: In addition usage as MPLS- and Ethernet-Switch

Seite 9

Bandwidth in Core of WiN (Wissenschaftsnetzes):

Capacities in Generations of WiN

Seite 10

B-WiN 1995: 0,622 Gbit/s G-WiN 2000: 10 Gbit/s X-WiN 2006: 400 Gbit/s X-WiN 2012: 8.800 Gbit/s

Results: Fiber set-up

Amplifier

• Raman amplifiers compensate excessive attenuation on

long spans

• New: Mixture of Raman, EDFA
• Requires additional maintenance procedures

Redundancy

• Customer connection: Redundant fiber with two Core Nodes

(nearly all customers, 77% had not even 1 second interruption in 2011)

• Further extension of redundant fiber connectivity

Seite 11

Results: ROADM

• High Capacity

– 88 Lambdas per Fiber – Bandwidth up to 100 Gbit/s per Lambda

• Flexible Routing of Connections

– Reconfigurable Optical Add-Drop Multiplexer (ROADM) – Colourless/Directionless Add-Drop – Tunable Transponder

• Switching Functions

– Optional: 1Tbit/s Switching-Fabric per Node – Currently: Usage as ODU Cross-Connect – Future: In addition usage as MPLS- and Ethernet-Switch

Seite 12

Results: ROADM

ROADM functionality

• Colourless: Flexible A/D on any available Lambda
• Directionless: Flexible mapping on any required Direction

(But still uni-directional use of each part of fiber pair)

• Contentionless: Blocking-free switching of same colours, requires add. WSS

(Not that important for DFN, partially possible, not 100%)

• Flexgrid/Super Channels: Not required for DFN use cases during life time of gear
• Each ROADM configuered with at least: 4 degrees + 2 A/D blocks,

extension to 9 degrees possible

• OTN-Switch complements sub-lambda switching done in routers
• Restoration by ROADM: Switch time 1sec

Seite 13

ROADM: Optical Architecture

Page 14

Source: ECI Telecom

ROADM: L1 Service Cards

Page 15

Multi service 10G Muxponder or AoC

AoC10

Multi service 10G double Transponder

TR10_4

Multi service 40G RZ-DQPSK Muxponder

CMB40

OTU3 Regenerator

REG40

Transponder/ Muxponder 100G

TR100

Source: ECI Telecom

ECI: ROADM/Service-Cards

page 16

West

Local A/D

East North

FIO10_5: 5*XFP -> Fabric

Fabric

TR10_4: 2*XFP -> 2*XFP-OTU2/2e FIOMR_16: 16*SFP -> Fabric AoC10: 16*SFP -> 2*XFP-OTU2

Client

Without Fabric: L1 Service Cards With Fabric: L1 Fabric Cards

TR100: 1*CFP -> 1*CFP-OTU4 (later) FIO100: 1*CFP -> Fabric (later) FIO10_5: 5*XFP -> Fabric (later)

Results: Switching

• High Capacity

– 88 Lambdas per Fiber – Bandwidth up to 100 Gbit/s per Lambda

• Flexible Routing of Connections

– Reconfigurable Optical Add-Drop Multiplexer (ROADM) – Colourless/Directionless Add-Drop – Tunable Transponder

• Switching Functions

– Optional: 1Tbit/s Switching-Fabric per Node – Currently: Usage as ODU Cross-Connect – Future: In addition usage as MPLS- and Ethernet-Switch

Seite 17

Optical Transport Network (OTN)

Seite 18

Source: Alcatel-Lucent

OTN-Hierarchy

page 19

Source: Alcatel-Lucent

Switching: OTN-BB of X-WiN

Seite 20

• Operation of 1Tbit/s-Fabric (blue-red)

– Initially at 14 core nodes – Optimized with current network structure and latency – If needed: extensible

• OTN-Backbone (yellow)

– Start: 2-3 OTU2-Connections per link – Future: Extension towards OTU3/4

• Access from User/Simple Core

Node to Fabric

– All interfaces use OTH-framing – Single or redundant OTU2e-connection to next one/two core nodes with fabric

Switching: L1 Fabric Cards

Page 21

Low rate client interface

FIOMR_16

Multi service 10G client line Interface

FIO10_5

40G RZ-DQPSK line card

FIO40

100G PM-QPSK line card

FIO100

Source: ECI Telecom

ECI: ROADM/Fabric-Cards

page 22

West

Local A/D

East North

FIO10_5: 5*XFP -> Fabric

Fabric

TR10_4: 2*XFP -> 2*XFP-OTU2/2e FIOMR_16: 16*SFP -> Fabric AoC10: 16*SFP -> 2*XFP-OTU2

Client

Without Fabric: L1 Service Cards With Fabric: L1 Fabric Cards

TR100: 1*CFP -> 1*CFP-OTU4 (later) FIO100: 1*CFP -> Fabric (later) FIO10_5: 5*XFP -> Fabric (later)

Universal Switch Fabric

Seite 23

 The fabric can support ODU-XC,

MPLS switch or any mix of both (depending on the service cards installed in the system).

 Scalable to 4Tbit and future

16Tbit switching capacity (in multi-shelf Architecture)

 ODUk and ODU-Flex XC  Transparency of timing and OH;

Each ODUk container carries its

• wn timing

 Each line card is configured to

work towards the fabric in either OTN mode or data mode

Packet Packet Packet OTN OTN OTN

OTN OTN OTN

Packet Packet Packet

Source: ECI Telecom

Status: Migration Work

• Core Nodes (54)

– about 100 new chassis (power, etc.)

• Intermediate Line Amplifier: 45 Locations
• Fiber links (85)

– Total length about 10.500 km – 33 parallel lines between central Core Nodes

• Lambda connections (167)

– Currently: Gigabit-Ethernet and 10-Gigabit-Ethernet – With max. 18 hops and 2140 km fiber length

Page 24

Status of Implementation

Seite 25

05 06 07 08 09 10 11 12

Planning Location- Infrastructure Implementation Location Infrastructure Training

• f DFN-

Employes Training

• f DFN-

Employes Planning parallel Fiber Infrastruktur Planning parallel Fiber Infrastruktur Provision Parallel Fiber Infrastruktur Provision Parallel Fiber Infrastruktur Preparation of Network Monitoring and Adaption of Information Systems Preparation of Network Monitoring and Adaption of Information Systems Provision and Operation ECI- Components Provision and Operation ECI- Components Planning ECI- Components Planning ECI- Components

Conclusion: Seen from Customer

• Increase of Bandwidth

– 100Gbit/s-Connections for VPN-service and DFNInternet (IP)

• Reduction of Provisioning Time for (new) Services

– Equipment is property of DFN: Better reserve of often required components – Flexibility: Components may used again for other connections

• New Switching Service

– Now: OTN, Mux of several 1Gb VPN over one 10Gb access – Later: MPLS and Ethernet

• Reduction of Cost

– Components for 1Gbit/s- and 10Gbit/s-Connections much cheaper

Page 26

Questions ...?

? ?

?

Seite 27

ROADM – classical

Seite 28

DWDM- Knoten Add/ Drop West

T / R T / R T / R T / R

Add/ Drop East Add/ Drop North

T / R T / R

X

• coloured

– For each „colour“ a specific port per Add/Drop-Block

• Directed

– Exactly one outgoing direction erreichbar per Add/Drop-Block

ROADM – „modern“

Seite 29

DWDM- Knoten Add/Drop

T / R T / R T / R T / R T / R

• Colourless

– each „colour“ at any Add/Drop-Port

• Directionless

– each Ausgangsrichtung erreichbar at any Add/Drop-Port

Gigabit AoC / Client-Card

Seite 30

2xXFP OTU2 colored uplinks 16xSFP colored uplink

Source: ECI Telecom

10G Transponder / Fabric Card

Seite 31

2xXFP OTU2/2e/2f colored uplinks 2xXFP FC8/10,STM-64/OC- 192/10GBE/OTU2/2e B&W or colored I/Fs 5xXFP FC8,STM-64/OC-192/10GBE/OTU2/2e B&W or colored I/Fs

Source: ECI Telecom

Variants of „Apollo“

Seite 32 Pure WDM Application Metro Core / Regional / LH OMLT Metro OMLT Application CESR Application

 24 universal slots  Photonics modules  Service cards  L1 service cards  2 slots for 100G

fabric cards

 22 universal slots  Photonics

modules

 Service cards  L1 service cards  L2/3 Data cards  4 slots for 1Tbps

universal fabric cards

 20 universal slots  Photonics modules  Service cards 

L1 service cards



L2/3 Data cards

 4 slots for 1Tbps

universal fabric cards

 20 universal slots  Service cards  L2/3 Data cards

Photonic layer

Photonic layer

Photonic layer

Photonic layer

Source: ECI Telecom

Service Restoration

Seite 33

R O A D M

C

S P L I T

A

Main Path

A C E H F G

1st Restoration Path

Restoration by ROADM. Switch time 1sec

2nd Restoration Path 3rd Restoration Path

Deutsches Forschungsnetz

KAI BON ZEU LEI KEH KI E Seite 35 Glasfaserpaar ,( Bestand, nicht parallel) SAA GAR ERL BAY FZJ AAC BI R POT TUB FZK GSI BRE HAN BRA MAG BI E FRA HEI STU REG DRE CHE ZI B I LM JEN HUB ADH AW I BAS ENS STB HAM DES DKR ROS SLU KAS PAD GI E MAR GOE DOR W UP FHM EW E W UE GRE DUI MUE

Bereitstellung Glasfaserstrecken

FFO Glasfaserpaar ( vorhanden) Glasfaserpaar ( parallel, beauftragt) Glasfaserpaar ( parallel, Übergabe erfolgt) BOC Glasfaserpaar ( parallel, Fertigstellung bis Ende Oktober)

KAI BOC BON ZEU LEI KEH KI E Seite 36 Glasfaserpaar ,( Bestand, nicht parallel) SAA GAR ERL BAY FZJ AAC BI R POT TUB FZK GSI BRE HAN BRA MAG BI E FRA HEI STU REG DRE CHE ZI B I LM JEN HUB ADH AW I BAS ENS STB HAM DES DKR ROS SLU KAS PAD GI E MAR GOE DOR W UP FHM EW E W UE GRE DUI MUE

Stand Installation der Technik

FFO Glasfaserpaar ( vorhanden) Glasfaserpaar ( parallel, beauftragt) Kernnetzknoten ( bereits aufgebaut) Kernnetzknoten ( geplant KW 4 2 ) Kernnetzknoten ( geplant KW 4 3 ) Kernnetzknoten ( geplant KW 4 4 ) Kernnetzknoten ( geplant KW 4 5 )

Beteiligte Einrichtungen

• DFN Geschäftsstellen in Berlin und Stuttgart
• ECI Telecom

– beschäftigt zusätzlich Montagefirma für Aufbau DWDM-Technik (7 Teams) – zusätzlich 6 eigene Teams für die Inbetriebnahme

• Glasfaserprovider

– stellen parallele Faserstrecken bereit und Stellflächen/DC-Versorgung an ILA-Standorten – insgesamt 10 Firmen

• Dimension Data

– Installationen an Kernnetzknoten (koordiniert zusätzlich Montagefirmen für Schrankaufbau und Installation von Vorverkabelungen) – Ersatzteillogistik (Zentrallager plus 10 regionale Depots)

• Gastgebende Einrichtungen an Kernnetzknoten

– zusätzlich Elektriker für die Installation von Stromversorgungen

Seite 37

Installationen an Kernnetzknoten

Seite 38

• 48V/DC Netzteile

– je 1-2 Chassis für USV/NS – Kapazität je Gerät 4kW (zzgl. 2kW Spare)

• Fibre-Spooler/Cable Guides

– „saubere“ Führung von Glasfaserkabeln

• Passivgehäuse „Artemis“

– Aufnahme von passiven Modulen (bspw. optische Splitter)

• Apollo 9624

– 1-4 Geräte je Standort – Aufnahme der aktiven Komponenten (Verstärker, ROADM, Line-/Fabric-Karten)

Installation am Standort JEN

Seite 39

• KNK Universität Jena (JEN)

– drei Kernnetzfasern – zehn 10G-Verbindungen – drei ECI OPT9624 Chassis

• Stellflächen

– Aufbau in nur einem Datenschrank, Bestückung von Vorder- und Rückseite – bisher wurden 3 Stellflächen genutzt

• Spannungsversorgung

– komplett redundant bzgl. Equipment und Versorgungszweig – kann zukünftig überwacht werden

Installation am Standort JEN

Seite 40

• Separates Chassis für ODU-XC

– drei 5-Port 10G-Karten – je 2-3 OTU2 Trunks zu anderen XCs