GANT network architecture Fibre and Photonic layers Guy Roberts, - - PowerPoint PPT Presentation

connect • communicate • collaborate

GÉANT network architecture – Fibre and Photonic layers

Guy Roberts, DANTE 21 November, 2012

connect • communicate • collaborate

Contents

Update on the new GÉANT DF footprint Diversity analysis of new fibre footprint New 100G coherent photonic layer: Infinera Network design decisions AAPs and flexibility points in the network

connect • communicate • collaborate

New Dark Fibre: eliminating shared risks

connect • communicate • collaborate

DF procurement

4

Current leases on GÉANT DF expire in 2015 To support the migration we decided to re-procure dark fibre early – having a second pair of fibres during migration makes process easier and reduces customer outages. ‘Hot swap’ of equipment on existing fibre will be necessary in some locations and will be a logistical challenge. Contracts have been awarded, 5 DF providers: Colt, Telia Sonera, Interoute, Level3, Pantel New fibre leases run to 2020.

connect • communicate • collaborate

New DF footprint: up to 2020

5

connect • communicate • collaborate

Major fibre cut between Geneva and Basel - has happened at least

• nce in the past and resulted in loss of both GEN-FRA and GEN-

MIL IP traffic between Geneva and Milan (and S&E of there) will reroute around a very long loop: Geneva-Paris-London-Brussels-Amsterdam-Frankfurt-Prague- Bratislava-Vienna/Budapest... Shared risk between GEN-FRA and GEN-MIL has been eliminated Shared risk between AMS-FRA and AMS-COP has been eliminated Shared risk in Frankfurt has been almost completely eliminated

6

Shared risk Geneva – and others

connect • communicate • collaborate

To Paris To Madrid To Frankfurt To Milan

Shared risk

GÉANT DF footprint 2006-2012

connect • communicate • collaborate

Shared risk Zurich-Geneva solved

connect • communicate • collaborate

Dusseldorf-Frankfurt : today

connect • communicate • collaborate

Dusseldorf-Frankfurt : solution

connect • communicate • collaborate

Frankfurt metro: today

GÉANT: Frankfurt dark fibre metro routes

Shared risk?

connect • communicate • collaborate

Frankfurt metro : Solved

connect • communicate • collaborate

GÉANT3 procurement: New 100G coherent photonic layer

connect • communicate • collaborate

Transmission Equipment Procurement

14

Alcatel DWDM transmission equipment no longer meets our needs (100G in particular) Procurement process was completed this year and Infinera is now

• ur transmission equipment provider.

Rollout of DTN-X equipment has begun on Geneva – Budapest route

connect • communicate • collaborate

DANTE’s role

15

DANTE builds and operates the GÉANT network on behalf of the NRENs (outsourcing model) Large network (180+ sites) small team Around 30 NRENs as owners makes for a challenging operating environment Heavy reliance on vendors for roll-out New emphasis on project management and transmission expertise 5 transmission engineers in operations and 6 project managers for GÉANT project mangement

connect • communicate • collaborate

Lessons from procurement process

16

Don’t be tempted to focus too much on detailed solutions in your Invitation-To-Tender. It is more important to be rigorous in your definition of the problem space. This will leave vendors to come up with innovative solutions. Don’t make assumptions about the cost of engineering solutions – equipment vendors can pull surprise discounts. Each vendor will have equipment architectures that scale in unique ways, so an accurate statement of beginning-of-life and end-of-life network capacity will help achieve cost. For example long-haul topology of GÉANT backbone suits Infinera than it would in a metro network.

connect • communicate • collaborate

GÉANT: 10Gb/s wavelengths in 2010

All lambdas....

connect • communicate • collaborate

GÉANT Fibre (2010)

6 fibre providers:

• Level3
• Colt
• Interoute
• TeliaSonera
• Invitel (previously

Memorex and Pantel)

• Global Crossing

G.655 (E-LEAF)

• All Western ring
• Madrid, vienna...

G.652 (SMF)

• Routes to Copenhagen
• Eastern ring (?)

4 3 5 5 1 1 1 1

PoP-PoP distance (km)

14 17 24 44 31 18 5 4 7

Hut-hut distance (km) Some long routes!

connect • communicate • collaborate

Up to 8Tb/s capacity on ILS in initial release

Up to 80 x 100G channels with ULH reach PIC‐based 500Gb/s DWDM line cards

5Tb/s Bandwidth Virtualization in single bay

Fully non‐blocking OTN and P‐OTN switching Wave, sub‐wave, super‐wave switching In‐service expansion to multi‐bay, non‐blocking 50Tb/s switching

Multi‐layer GMPLS, MPLS‐TP

Software intelligence for OTN & packet services

The Infinera Solution – DTN-X

Next-gen PIC-based DWDM GMPLS & MPLS-TP Control Plane Next Generation Integrated WDM Transport, OTN, & Packet Switching platform

Bandwidth Virtualization Multi-Tb/s OTN & Packet Switch

connect • communicate • collaborate

Digital ROADMs

• Separate WDM/ROADM & OTN switching

layers

• Sub- grooming & muxing only with OXC
• Manual grooming complexity or extra cost

for OXC

• Integrated WDM and OTN/packet

bandwidth management

• Sub- grooming at every node
• End-end service management, PM and

OAM

OXC

O O O O O O O O O O O O O O O O O-E-O O-E-O O-E-O O-E-O O-E-O O-E-O O-E-O O-E-O O-E-O O-E-O O-E-O O-E-O

ODU0 & packet bandwidth management OTN & packet services

Conventional WDM Networks Infinera Digital Optical Network

connect • communicate • collaborate

Coherent Transmission and Super-Channels

Traffic Growth 1998 2000 2010 2014 2012 2002 2004 2006 2008

Super-channel: several DWDM carriers combined on

• ne line card to create a channel >100G

Turn up more capacity in a single operational cycle Scale fiber capacity and reach

Support next generation data service rates >100GbE

Data Rate 2.5G 10G 40/100G 500G 1Tb/s

Enabling Technology

CD Management

Coherent Super-Channels

All of these are problems of scale

connect • communicate • collaborate

Photonic integration

500G Tx PIC

RF Fanout

MZ Modulator Driver ASIC Control ASICS Ceramic Package

500G Tx PIC 500G Rx PIC

Output Fibers 500G Rx PIC TIA ASIC

Stacked Ceramic LGA Package Thermoelectric Cooler

500G Rx PIC

connect • communicate • collaborate

Line side capacity & redundancy

500G capacity on all trunks from Day1, up to 2 Tbps end-

• f-life

GMPLS enabled to support restoration At least 250G headroom on all trunks on Day 1 – will make planning simpler and will support restoration. Resilience of the system is assured with the use of protection for all cards – except for client interfaces – use pair of OTMs to remove single point of failure

connect • communicate • collaborate

Move to all coherent transmission

We are re-engineering the passive photonic layer to take advantage of coherent technology

• Addition of some new ILA sites (where huts have

previously been “skipped”)

• Removal of dispersion compensation fibre (good for

latency)

• The addition of gain equalisers in some ILA sites

connect • communicate • collaborate

Optical Design Future optical flexibility points

Fibre has been chosen with the possibility of future optical ‘flexibility points’ in mind. Lyon, Zurich and Hamburg are all fibre cross-over points that could accommodate a DTN-X Milan, Hamburg and Zurich are candidates for AAPs. Milan will get an AAP on day 1. Hamburg planning is on- going.

connect • communicate • collaborate

All Photonic sites

connect • communicate • collaborate GARR backup 100G access (IP + GEANT+) GEANT-Caldera GEANT-Lancetti GARR -Lancetti GARR -Caldera XTC-4 XTC-10 GEANT-Marseille GARR primary 100G access (IP + GEANT+) GEANT IP 100G GEANT-Geneva GEANT-Vienna XTC-10

Milan final setup (connections)

27

connect • communicate • collaborate

Summary

A new fibre footprint improves the resilience of the network. GÉANT has procured new equipment for the transmission and switched layers of the network. The Ethernet switching layer rollout is now complete The Transmission layer rollout has started and is expected to be completed in Q2 2013

28