Status Report on National and Regional Optical Networking - - PowerPoint PPT Presentation

▶
status report on national and regional optical networking
SMART_READER_LITE
LIVE PREVIEW

Status Report on National and Regional Optical Networking - - PowerPoint PPT Presentation

May 28, 2023 47 likes •337 views

Status Report on National and Regional Optical Networking Initiatives in the United States Steve Corbat Director, Backbone Network Infrastructure TERENA Networking Conference 2003 Section 6b: Optical Networks - Practical Experiences Zagreb,

slide-1
SLIDE 1

Status Report on National and Regional Optical Networking Initiatives in the United States

Steve Corbató Director, Backbone Network Infrastructure TERENA Networking Conference 2003 Section 6b: Optical Networks - Practical Experiences Zagreb, Croatia 21 May 2003

Version 4 – 21 May 2003 6p CET

slide-2
SLIDE 2

5/21/2003 2

Quick summary

Need for concurrent national & regional initiatives now widely recognized in U.S. Challenges

  • U.S. distance scale – 16,000 km national; 2-D country
  • Need for regional optical networks: 3-layer hierarchy

National-scale, facility-based λ network for computational science and network research

  • National Lambda Rail (NLR)

Supporting project for regional optical initiatives – to hold & assign dark fiber

  • Fiberco

Other complementary efforts in progress

  • USA Waves & Northern Tier
slide-3
SLIDE 3

5/21/2003 3

Topics

Abilene

  • How does it relate?

Why optical networking? Critical importance of regional initiatives National efforts

slide-4
SLIDE 4
slide-5
SLIDE 5

5/21/2003 5

Abilene core features

U.S. higher education’s network

  • Natural base for community-wide efforts
  • Native multicast & IPv6, large MTU, measurement,

advanced apps

IPv4+IPv6 common bearer services Bandwidth availability & utilization incentive Peering limited to U.S. & int’l R&E nets Regional aggregation model

  • SONET & DWDM backhaul support

“4+ Nines” reliability target

  • Advanced service deployment with continuous monitoring

Open measurement platform

slide-6
SLIDE 6

Future of Abilene

10-Gbps optical upgrade nearing completion

  • Final backbone λ’s to be installed this summer

Abilene transport (DWDM & SONET) MoU with Qwest in place through October 2006

  • 2 10-Gbps connections – CENIC and Pacific Northwest

New Juniper T640 routers deployed in 2002

  • 8-Gbps transcontinental test flows: IPv4+IPv6 mix & all IPv6

Current peak load ~10% of upgraded bandwidth

  • Traffic doubling time ~ 1 year

Engaged national user community

  • 221 participants (research universities and laboratories)

Ensemble of advanced networking projects

  • Abilene Observatory, native IPv6, MPLS VPN test, E2E support
slide-7
SLIDE 7

5/21/2003 7

Why a national optical facility?

Control of all network layers on national scale

  • Economic drivers

– Expansion capability (λ’s) at marginal cost – Hedge

  • Technical drivers

– New technologies: 10 Gigabit Ethernet and rational optical switching – Influencing development of new protocols at IP/optical interface

Unprecedented marketplace for both fiber and

  • ptical electronics
  • Contrarian opportunity for higher education

New type of network research testbed

  • Differentiated networks for diverse requirements

Key enabler for regional optical initiatives

slide-8
SLIDE 8

5/21/2003 8

slide-9
SLIDE 9

5/21/2003 9

The persistent end-to-end performance problem

  • ‘Bulk TCP’ flows across Abilene
  • Flows with minimum payload transfer of 10 MB

– 2.3 Mbps median – 6.4 Mbps (90%) – 24 Mbps (99%)

netflow.internet2.edu

slide-10
SLIDE 10

5/21/2003 10

Persistence of network hierarchy

Scales of optical network deployments

  • National
  • Regional/State
  • Campus/Metro
slide-11
SLIDE 11

Optical network project scale differentiation

Add OEO regenerators & O&M $’s TeraGrid NG Abilene, Light Rail > 500 Extended Regional/ National Add OO amplifiers I-WIRE (IL), I-LIGHT (IN), CENIC ONI < 500 (LH) <(1.5-2.5k) (ELH/ULH) State/ Regional Dark fiber & end terminals UWash USC/ISI(LA), MAX(DC/MD/VA) < 60 Metro Equipment Examples Distance scale (km)

slide-12
SLIDE 12

5/21/2003 12

Leading & emerging Regional Optical Initiatives

California (CENIC Optical Networking Initiative) Connecticut (Connecticut Education Network) Florida (Florida LambdaRail) Indiana (I-LIGHT) Illinois (I-WIRE) Maryland, D.C. & northern Virginia (MAX) Michigan New York + New England states (NEREN) North Carolina (NCNI) Ohio (Third Frontier Network) Oregon SURA Crossroads (southeastern region) Texas (Star of Texas)

slide-13
SLIDE 13

5/21/2003 13

Current national optical efforts

National initiatives

  • 1) National Lambda Rail (NLR)
  • 4) USA Waves

Supporting projects

  • 2) Fiberco
  • 3) Northern Tier
slide-14
SLIDE 14

5/21/2003 14

National Lambda Rail (NLR)

National-scale optical networking facility

  • 4(→40)10-Gbps λ’s over national footprint (16,000+ km)
  • Ability to provision more λ’s at marginal cost
  • Experimental IP and switched Ethernet networks

Primary objective: support for new forms of network research

  • Both computer & computational science

Corporate partners

  • Cisco (optical transport/switching/routing)

– Critical engagement of ARTI group

  • Level 3 (dark fiber & co-location)

Budget: $83-100M over 5 years

  • $50M provisionally raised for Phase 1 build
slide-15
SLIDE 15
slide-16
SLIDE 16

5/21/2003 16

National Lambda Rail (NLR)

Potential participants (Phase 1 in red)

  • CENIC (2 shares – California & Nevada)
  • Pacific Northwest Gigapop (Washington & NW region)
  • NCAR/Front Range Gigapop (Colorado)
  • Pittsburgh Supercomputer Center (Pennsylvania)
  • Virginia Tech (Virginia & Washington D.C.)
  • Duke (North Carolina)
  • Georgia Tech (Georgia)
  • Florida consortium
  • Texas consortium
  • CIC CIOs (Chicago)
  • Internet2 (2 shares – national participant)
slide-17
SLIDE 17

5/21/2003 17

NLR participation

Benefits

  • NLR optical node (terminals or OADM)
  • Access to shared experimental services (GigE & IP)
  • Ability to provision additional λ’s across NLR at marginal

cost

Responsibilities

  • Fundamental commitment to advancing network research
  • Geographic service area – optical capabilities and

performance levels

  • $5M over 5 years to capitalize NLR build and operations
slide-18
SLIDE 18

5/21/2003 18

NLR technology

Optical transport

  • Cisco 15808 LH/ELH
  • Preferred tributary: 10 Gigabit Ethernet LAN PHY

Ethernet switching (GigE VPNs)

  • Cisco 6509

Routing

  • Cisco 12410
slide-19
SLIDE 19

Seattle Denver San Diego Sunnyvale Los Angeles Cleveland New York City Washington DC

10 Gig E

2 4 4 4 2 6 4 4

National Light Rail Lambda & Route Map

Kansas Ogden Sacramento Portland ashville

15808 ELH System

2

TERMINAL

4 4 2 2 4

Salt Lake City

2

StarLight

6

Metro 10 Gig E OC192 15540 Metro System

Chicago Atlanta Boise 2

REGEN OADM

4 4 5 Boston Pittsburgh

15808 LH System

4 4 Fresno 4 4 Stratford 4 Walnut N Dallas Raleigh Pheonix Olga 4

slide-20
SLIDE 20

5/21/2003 20

Abilene and NLR/IP

NLR/IP will be a fully experimental, interruptible platform Abilene has an existing model for interconnecting with this class of network (e.g., DARPA Supernet, TeraGrid) Interconnection and limited peering for experimentation and demonstrations

slide-21
SLIDE 21

5/21/2003 21

Internet2 and NLR

Internet2 engaged as collaborator since December, 2001 Working to become founding member ($10M commitment) over five years from Abilene Network reserves Intend to offer national experimental service

  • ver a single λ for first 5 years of operation –

lambda grid initially Working to complete organizational process this month

slide-22
SLIDE 22

5/21/2003 22

Fiberco

Designed to support optical initiatives

  • Regional
  • National

Fiber options

  • Holding company for any future initiatives
  • Assignment vehicle

– Regional initiatives – National initiatives (e.g., NLR)

Not an operational entity – supporting project

  • Will not light any fiber

Internet2 took responsibility for LLC formation

  • Idea was spin-off from NLR formation discussions
  • National Research & Education Fiber Co. incorporated in DE
  • First acquisition of dark fiber for Fiberco on March 21
slide-23
SLIDE 23

5/21/2003 23

Fiberco and Level 3

Level 3 fiber arrangement: bifurcated contracts

  • Preferred provider relationship with Level 3
  • 20-yr IRU

– Extensible fiber arrangement – Minimum commitment of 4,000+ km – Initial footprint flexible through September 2003

  • 5-yr renewable fiber O&M and co-location/power

– Fees not incurred until the fiber is lit (through May 2004)

Evaluation factors for principal fiber choice

  • National-scale IRU and O&M pricing available through 2006
  • Aggressive open fiber interconnection policy
  • Homogeneous fiber type
  • Co-location space availability
  • Impact of fiber plant on total cost of system ownership (5 years)

– Hut spacings, directness of fiber routing

slide-24
SLIDE 24

Legend

Level 3 / Genuity Services Distribution Market Added Distribution Market (Likely to be Added) Level 3 Intercity Fiber Genuity Routes (Retained) Genuity Routes (Likely to be Retained)

·

Conf idential & Proprietary Subject to Change

200 400 100 Miles

(External) February 24, 2003

Combined Level 3 / Genuity Networks

Seatt le

Hartford

Bryan

Las Vegas Tustin Memphis Wilmington Newark Stamford Miami Omaha Tampa Austin Dallas Albany Denver Boston Chicago Buffalo Raleigh Orlando Phoenix Detroit Houston Atlanta Portland New York San Jose Richmond Los Osos Nashville Baltimore Cleveland San Diego

  • St. Louis

Charlotte Fort Worth Louisville Sacramento Pittsburgh Cincinnati Los Angeles Kansas City San Antonio New Orleans Santa Teresa Jacksonville Philadelphia Indianapolis San Francisco Salt Lake City Washington, DC Columbus Tulsa Norfolk Syracuse Milwaukee Poughkeepsie Minneapolis Oklahoma City Durham White Plains

slide-25
SLIDE 25

5/21/2003 25

The Northern Tier project

slide-26
SLIDE 26

5/21/2003 26

USA Waves

Internet2 was an original participant in the SURA National Buyers Consortium First phase of cooperative agreement under active discussion between SURA and AT&T

  • Donation of IRU for new dark fiber: 10,000 route-km
  • Use of dark fiber for network research: 3,000 route-km
  • Donation of remaining Velocita optical assets

– Predominantly Cisco 15800 kit

Significant opportunity for dark fiber donation

  • Especially in Southeast and western Northern Tier

Second phase seeks incremental pricing model for λ’s with AT&T’s existing optronics

  • Managed service
slide-27
SLIDE 27

5/21/2003 27

Conclusions

Need for concurrent national & regional initiatives now widely recognized in U.S. Challenges

  • U.S. distance scale – 16,000 km national; 2-D country
  • Need for regional optical networks: 3-layer hierarchy

National-scale, facility-based λ network for computational science and network research

  • National Lambda Rail (NLR)

Supporting project for regional optical initiatives – to hold & assign dark fiber

  • Fiberco

Other complementary efforts in progress

  • USA Waves & Northern Tier
slide-28
SLIDE 28

5/21/2003 28

For more information…

Steve Corbató, Internet2

  • abilene@internet2.edu
  • http://www.internet2.edu/abilene
  • fiberco@internet2.edu
  • http://www.internet2.edu/fiberco

Dan Updegrove’s Optical Initiative Page

  • http://wnt.utexas.edu/~danu/ren-2003-02.html

NLR information under development

slide-29
SLIDE 29

5/21/2003 29