Janet6: What it is, and what it isnt. Rob Evans Chief Network - - PowerPoint PPT Presentation

▶
janet6 what it is and what it isn t
SMART_READER_LITE
LIVE PREVIEW

Janet6: What it is, and what it isnt. Rob Evans Chief Network - - PowerPoint PPT Presentation

Jul 21, 2023 326 likes •469 views

Janet6: What it is, and what it isnt. Rob Evans Chief Network Architect, Janet Janet background Backbone IP service managed by the Janet Network Operations Centre More on the transmission management later Regional networks

slide-1
SLIDE 1

Rob Evans Chief Network Architect, Janet

Janet6: What it is, and what it isn’t.

slide-2
SLIDE 2
  • Backbone

– IP service managed by the Janet Network Operations Centre

  • More on the transmission management later
  • Regional networks

– Most managed autonomously by the regions themselves – Some “public service networks”

  • Accredited to carry other public sector traffic
  • Mainly MPLS to segregate Janet traffic and Internet from private networks

– Connect to the backbone in two different places

  • Most sites connect to regional networks

– Two management boundaries between Janet and the site

  • Janet – Regional Network
  • Regional Network – Site

Janet background

slide-3
SLIDE 3
  • SuperJANET5

– Contract signed October 23rd, 2006. – Transmission system dedicated to us, but managed by Verizon Business

  • Ciena CoreStream and 4200
  • Latterly Nortel/Ciena 6500 for 40G SDH and 100GE on high-PMD fibres

– Juniper routers managed in-house

  • Two routing platforms

– T series for IP » No MPLS! – MX for EoMPLS, used for lightpaths

– End of contract October 23rd, 2013.

What we had

slide-4
SLIDE 4
  • Light the dark fibre ourselves

– Reduce complexity of asking Verizon Business to do something, then Verizon having to ask Ciena to do it

  • Lots of contractual negotiations for anything ‘new’

– Scale under our control

  • Lots of high-speed circuits

– Currently peaking at about 160Gbit/s of IP traffic from GEANT, peering and transit

  • Still growing exponentially
  • Ability to offer consistent set of services

– Bring management of regional networks in-house

What we wanted

slide-5
SLIDE 5
  • 6,500km of dark fibre
  • Ciena 6500 transmission system

– 28 x 100GE circuits – 160(ish) 10G circuits – All coherent

  • 10G carried over 40G muxponders
  • No dispersion compensation
  • 100GE uses SR10 optics

– Cheaper optics, but more expensive cabling – Only use within a data centre – Saved ~£1M (~€1.2M) across network

  • Janet manages most regional networks

– Not all – Regional network infrastructure not refreshed as part of this, but

  • ngoing project

What we got

slide-6
SLIDE 6

London Telehouse North London Telecity Harbour Ex London Bristol Bradley Stoke South South West PSBA TVN KPSN London Telehouse West Nottingham Lowdham Birmingham Erdington WMRN YHMAN Manchester Telecity KH NNW CANLMAN NIRAN Glasgow ClydeNET Aberdeen Fife & Tayside EaStMAN NorMAN EMMAN EastERN London Telecity Powergate Core PoP (Point of Presence) Regional network Transmission site Leeds AQL The TransPennine Arc

A picture is worth 1,000 words

slide-7
SLIDE 7
  • Keeping two routing platforms
  • Juniper T4000 for IP service

– Upgrade from T1600

  • Sorta

– 100GE cost on T4000 is fraction of cost on T1600 – Introducing point-to-point circuits with uncommitted bandwidth

  • Juniper MX for guaranteed bandwidth circuits

– Upgrade interconnects from 10GE to 100GE – Can provision 10GE point to point circuits rapidly

What we got

slide-8
SLIDE 8
  • OTN Switching

– Had considered it for some parts of the network

  • Bandwidth drop at each point didn’t need to be high
  • Wasn’t available on many smaller chassis
  • Added cost

– We use the routing platform for building point-to-point circuits

  • More flexible and dynamic
  • Transponder-less DWDM system

– Router optics not there for long-haul 100G

What we didn’t get

slide-9
SLIDE 9 1 1 1 2 2

WMRN CANLMAN NIRAN ClydeNET Aberdeen Fife & Tayside EaStMAN NorMAN EMMAN Core PoP (Point of Presence) Regional network

100Gbps channel

Birmingham Erdington Nottingham Lowdham EastERN

Telehouse fibre N x 10Gbps channels

Elsewhere newc ct PoP belf nl PoP glas vz PoP East of Scotland

4 2 2 2 2 2 2 1 2 1 3 4 1 1 3 3 6 6 2 1 1 1 2 2 1 1 2 2 3 3 2 2 N 1

HEAnet

1

London Telehouse West London Telecity Powergate PSBA South West TVN Bristol Bradley Stoke RAL South Glasgow Leeds AQL YHMAN

4 4 2 2 2 2 2

NNW

4

Manchester Telecity Kilburn House manc rh PoP leed lu PoP leed lm PoP

1 1 1

TransPennine Arc emPSN

1 1

London

3

KPSN edin sc PoP

1

GÉANT Global Transit Public & Private Peers Public & Private Peers External connectivity

3 2 2 100G 2 2 2

London Telehouse North Global Transit London Telecity Harbour Ex

Here is the second thousand

slide-10
SLIDE 10
  • Router power and cooling
  • Wavelogic 3 Cards, shelf software and management software

(OneControl under Linux) from Ciena were all new

– Do release dates ever slip?

  • Odd timing problem on 100Gbit/s OCLD (line-side) cards

– Manifested as flapping links – Required a firmware fix

  • Underwater links to Ireland require lots of amplification

– 235km unamplified – Co- and counter-pump Raman amplifiers – Odd blip

  • Pump amplifiers up to maximum
  • Clean fibres

– No, I mean REALLY clean the fibres – Never, ever, ever unplug this fibre again

Some (technical) challenges

slide-11
SLIDE 11
  • Where now?
  • Transmission capacity to scale for some time
  • Router density is a concern
  • Space and power for multiple chassis is difficult

Future looks

slide-12
SLIDE 12

Janet, Lumen House Library Avenue, Harwell Oxford Didcot, Oxfordshire t: +44 (0) 1235 822200 f: +44 (0) 1235 822399 e: Service@ja.net

Comments? Questions?