Network futures: AARNet4, Science DMZ, SDN David Wilde David Wilde - - PowerPoint PPT Presentation

▶
network futures aarnet4 science dmz sdn
SMART_READER_LITE
LIVE PREVIEW

Network futures: AARNet4, Science DMZ, SDN David Wilde David Wilde - - PowerPoint PPT Presentation

May 13, 2023 124 likes •645 views

AAR AARNet Copy opyright 2015 2015 Network futures: AARNet4, Science DMZ, SDN Network futures: AARNet4, Science DMZ, SDN David Wilde David Wilde AAR AARNet Copy opyright 2015 2015 Network futures: AARNet4, Science DMZ, SDN THETA //

slide-1
SLIDE 1

AAR AARNet Copy

  • pyright 2015

2015

Network futures: AARNet4, Science DMZ, SDN

David Wilde

Network futures: AARNet4, Science DMZ, SDN

David Wilde

slide-2
SLIDE 2

AAR AARNet Copy

  • pyright 2015

2015

Network futures: AARNet4, Science DMZ, SDN

David Wilde Network Architect, AARNet THETA // QuestNet 12 May 2015

slide-3
SLIDE 3

AAR AARNet Copy

  • pyright 2015

2015

AARNet4

slide-4
SLIDE 4

AAR AARNet Copy

  • pyright 2015

2015

Brisbane Canberra Melbourne Perth Darwin Sippy Downs Gladstone Rockhampton Mackay Cairns Townsville Armidale Geraldton AARNet POP < 1 Gbps < 2.5 Gbps < 10 Gbps WDM Transmission KEY

4

AARNet4 – National

Hobart Murchison Radio-Astronomy Observatory Sydney Adelaide Alice Springs

100Gbps Optical Network 100Gbps Capable Juniper MX Routers

slide-5
SLIDE 5

AAR AARNet Copy

  • pyright 2015

2015

Singapore Seattle Palo Alto San Jose Los Angeles Honolulu Muana Auckland

5

Sydney Perth

AARNet4 - International

Suva Guam

slide-6
SLIDE 6

AAR AARNet Copy

  • pyright 2015

2015

6

AARNet4 – network services

  • Connectivity up to 10 or nx10Gbps

Routed access to internet and global R&E networks

  • Point-to-point or multipoint VPLS

Layer 2 VPN

  • Multipoint, your own IP addressing

Layer 3 VPN

slide-7
SLIDE 7

AAR AARNet Copy

  • pyright 2015

2015

7

Supporting the AARNet Portfolio

It used to be about the plumbing, now it’s so much more…

slide-8
SLIDE 8

AAR AARNet Copy

  • pyright 2015

2015

AARNet4 customer migration

8

5 6 7 5 8 7 38

5 10 15 20 25 30 35 40

In the queue Design discussion complete Proposal issued Service Agreement issued Deployment underway Completely migrated All institutions

slide-9
SLIDE 9

AAR AARNet Copy

  • pyright 2015

2015

Science DMZ

slide-10
SLIDE 10

AAR AARNet Copy

  • pyright 2015

2015

10

RDSI : cloud storage for researchers

“Enabling researchers to use, reuse and manipulate significant data collections”

https://www.rdsi.edu.au/node-statuses

www.rdsi.edu.au

slide-11
SLIDE 11

AAR AARNet Copy

  • pyright 2015

2015

11

RDSI : cloud storage for researchers

“Enabling researchers to use, reuse and manipulate significant data collections”

https://www.rdsi.edu.au/node-statuses

slide-12
SLIDE 12

AAR AARNet Copy

  • pyright 2015

2015

The problem: data sharing

slide-13
SLIDE 13

AAR AARNet Copy

  • pyright 2015

2015

The problem:

13

Brisbane-Melbourne (30ms) Perth-Sydney (50ms) NYC- London (75ms) Perth-LAX (160ms!)

Image: ESNet

slide-14
SLIDE 14

AAR AARNet Copy

  • pyright 2015

2015

14 14

Latency…

14

slide-15
SLIDE 15

AAR AARNet Copy

  • pyright 2015

2015

15 15

Latency…

15

slide-16
SLIDE 16

AAR AARNet Copy

  • pyright 2015

2015

The solution: Science DMZ

slide-17
SLIDE 17

AAR AARNet Copy

  • pyright 2015

2015

17

The solution:

“Friction free networking”

  • 2. Dedicated systems for data transfer
  • 3. Performance and network measurement tools
  • 4. Security mechanisms designed for high performance
  • 1. Network devices selected for high performance applications
slide-18
SLIDE 18

AAR AARNet Copy

  • pyright 2015

2015

18

The solution:

“Friction free networking”

Tionette Stoddard - February 14, 2010 - Source: Richard Heathcote/Getty Images North America

slide-19
SLIDE 19

AAR AARNet Copy

  • pyright 2015

2015

Science DMZ and RDSI

slide-20
SLIDE 20

AAR AARNet Copy

  • pyright 2015

2015

20

Standard campus connection

slide-21
SLIDE 21

AAR AARNet Copy

  • pyright 2015

2015

21

Campus connection with Science DMZ

slide-22
SLIDE 22

AAR AARNet Copy

  • pyright 2015

2015

22

Science DMZ deployment

22

AARNet backbone network APL NAP #2 APL NAP #1

RDSI Node Node network infrastructure Node APL AARNet Layer 3 Inter-Node VPN PE1 APL-NTU1 PE2

PerfSonar 2 PerfSonar 1

Node Storage BES-1 BES-2

DTN 1

APL-NTU2

DTN 2

slide-23
SLIDE 23

AAR AARNet Copy

  • pyright 2015

2015

Primary Node Secondary Node

Inter-node VPN AARNet 4 Routed Access 23

RDSI : high speed network connectivity

slide-24
SLIDE 24

AAR AARNet Copy

  • pyright 2015

2015

24 24

PerfSonar

24

slide-25
SLIDE 25

AAR AARNet Copy

  • pyright 2015

2015

25 25

DTN : Aspera + Globus Online

25

slide-26
SLIDE 26

AAR AARNet Copy

  • pyright 2015

2015

26

Moving forward: Science DMZ on your campus?

slide-27
SLIDE 27

AAR AARNet Copy

  • pyright 2015

2015

SDN

slide-28
SLIDE 28

AAR AARNet Copy

  • pyright 2015

2015

28

The AARNet SDN testbed

SDN switch Sydney Melbourne Perth Seattle

slide-29
SLIDE 29

AAR AARNet Copy

  • pyright 2015

2015

29

The AARNet SDN testbed

slide-30
SLIDE 30

AAR AARNet Copy

  • pyright 2015

2015

30

The ANZSDN testbed

Successful LIEF grant >> 9 universities + CSIRO + AARNet

slide-31
SLIDE 31

AAR AARNet Copy

  • pyright 2015

2015

31

Useful links

AARNet SDN testbed: Contact me: david.wilde@aarnet.edu.au (More info coming soon on www.aarnet.edu.au …) LIEF-funded ANZSDN testbed: Talk to Vijay Sivaraman (UNSW): vijay@unsw.edu.au https://sites.google.com/site/anzsdntestbed/ SDN in general: Get involved! http://www.anzsdn.net/ http://www.meetup.com/Australian-SDN-Meetup

slide-32
SLIDE 32

AAR AARNet Copy

  • pyright 2015

2015

David Wilde david.wilde@aarnet.edu.au

slide-33
SLIDE 33

AAR AARNet Copy

  • pyright 2015

2015

33

Spare slides

slide-34
SLIDE 34

AAR AARNet Copy

  • pyright 2015

2015

34

Components

Data transfer nodes: Dell Poweredge 720XD, 64GB RAM, 2 x SSD, 2 x 3.4GHz 8-core CPU 3 x Mellanox Connect3 VPI card (10/40 ethernet 10/40/56 IB) PerfSonar: 2-blade Supermicro + Mellanox NICs PerfSonar Toolkit; MadDash dashboard Data transfer tools: Aspera, Globus/GridFTP Border edge switch: Juniper EX4550; Cisco 6800/NX6K/NX5K; Dell Force10

slide-35
SLIDE 35

AAR AARNet Copy

  • pyright 2015

2015

35

Research Drivers: “Really Big Data”

Square Kilometre Array Large Hadron Collider Climate Change Data Genomics Data

slide-36
SLIDE 36

AAR AARNet Copy

  • pyright 2015

2015

36

Other research projects

Catlin Global Reef Record Global research on greenhouse gases Disease transmission among lizards Historical newspaper record

https://www.rdsi.edu.au/use-cases

slide-37
SLIDE 37

AAR AARNet Copy

  • pyright 2015

2015

Challenges

slide-38
SLIDE 38

AAR AARNet Copy

  • pyright 2015

2015

38 38

Latency

38

2 4 6 8 10 12 1 8 15 22 29 36 43 50 57 64 71 78 85 92 99 106 113 120 127 134 141 148 155 162 169 176 183 190 197 204 211 218 225 232 239 246 253 260 267 274 281 288 Series1

Solution: tightly manage the DTN: NIC drivers, OS updates … Careful choice of TCP congestion avoidance algorithm

slide-39
SLIDE 39

AAR AARNet Copy

  • pyright 2015

2015

39

Compatibility of storage architectures & vendors

slide-40
SLIDE 40

AAR AARNet Copy

  • pyright 2015

2015

Inter-node VPN AARNet 4 Routed Access 40

Compatibility of storage architectures & vendors

slide-41
SLIDE 41

AAR AARNet Copy

  • pyright 2015

2015

Inter-node VPN AARNet 4 Routed Access 41

Compatibility of storage architectures & vendors

Solution: Science DMZ architecture + L3VPN for inter-Node traffic

slide-42
SLIDE 42

AAR AARNet Copy

  • pyright 2015

2015

42

User tools & familiarity

Images: fasterdata.es.net and pinterest.com

Command line tools Typical Australian researcher

=

slide-43
SLIDE 43

AAR AARNet Copy

  • pyright 2015

2015

43

User tools & familiarity

Solution: keep it simple => Focus on one tool (eg. Aspera) => Many users just want a mapped drive … although non-web authentication an issue => Partner with eResearch organisations for training and outreach

=

slide-44
SLIDE 44

AAR AARNet Copy

  • pyright 2015

2015

Moving forward

slide-45
SLIDE 45

AAR AARNet Copy

  • pyright 2015

2015

45

Improved integration with other projects

slide-46
SLIDE 46

AAR AARNet Copy

  • pyright 2015

2015

46

Improved integration with other projects

slide-47
SLIDE 47

AAR AARNet Copy

  • pyright 2015

2015

47

Better integration with cloud providers

slide-48
SLIDE 48

AAR AARNet Copy

  • pyright 2015

2015

48

Add SDN for more flexibility…

slide-49
SLIDE 49

AAR AARNet Copy

  • pyright 2015

2015

Brisbane Canberra Melbourne Perth Darwin Sippy Downs Gladstone Rockhampton Mackay Cairns Townsville Armidale Geraldton AARNet POP < 1 Gbps < 2.5 Gbps < 10 Gbps WDM Transmission KEY

49

Increased bandwidth

Hobart Murchison Radio-Astronomy Observatory Sydney Adelaide Alice Springs

100Gbps Optical Network

slide-50
SLIDE 50

AAR AARNet Copy

  • pyright 2015

2015

Brisbane Canberra Melbourne Perth Darwin Sippy Downs Gladstone Rockhampton Mackay Cairns Townsville Armidale Geraldton AARNet POP < 1 Gbps < 2.5 Gbps < 10 Gbps WDM Transmission KEY

50

Increased bandwidth

Hobart Murchison Radio-Astronomy Observatory Sydney Adelaide Alice Springs

100Gbps Optical Network