Using Flow for Realtime Traffic Management in 100G Networks John - - PowerPoint PPT Presentation

▶
using flow for realtime traffic management in 100g
SMART_READER_LITE
LIVE PREVIEW

Using Flow for Realtime Traffic Management in 100G Networks John - - PowerPoint PPT Presentation

Jun 29, 2023 25 likes •198 views

Using Flow for Realtime Traffic Management in 100G Networks John Gerth Johan van Reijendam Stanford University Ethernet Speed Evolution 1970s thick ethernet 3 Mbps over 10Base5 coax 1980s thin ethernet 10 Mbps

slide-1
SLIDE 1

Using Flow for Realtime Traffic Management in 100G Networks

John Gerth Johan van Reijendam Stanford University

slide-2
SLIDE 2

Ethernet Speed Evolution

  • 1970’s “thick” ethernet

– 3 Mbps over 10Base5 coax

  • 1980’s “thin” ethernet

– 10 Mbps over 10BaseT coax

  • 1990’s “fast” ethernet

– 100 Mbps over Cat5

  • 2000’s “gigE” and “ten gig”

– 1 and 10 Gbps over Cat5e/6 and fiber

  • 2010’s “QSFP…”

– 40 and 100 Gbps

DRAFT - FloCon 2017

slide-3
SLIDE 3

Realtime challenges

  • Network bandwidth

– Now rivals I/O bus speeds

  • Processor speeds stagnant

– Multi-core CPUs – Hyperthreading

  • Memory

– Local memory per CPU socket – Non-local memory has access penalties

DRAFT - FloCon 2017

slide-4
SLIDE 4

Sensing Design for 100G

  • NIC

– Full-duplex link max bandwidth 2x100G – PCIe gen3 max bandwidth 115G

  • Host

– Assembling flows is multi-core task – Minimizing memory latency critical

DRAFT - FloCon 2017

slide-5
SLIDE 5

NUMA (Non-Uniform Memory Access)

DRAFT - FloCon 2017

slide-6
SLIDE 6

Intel QPI

DRAFT - FloCon 2017

slide-7
SLIDE 7

Single PCIe Slot

DRAFT - FloCon 2017

slide-8
SLIDE 8

Dual Slots with Intel QPI

DRAFT - FloCon 2017

slide-9
SLIDE 9

Dual with inter-card xfer

DRAFT - FloCon 2017

slide-10
SLIDE 10

SC16 Demo

DRAFT - FloCon 2017

slide-11
SLIDE 11

Flow steering

  • Goal - optimize bandwidth utilization

– Don’t need or want 100G for all transfers – Want to keep pipe full yet uncongested

  • Tool – SDN

– Controller accepts flow-specific commands – Can reassign active flow paths

  • Steering decision

– Use flow metrics to identify opportunities

DRAFT - FloCon 2017

slide-12
SLIDE 12

Herding elephants

  • What are “elephant flows” ?

– Files in “big data” research environments – Video streams – Cloud backups

  • How can they be identified ?

– All flow sensors emit periodic records – Adjust reporting period – Simple byte count thresholds

DRAFT - FloCon 2017

slide-13
SLIDE 13

Steering Demo Configuration

DRAFT - FloCon 2017

slide-14
SLIDE 14

Steering

  • OpenFlow switch

– Routes packets based on ACL policies

  • OpenFlow controller

– Pushes ACL policies to switch

  • Argus sensor machine

– Python script tracks elephants in flows – Uses REST interface on Controller to add or delete flows from the ACL policy lists

DRAFT - FloCon 2017

slide-15
SLIDE 15

Steering Demo (place holder)

DRAFT - FloCon 2017

slide-16
SLIDE 16

Beyond Pachyderms

  • SDN – software defined networking

– More than just bandwidth management

  • Flow metrics

– More than packet and byte counts

  • Coupling SDN and Flow

– Realtime audit and validation – Fault detection and correction – Security monitoring and remediation

DRAFT - FloCon 2017

slide-17
SLIDE 17

Acknowledgments

  • QoSient

– Argus Pro software with Napatech support – Elephant-flow visualization

  • Napatech

– Loan of NT200C01 Network Accelerator card

  • Dell

– Loan of 2x20 core server and

  • Stanford Networking

– OpenFlow controller and 100Gbe link

DRAFT - FloCon 2017