Pantheon: the Training Ground for Internet Congestion-Control - - PowerPoint PPT Presentation

pantheon the training ground for internet congestion
SMART_READER_LITE
LIVE PREVIEW

Pantheon: the Training Ground for Internet Congestion-Control - - PowerPoint PPT Presentation

Chair of Network Architectures and Services Department of Informatics Technical University of Munich Pantheon: the Training Ground for Internet Congestion-Control Research Chun-Te Sung July 13, 2018 Chair of Network Architectures and Services


slide-1
SLIDE 1

Chair of Network Architectures and Services Department of Informatics Technical University of Munich

Pantheon: the Training Ground for Internet Congestion-Control Research

Chun-Te Sung

July 13, 2018 Chair of Network Architectures and Services Department of Informatics Technical University of Munich

slide-2
SLIDE 2

Structure

Introduction

  • History
  • Challenges of the development of congestion control

Background

  • Congestion control
  • Network emulation

Design

  • How the Pantheon works

Evaluation Conclusion

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 2

slide-3
SLIDE 3

Introduction

History

  • 1969: ARPANET, the first network

src: http://www.wikiwand.com/en/Global_Internet_usage Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 3

slide-4
SLIDE 4

Introduction

History

  • 1969: ARPANET, the first network
  • 1974: TCP/IP

src: http://www.wikiwand.com/en/Global_Internet_usage Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 3

slide-5
SLIDE 5

Introduction

History

  • 1969: ARPANET, the first network
  • 1974: TCP/IP
  • 1986: First network collapses

src: http://www.wikiwand.com/en/Global_Internet_usage Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 3

slide-6
SLIDE 6

Introduction

History

  • 1969: ARPANET, the first network
  • 1974: TCP/IP
  • 1986: First network collapses
  • 2018: Over 4 billion network users!

src: http://www.wikiwand.com/en/Global_Internet_usage Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 3

slide-7
SLIDE 7

Introduction

Challenges of the development of congestion control Testing environment: academic networks or small testbeds in private laboratories Reproducibility: challenges from realtime networks

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 4

slide-8
SLIDE 8

Introduction

Challenges of the development of congestion control Testing environment: academic networks or small testbeds in private laboratories Reproducibility: challenges from realtime networks Pantheon: distributed, collaborative, training ground for congestion control research

  • a collection of congestion control schemes
  • a testing infrastructure
  • a group of globally deployed network nodes

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 4

slide-9
SLIDE 9

Background

Congestion control

src: https://ourworldindata.org/internet Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 5

slide-10
SLIDE 10

Background

Congestion control Network collapse

src: https://ourworldindata.org/internet Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 5

slide-11
SLIDE 11

Background

Congestion control Network collapse Congestion window

src: https://ourworldindata.org/internet Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 5

slide-12
SLIDE 12

Background

Congestion control Network collapse Congestion window Different methods:

  • TCP Reno and Cubic:

loss-based approach

src: https://ourworldindata.org/internet Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 5

slide-13
SLIDE 13

Background

Congestion control Network collapse Congestion window Different methods:

  • TCP Reno and Cubic:

loss-based approach

  • TCP Vegas: delay-based

approach

src: https://ourworldindata.org/internet Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 5

slide-14
SLIDE 14

Background

Congestion control Network collapse Congestion window Different methods:

  • TCP Reno and Cubic:

loss-based approach

  • TCP Vegas: delay-based

approach

  • TCP BBR: model-based

approach

src: https://ourworldindata.org/internet Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 5

slide-15
SLIDE 15

Background

Congestion control Network collapse Congestion window Different methods:

  • TCP Reno and Cubic:

loss-based approach

  • TCP Vegas: delay-based

approach

  • TCP BBR: model-based

approach

  • Remy and PCC: generate

new protocols with machine learning

src: https://ourworldindata.org/internet Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 5

slide-16
SLIDE 16

Background

Network emulation Reproducibility

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 6

slide-17
SLIDE 17

Background

Network emulation Reproducibility Controlled experimental conditions

  • Autocorrelated loss
  • Reordering
  • Bit errors
  • and more!

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 6

slide-18
SLIDE 18

Background

Network emulation Reproducibility Controlled experimental conditions

  • Autocorrelated loss
  • Reordering
  • Bit errors
  • and more!

Dummynet, Mahimahi, Mininet, and NetEm

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 6

slide-19
SLIDE 19

Design

How the Pantheon works Two testing modes

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7

slide-20
SLIDE 20

Design

How the Pantheon works Two testing modes

  • Remote mode: Real network paths us-

ing the globally deployed network nodes

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7

slide-21
SLIDE 21

Design

How the Pantheon works Two testing modes

  • Remote mode: Real network paths us-

ing the globally deployed network nodes

  • Local mode: Mahimahi emulator

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7

slide-22
SLIDE 22

Design

How the Pantheon works Two testing modes

  • Remote mode: Real network paths us-

ing the globally deployed network nodes

  • Local mode: Mahimahi emulator

Scheme Running order TCP Cubic Receiver first TCP Vegas Receiver first TCP BBR Receiver first QUIC Sender first WebRTC Sender first LEDBAT Receiver first PCC Receiver first Verus Sender first SCReAM Receiver first RemyCC Receiver first Sprout Receiver first Copa Receiver first Vivace Receiver first FillP Receiver first Indigo Sender first

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7

slide-23
SLIDE 23

Design

How the Pantheon works Two testing modes

  • Remote mode: Real network paths us-

ing the globally deployed network nodes

  • Local mode: Mahimahi emulator

Wrappers for congestion control schemes Scheme Running order TCP Cubic Receiver first TCP Vegas Receiver first TCP BBR Receiver first QUIC Sender first WebRTC Sender first LEDBAT Receiver first PCC Receiver first Verus Sender first SCReAM Receiver first RemyCC Receiver first Sprout Receiver first Copa Receiver first Vivace Receiver first FillP Receiver first Indigo Sender first

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7

slide-24
SLIDE 24

Design

How the Pantheon works Two testing modes

  • Remote mode: Real network paths us-

ing the globally deployed network nodes

  • Local mode: Mahimahi emulator

Wrappers for congestion control schemes

  • Mostly iperf

Scheme Running order TCP Cubic Receiver first TCP Vegas Receiver first TCP BBR Receiver first QUIC Sender first WebRTC Sender first LEDBAT Receiver first PCC Receiver first Verus Sender first SCReAM Receiver first RemyCC Receiver first Sprout Receiver first Copa Receiver first Vivace Receiver first FillP Receiver first Indigo Sender first

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7

slide-25
SLIDE 25

Design

How the Pantheon works Two testing modes

  • Remote mode: Real network paths us-

ing the globally deployed network nodes

  • Local mode: Mahimahi emulator

Wrappers for congestion control schemes

  • Mostly iperf
  • QUIC

Scheme Running order TCP Cubic Receiver first TCP Vegas Receiver first TCP BBR Receiver first QUIC Sender first WebRTC Sender first LEDBAT Receiver first PCC Receiver first Verus Sender first SCReAM Receiver first RemyCC Receiver first Sprout Receiver first Copa Receiver first Vivace Receiver first FillP Receiver first Indigo Sender first

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7

slide-26
SLIDE 26

Design

How the Pantheon works Two testing modes

  • Remote mode: Real network paths us-

ing the globally deployed network nodes

  • Local mode: Mahimahi emulator

Wrappers for congestion control schemes

  • Mostly iperf
  • QUIC

Pantheon-tunnel Scheme Running order TCP Cubic Receiver first TCP Vegas Receiver first TCP BBR Receiver first QUIC Sender first WebRTC Sender first LEDBAT Receiver first PCC Receiver first Verus Sender first SCReAM Receiver first RemyCC Receiver first Sprout Receiver first Copa Receiver first Vivace Receiver first FillP Receiver first Indigo Sender first

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7

slide-27
SLIDE 27

Design

How the Pantheon works Two testing modes

  • Remote mode: Real network paths us-

ing the globally deployed network nodes

  • Local mode: Mahimahi emulator

Wrappers for congestion control schemes

  • Mostly iperf
  • QUIC

Pantheon-tunnel

  • TUN

Scheme Running order TCP Cubic Receiver first TCP Vegas Receiver first TCP BBR Receiver first QUIC Sender first WebRTC Sender first LEDBAT Receiver first PCC Receiver first Verus Sender first SCReAM Receiver first RemyCC Receiver first Sprout Receiver first Copa Receiver first Vivace Receiver first FillP Receiver first Indigo Sender first

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7

slide-28
SLIDE 28

Design

How the Pantheon works Two testing modes

  • Remote mode: Real network paths us-

ing the globally deployed network nodes

  • Local mode: Mahimahi emulator

Wrappers for congestion control schemes

  • Mostly iperf
  • QUIC

Pantheon-tunnel

  • TUN
  • Running order of sender and receiver

Scheme Running order TCP Cubic Receiver first TCP Vegas Receiver first TCP BBR Receiver first QUIC Sender first WebRTC Sender first LEDBAT Receiver first PCC Receiver first Verus Sender first SCReAM Receiver first RemyCC Receiver first Sprout Receiver first Copa Receiver first Vivace Receiver first FillP Receiver first Indigo Sender first

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7

slide-29
SLIDE 29

Design

How the Pantheon works

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 8

slide-30
SLIDE 30

Design

How the Pantheon works

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 8

slide-31
SLIDE 31

Design

How the Pantheon works

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 8

slide-32
SLIDE 32

Design

Globally deployed network nodes Location Cellular network Wired Network WiFi U.S.

  • Mexico
  • Brazil
  • Colombia
  • India
  • China
  • U.K.
  • Japan
  • Australia
  • Nepal
  • Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research

9

slide-33
SLIDE 33

Design

Sample output

6 8 10 12 14

95th percentile one-way delay (ms)

50 100 150 200 250 300 350

Average throughput (Mbit/s) test from local to remote, 3 runs of 30s each per scheme FillP Copa Indigo QUIC Cubic TCP Cubic Sprout PCC-Vivace SCReAM TCP Vegas TCP BBR Verus PCC-Allegro PCC-Expr WebRTC media TaoVA-100x LEDBAT

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 10

slide-34
SLIDE 34

Evaluation

src: https://www.google.com/maps Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 11

slide-35
SLIDE 35

Evaluation

src: https://www.google.com/maps Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 11

slide-36
SLIDE 36

Evaluation

src: https://www.google.com/maps Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 11

slide-37
SLIDE 37

Evaluation

Different network paths

Frankfurt to London (left) and Frankfurt to Paris (right)

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 12

slide-38
SLIDE 38

Evaluation

Opposite directions of a network path

Frankfurt to London (left) and London to Frankfurt (right)

Reflection:

  • Bidirectional measurements

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 13

slide-39
SLIDE 39

Evaluation

Different testing time

Frankfurt to London with one week difference (right)

Potential reasons:

  • Peak/Off peak time
  • Abnormal behaviors of Internet traffic

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 14

slide-40
SLIDE 40

Evaluation

Different number of flows

Frankfurt to London with 3 flows running in a single test (right)

Potential reasons:

  • Quality of networks

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 15

slide-41
SLIDE 41

Conclusion

Challenges of the development of congestion control

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 16

slide-42
SLIDE 42

Conclusion

Challenges of the development of congestion control The Pantheon

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 16

slide-43
SLIDE 43

Conclusion

Challenges of the development of congestion control The Pantheon

  • community evaluation platform

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 16

slide-44
SLIDE 44

Conclusion

Challenges of the development of congestion control The Pantheon

  • community evaluation platform
  • 15 different congestion control schemes and global measurement nodes

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 16

slide-45
SLIDE 45

Conclusion

Challenges of the development of congestion control The Pantheon

  • community evaluation platform
  • 15 different congestion control schemes and global measurement nodes
  • network emulators

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 16

slide-46
SLIDE 46

Thank you

Any questions?

Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 17