Chair of Network Architectures and Services Department of Informatics Technical University of Munich
Pantheon: the Training Ground for Internet Congestion-Control - - PowerPoint PPT Presentation
Pantheon: the Training Ground for Internet Congestion-Control - - PowerPoint PPT Presentation
Chair of Network Architectures and Services Department of Informatics Technical University of Munich Pantheon: the Training Ground for Internet Congestion-Control Research Chun-Te Sung July 13, 2018 Chair of Network Architectures and Services
Structure
Introduction
- History
- Challenges of the development of congestion control
Background
- Congestion control
- Network emulation
Design
- How the Pantheon works
Evaluation Conclusion
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 2
Introduction
History
- 1969: ARPANET, the first network
src: http://www.wikiwand.com/en/Global_Internet_usage Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 3
Introduction
History
- 1969: ARPANET, the first network
- 1974: TCP/IP
src: http://www.wikiwand.com/en/Global_Internet_usage Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 3
Introduction
History
- 1969: ARPANET, the first network
- 1974: TCP/IP
- 1986: First network collapses
src: http://www.wikiwand.com/en/Global_Internet_usage Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 3
Introduction
History
- 1969: ARPANET, the first network
- 1974: TCP/IP
- 1986: First network collapses
- 2018: Over 4 billion network users!
src: http://www.wikiwand.com/en/Global_Internet_usage Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 3
Introduction
Challenges of the development of congestion control Testing environment: academic networks or small testbeds in private laboratories Reproducibility: challenges from realtime networks
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 4
Introduction
Challenges of the development of congestion control Testing environment: academic networks or small testbeds in private laboratories Reproducibility: challenges from realtime networks Pantheon: distributed, collaborative, training ground for congestion control research
- a collection of congestion control schemes
- a testing infrastructure
- a group of globally deployed network nodes
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 4
Background
Congestion control
src: https://ourworldindata.org/internet Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 5
Background
Congestion control Network collapse
src: https://ourworldindata.org/internet Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 5
Background
Congestion control Network collapse Congestion window
src: https://ourworldindata.org/internet Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 5
Background
Congestion control Network collapse Congestion window Different methods:
- TCP Reno and Cubic:
loss-based approach
src: https://ourworldindata.org/internet Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 5
Background
Congestion control Network collapse Congestion window Different methods:
- TCP Reno and Cubic:
loss-based approach
- TCP Vegas: delay-based
approach
src: https://ourworldindata.org/internet Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 5
Background
Congestion control Network collapse Congestion window Different methods:
- TCP Reno and Cubic:
loss-based approach
- TCP Vegas: delay-based
approach
- TCP BBR: model-based
approach
src: https://ourworldindata.org/internet Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 5
Background
Congestion control Network collapse Congestion window Different methods:
- TCP Reno and Cubic:
loss-based approach
- TCP Vegas: delay-based
approach
- TCP BBR: model-based
approach
- Remy and PCC: generate
new protocols with machine learning
src: https://ourworldindata.org/internet Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 5
Background
Network emulation Reproducibility
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 6
Background
Network emulation Reproducibility Controlled experimental conditions
- Autocorrelated loss
- Reordering
- Bit errors
- and more!
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 6
Background
Network emulation Reproducibility Controlled experimental conditions
- Autocorrelated loss
- Reordering
- Bit errors
- and more!
Dummynet, Mahimahi, Mininet, and NetEm
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 6
Design
How the Pantheon works Two testing modes
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7
Design
How the Pantheon works Two testing modes
- Remote mode: Real network paths us-
ing the globally deployed network nodes
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7
Design
How the Pantheon works Two testing modes
- Remote mode: Real network paths us-
ing the globally deployed network nodes
- Local mode: Mahimahi emulator
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7
Design
How the Pantheon works Two testing modes
- Remote mode: Real network paths us-
ing the globally deployed network nodes
- Local mode: Mahimahi emulator
Scheme Running order TCP Cubic Receiver first TCP Vegas Receiver first TCP BBR Receiver first QUIC Sender first WebRTC Sender first LEDBAT Receiver first PCC Receiver first Verus Sender first SCReAM Receiver first RemyCC Receiver first Sprout Receiver first Copa Receiver first Vivace Receiver first FillP Receiver first Indigo Sender first
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7
Design
How the Pantheon works Two testing modes
- Remote mode: Real network paths us-
ing the globally deployed network nodes
- Local mode: Mahimahi emulator
Wrappers for congestion control schemes Scheme Running order TCP Cubic Receiver first TCP Vegas Receiver first TCP BBR Receiver first QUIC Sender first WebRTC Sender first LEDBAT Receiver first PCC Receiver first Verus Sender first SCReAM Receiver first RemyCC Receiver first Sprout Receiver first Copa Receiver first Vivace Receiver first FillP Receiver first Indigo Sender first
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7
Design
How the Pantheon works Two testing modes
- Remote mode: Real network paths us-
ing the globally deployed network nodes
- Local mode: Mahimahi emulator
Wrappers for congestion control schemes
- Mostly iperf
Scheme Running order TCP Cubic Receiver first TCP Vegas Receiver first TCP BBR Receiver first QUIC Sender first WebRTC Sender first LEDBAT Receiver first PCC Receiver first Verus Sender first SCReAM Receiver first RemyCC Receiver first Sprout Receiver first Copa Receiver first Vivace Receiver first FillP Receiver first Indigo Sender first
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7
Design
How the Pantheon works Two testing modes
- Remote mode: Real network paths us-
ing the globally deployed network nodes
- Local mode: Mahimahi emulator
Wrappers for congestion control schemes
- Mostly iperf
- QUIC
Scheme Running order TCP Cubic Receiver first TCP Vegas Receiver first TCP BBR Receiver first QUIC Sender first WebRTC Sender first LEDBAT Receiver first PCC Receiver first Verus Sender first SCReAM Receiver first RemyCC Receiver first Sprout Receiver first Copa Receiver first Vivace Receiver first FillP Receiver first Indigo Sender first
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7
Design
How the Pantheon works Two testing modes
- Remote mode: Real network paths us-
ing the globally deployed network nodes
- Local mode: Mahimahi emulator
Wrappers for congestion control schemes
- Mostly iperf
- QUIC
Pantheon-tunnel Scheme Running order TCP Cubic Receiver first TCP Vegas Receiver first TCP BBR Receiver first QUIC Sender first WebRTC Sender first LEDBAT Receiver first PCC Receiver first Verus Sender first SCReAM Receiver first RemyCC Receiver first Sprout Receiver first Copa Receiver first Vivace Receiver first FillP Receiver first Indigo Sender first
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7
Design
How the Pantheon works Two testing modes
- Remote mode: Real network paths us-
ing the globally deployed network nodes
- Local mode: Mahimahi emulator
Wrappers for congestion control schemes
- Mostly iperf
- QUIC
Pantheon-tunnel
- TUN
Scheme Running order TCP Cubic Receiver first TCP Vegas Receiver first TCP BBR Receiver first QUIC Sender first WebRTC Sender first LEDBAT Receiver first PCC Receiver first Verus Sender first SCReAM Receiver first RemyCC Receiver first Sprout Receiver first Copa Receiver first Vivace Receiver first FillP Receiver first Indigo Sender first
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7
Design
How the Pantheon works Two testing modes
- Remote mode: Real network paths us-
ing the globally deployed network nodes
- Local mode: Mahimahi emulator
Wrappers for congestion control schemes
- Mostly iperf
- QUIC
Pantheon-tunnel
- TUN
- Running order of sender and receiver
Scheme Running order TCP Cubic Receiver first TCP Vegas Receiver first TCP BBR Receiver first QUIC Sender first WebRTC Sender first LEDBAT Receiver first PCC Receiver first Verus Sender first SCReAM Receiver first RemyCC Receiver first Sprout Receiver first Copa Receiver first Vivace Receiver first FillP Receiver first Indigo Sender first
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 7
Design
How the Pantheon works
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 8
Design
How the Pantheon works
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 8
Design
How the Pantheon works
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 8
Design
Globally deployed network nodes Location Cellular network Wired Network WiFi U.S.
- Mexico
- Brazil
- Colombia
- India
- China
- U.K.
- Japan
- Australia
- Nepal
- Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research
9
Design
Sample output
6 8 10 12 14
95th percentile one-way delay (ms)
50 100 150 200 250 300 350
Average throughput (Mbit/s) test from local to remote, 3 runs of 30s each per scheme FillP Copa Indigo QUIC Cubic TCP Cubic Sprout PCC-Vivace SCReAM TCP Vegas TCP BBR Verus PCC-Allegro PCC-Expr WebRTC media TaoVA-100x LEDBAT
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 10
Evaluation
src: https://www.google.com/maps Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 11
Evaluation
src: https://www.google.com/maps Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 11
Evaluation
src: https://www.google.com/maps Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 11
Evaluation
Different network paths
Frankfurt to London (left) and Frankfurt to Paris (right)
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 12
Evaluation
Opposite directions of a network path
Frankfurt to London (left) and London to Frankfurt (right)
Reflection:
- Bidirectional measurements
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 13
Evaluation
Different testing time
Frankfurt to London with one week difference (right)
Potential reasons:
- Peak/Off peak time
- Abnormal behaviors of Internet traffic
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 14
Evaluation
Different number of flows
Frankfurt to London with 3 flows running in a single test (right)
Potential reasons:
- Quality of networks
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 15
Conclusion
Challenges of the development of congestion control
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 16
Conclusion
Challenges of the development of congestion control The Pantheon
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 16
Conclusion
Challenges of the development of congestion control The Pantheon
- community evaluation platform
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 16
Conclusion
Challenges of the development of congestion control The Pantheon
- community evaluation platform
- 15 different congestion control schemes and global measurement nodes
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 16
Conclusion
Challenges of the development of congestion control The Pantheon
- community evaluation platform
- 15 different congestion control schemes and global measurement nodes
- network emulators
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 16
Thank you
Any questions?
Chun-Te Sung — Pantheon: the Training Ground for Internet Congestion-Control Research 17