SLIDE 1
Internet Policy and Independent Network Performance Measurement
Collin Anderson BEREC Expert Workshop on IP Interconnection
BoR (16) 230
Internet Policy and Independent Network Performance Measurement - - PowerPoint PPT Presentation
Internet Policy and Independent Network Performance Measurement - - PowerPoint PPT Presentation
BoR (16) 230 Internet Policy and Independent Network Performance Measurement Collin Anderson BEREC Expert Workshop on IP Interconnection Overview of Measurement Lab International Collaboration, Interdisciplinary, Open, Reviewed Modern
SLIDE 2
SLIDE 3
International Collaboration, Modern Research
Interdisciplinary, Open, Reviewed
SLIDE 4
M-Lab’s Global Footprint
Servers on Every Continent, Infrastructure Diversity
SLIDE 5
Throughput Measurements
- M-Lab hosts two active
throughput measurements:
- Network Diagnostic Tool
(NDT)
- BISmark
- NDT is integrated with
numerous applications and receives about 100,000 tests per day.
- Nearly every country is well-
covered.
SLIDE 6
How Does M-Lab Collect Its Data?
SLIDE 7
Measurement Clients
Performance measurement clients for informing users of their network capacity.
SLIDE 8
Software Integrations
Providing network information to software to enable better user experience.
SLIDE 9
Partnerships with Regulatory Agencies
Monitoring the progress of broadband deployment for policy- making.
SLIDE 10
Consumer Measurement and Policy Case Study
Interconnection Disputes in the United States
SLIDE 11
The Regulator’s Problem
- Utilization and performance
data is proprietary and hidden from the public.
- User collected information is
- ften unreliable, incomparable,
methodologically inconsistent and narrowly scoped.
- Longitudinal data is rare, so is
comparative measurement.
- Independent data is expensive,
collection efforts are burdensome.
SLIDE 12
Network Diagnostic Tool
- M-Lab’s most popular hosted
test, tens of thousands of measurements daily.
- Simple test of bulk transfer
capacity.
- Multiple NDT implementations
available, across different languages and for diversity of purposes.
- All implementations share the
same methodology and are inter compatible.
SLIDE 13
Measuring Performance
Bulk Transfer Capacity
Interconnection
SLIDE 14
Transit ISP X Transit ISP Y Access ISP A Access ISP B
Network Interconnection s
Transit ISP X Transit ISP Y Access ISP A Access ISP B
✓
Transit ISP X Transit ISP Y Access ISP A Access ISP B
✓
Transit ISP X Transit ISP Y Access ISP A Access ISP B Transit ISP X Transit ISP Y Access ISP A Access ISP B
? ? ?
1 3 5 4 2
Methodology
Inferring the Source of Congestion
SLIDE 15
Inferring Sources of Congestion in Practice
Using New York’s Comparison
SLIDE 16
Inferring Sources of Congestion in Practice
Using New York’s Comparison
SLIDE 17
Inferring Sources of Congestion in Practice
US Access ISPs and Cogent (2013-2014)
SLIDE 18
Inferring Sources of Congestion in Practice
US Access ISPs and Cogent (2013-2014)
SLIDE 19
Internet Performance Varies Significantly Throughout the Day and Across Interconnections
SLIDE 20
Diurnal Patterns Are Instructive
Expectations of Normal Performance
SLIDE 21
Diurnal Patterns Are Instructive
Expectations of Congested Performance
SLIDE 22
Diurnal Cycles In Practice
Peak Hours, Peak Disruption
SLIDE 23
Not Limited to Throughput
Latency Sensitive Applications Affected
SLIDE 24
Not Limited to One Transit Provider
Level 3 and Verizon
SLIDE 25
Congestion is Continuing
Congestion as of Q4 2014
SLIDE 26
Public Interest Data
- Interconnection Study results
were referred to in filings to United States regulator agency since the start of this year alone.
- M-Lab data has been used by
public interest organizations, private companies and individual citizens representing all sides of the debate.
- Cited in dozens of media
articles in interconnection.
SLIDE 27
Next Steps for Measurement Lab
Measurement Volume and Site Expansion
SLIDE 28
Partners and Integrations
Increased Test Volume
SLIDE 29
New Sites in Europe
Increased Test Volume
SLIDE 30