Speed Measurements of Residential Internet Access Oana Goga, Renata - - PowerPoint PPT Presentation

▶
speed measurements of residential internet access
SMART_READER_LITE
LIVE PREVIEW

Speed Measurements of Residential Internet Access Oana Goga, Renata - - PowerPoint PPT Presentation

Nov 20, 2022 337 likes •727 views

Speed Measurements of Residential Internet Access Oana Goga, Renata Teixeira CNRS and UPMC Sorbonne Universites PAM 2012 News headlines question broadband access speed July 26, 2010 Aug. 15, 2010 Aug. 17, 2010 1 / 15 Who cares?

slide-1
SLIDE 1

Speed Measurements of Residential Internet Access

Oana Goga, Renata Teixeira

CNRS and UPMC Sorbonne Universites

PAM 2012

slide-2
SLIDE 2

News headlines question broadband access speed

July 26, 2010

  • Aug. 15, 2010
  • Aug. 17, 2010

1 / 15

slide-3
SLIDE 3

Who cares?

Policymakers want to regulate broadband access → FCC Open Internet Apps Challenge → FCC and Ofcom working with SamKnows to distribute routers Users want to test their connections → Speedtest.net, ComScore, Grenouille.fr, NDT, Netalyzr, etc. ISPs want to provision their network

2 / 15

slide-4
SLIDE 4

Speed metrics

Capacity → maximum link/path transmission rate TCP achievable throughput → average speed of single TCP transfer Available bandwidth → residual link/path capacity

3 / 15

slide-5
SLIDE 5

Speed metrics

Capacity → maximum link/path transmission rate ✘ does not capture speed variations TCP achievable throughput → average speed of single TCP transfer Available bandwidth → residual link/path capacity

3 / 15

slide-6
SLIDE 6

Speed metrics

Capacity → maximum link/path transmission rate ✘ does not capture speed variations TCP achievable throughput → average speed of single TCP transfer ✘ depends on factors exogenous to access ISPs Available bandwidth → residual link/path capacity

3 / 15

slide-7
SLIDE 7

Speed metrics

Capacity → maximum link/path transmission rate ✘ does not capture speed variations TCP achievable throughput → average speed of single TCP transfer ✘ depends on factors exogenous to access ISPs Available bandwidth → residual link/path capacity ✔ measures what users can get in their homes

3 / 15

slide-8
SLIDE 8

Approaches to measure available bandwidth

Flooding-based tools → Large parallel TCP transfers & post-processing Optimized-probing tools → Trains and pairs of probes with varying sizes and spacing

4 / 15

slide-9
SLIDE 9

Approaches to measure available bandwidth

Flooding-based tools → Large parallel TCP transfers & post-processing ✔ Measures the effective available bandwidth ✘ Large overhead Optimized-probing tools → Trains and pairs of probes with varying sizes and spacing

4 / 15

slide-10
SLIDE 10

Approaches to measure available bandwidth

Flooding-based tools → Large parallel TCP transfers & post-processing ✔ Measures the effective available bandwidth ✘ Large overhead Optimized-probing tools → Trains and pairs of probes with varying sizes and spacing ✔ Lower overhead ✘ Measures the theoretical available bandwidth

4 / 15

slide-11
SLIDE 11

This paper ...

Evaluate the tools in ADSL and cable networks → Tools selection → Testing methodology → Accuracy → Tools that use small probes underestimate the bandwidth → Home gateways cannot sustain the high packet rate of probes → Overhead

5 / 15

slide-12
SLIDE 12

Tools

Flooding-based tools iperf } → 10 parallel TCP connections, 10 seconds transfer Optimized-probing tools pathload

}

→ probe-rate model pathchirp spruce

}

→ probe-gap model igi/ptr

6 / 15

slide-13
SLIDE 13

Measurement setup

Full control over end-hosts → controlled traffic on the local loop The bottleneck is the local loop

7 / 15

slide-14
SLIDE 14

Accuracy of available bandwidth estimation tools

Tool Pckt. Comcast Orange Size Avg (Mbps) Avg (Mbps) UDP capacity 1440B 20.60/22.93 15.80 parallel TCP 1440B 19.20/22.00 15.04 spruce 1440B 23.35 15.77 pathload 200B 21.88 – 22.02 12.29 – 12.81

8 / 15

slide-15
SLIDE 15

Accuracy of available bandwidth estimation tools

Tool Pckt. Comcast Orange Size Avg (Mbps) Avg (Mbps) UDP capacity 1440B 20.60/22.93 15.80 parallel TCP 1440B 19.20/22.00 15.04 spruce 1440B 23.35 15.77 pathload 200B 21.88 – 22.02 12.29 – 12.81

8 / 15

slide-16
SLIDE 16

Accuracy of available bandwidth estimation tools

Tool Pckt. Comcast Orange Size Avg (Mbps) Avg (Mbps) UDP capacity 1440B 20.60/22.93 15.80 parallel TCP 1440B 19.20/22.00 15.04 spruce 1440B 23.35 15.77 pathload 200B 21.88 – 22.02 12.29 – 12.81

8 / 15

slide-17
SLIDE 17

Accuracy of available bandwidth estimation tools

Tool Pckt. Comcast Orange Size Avg (Mbps) Avg (Mbps) UDP capacity 1440B 20.60/22.93 15.80 parallel TCP 1440B 19.20/22.00 15.04 spruce 1440B 23.35 15.77 pathload 200B 21.88 – 22.02 12.29 – 12.81

8 / 15

slide-18
SLIDE 18

Accuracy of available bandwidth estimation tools

Tool Pckt. Comcast Orange Size Avg (Mbps) Avg (Mbps) UDP capacity 1440B 20.60/22.93 15.80 parallel TCP 1440B 19.20/22.00 15.04 spruce 1440B 23.35 15.77 pathload 200B 21.88 – 22.02 12.29 – 12.81

8 / 15

slide-19
SLIDE 19

Accuracy of available bandwidth estimation tools

Tool Pckt. Comcast Orange Size Avg (Mbps) Avg (Mbps) UDP capacity 1440B 20.60/22.93 15.80 parallel TCP 1440B 19.20/22.00 15.04 spruce 1440B 23.35 15.77 pathload 200B 21.88 – 22.02 12.29 – 12.81

8 / 15

slide-20
SLIDE 20

Accuracy of available bandwidth estimation tools

Tool Pckt. Comcast Orange Size Avg (Mbps) Avg (Mbps) UDP capacity 1440B 20.60/22.93 15.80 parallel TCP 1440B 19.20/22.00 15.04 spruce 1440B 23.35 15.77 pathload 200B 21.88 – 22.02 12.29 – 12.81

8 / 15

slide-21
SLIDE 21

Accuracy of available bandwidth estimation tools

Tool Pckt. Comcast Orange Size Avg (Mbps) Avg (Mbps) UDP capacity 1440B 20.60/22.93 15.80 parallel TCP 1440B 19.20/22.00 15.04 spruce 1440B 23.35 15.77 pathload 200B 21.88 – 22.02 12.29 – 12.81 pathload 1440B 22.87 – 23.10 15.52 – 15.66

8 / 15

slide-22
SLIDE 22

Accuracy of available bandwidth estimation tools

Tool Pckt. Comcast Orange Size Avg (Mbps) Avg (Mbps) UDP capacity 1440B 20.60/22.93 15.80 parallel TCP 1440B 19.20/22.00 15.04 spruce 1440B 23.35 15.77 pathload 200B 21.88 – 22.02 12.29 – 12.81 pathload 1440B 22.87 – 23.10 15.52 – 15.66 Spruce, pathload with large probes and parallel TCP are accurate Tools that use small probes underestimate the bandwidth

8 / 15

slide-23
SLIDE 23

Why tools with small probes underestimate the bandwidth?

Optimized-probing tools work well in core/academic networks Packet rate limitation on the ADSL part of the network → DSLAM? → Gateways? → ATM encapsulation?

9 / 15

slide-24
SLIDE 24

Controlled experiments to explain underestimation

10 / 15

slide-25
SLIDE 25

Controlled experiments to explain underestimation

10 / 15

slide-26
SLIDE 26

Controlled experiments to explain underestimation

10 / 15

slide-27
SLIDE 27

Maximum achievable packet rate

11 / 15

slide-28
SLIDE 28

Maximum achievable packet rate

11 / 15

slide-29
SLIDE 29

Maximum achievable packet rate

11 / 15

slide-30
SLIDE 30

Maximum achievable packet rate

11 / 15

slide-31
SLIDE 31

Summary of findings on accuracy

Spruce, pathload with large probes and parallel TCP are accurate Tools that use small probes underestimate the bandwidth Home gateways cannot sustain the high packet rate of probes Low-performance hardware and network-address translation are limiting factors The limit is true for all 40 gateways we tested

12 / 15

slide-32
SLIDE 32

Overhead of available bandwidth estimation tools

Tool Pckt. Orange Comcast Size (Kbytes) (Kbytes) parallel TCP 1440B 20,908 26,844/19,177 pathload 1440B 8,528 12,582 pathload 200B 622 2,041 spruce 1440B 288 288

13 / 15

slide-33
SLIDE 33

Overhead of available bandwidth estimation tools

Tool Pckt. Orange Comcast Size (Kbytes) (Kbytes) parallel TCP 1440B 20,908 26,844/19,177 pathload 1440B 8,528 12,582 pathload 200B 622 2,041 spruce 1440B 288 288

13 / 15

slide-34
SLIDE 34

Overhead of available bandwidth estimation tools

Tool Pckt. Orange Comcast Size (Kbytes) (Kbytes) parallel TCP 1440B 20,908 26,844/19,177 pathload 1440B 8,528 12,582 pathload 200B 622 2,041 spruce 1440B 288 288

13 / 15

slide-35
SLIDE 35

Overhead of available bandwidth estimation tools

Tool Pckt. Orange Comcast Size (Kbytes) (Kbytes) parallel TCP 1440B 20,908 26,844/19,177 pathload 1440B 8,528 12,582 pathload 200B 622 2,041 spruce 1440B 288 288

13 / 15

slide-36
SLIDE 36

Summary of findings on overhead

Overhead of flooding-based tools ≫ optimized-probing tools Spruce has the lowest overhead BUT → needs interrupt coalescence disabled → assumes knowledge of capacity

14 / 15

slide-37
SLIDE 37

Guidelines

Both flooding-based tools and optimized-probing tools are necessary

◮ Flooding-based tools are necessary because of cross traffic ◮ Optimized-probing tools are necessary for frequent measurements

❳❳❳❳❳❳❳❳❳❳❳

Frequency Control Full No One shot parallel TCP parallel TCP Repeated spruce pathload

15 / 15