Improving Content Delivery Using Provider-aided Distance Information - - PowerPoint PPT Presentation

▶
improving content delivery using provider aided distance
SMART_READER_LITE
LIVE PREVIEW

Improving Content Delivery Using Provider-aided Distance Information - - PowerPoint PPT Presentation

Mar 19, 2024 365 likes •615 views

Titlepage Improving Content Delivery Using Provider-aided Distance Information Ingmar Poese Benjamin Frank Bernhard Ager Georgios Smaragdakis Anja Feldmann { ingmar|bfrank|bernhard|georgios|anja } @net.t-labs.tu-berlin.de Technische

slide-1
SLIDE 1

Titlepage

Improving Content Delivery Using Provider-aided Distance Information

Ingmar Poese Benjamin Frank Bernhard Ager Georgios Smaragdakis Anja Feldmann {ingmar|bfrank|bernhard|georgios|anja} @net.t-labs.tu-berlin.de

Technische Universtit¨ at Berlin/Deutsche Telekom Laboratories

November 1 2010

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 1

slide-2
SLIDE 2

Outline

1 Background 2 Diversity in cache locations 3 Leveraging diversity with PaDIS 4 Evaluation

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 2

slide-3
SLIDE 3

Background

Content is King

Maier Germany 2008 Maier Germany 2009 ipoque Germany 2007 ipoque Germany 2009 ipoque MidEast 2007 ipoque MidEast 2009 Arbor World-wide 2007 Arbor World-wide 2009 Sandvine World-wide 2008 Sandvine World-wide 2009 0% 20% 40% 60% 80% 100% Web Streaming Usenet (NNTP) BitT

  • rrent/P2P

eDonkey Other/known Unclassified P2P more likely* at 18% *Based on limited dataset using payload inspection

Fabian Schneider: Analysis of New Trends in the Web from a Network Perspective, 2010

  • Web and streaming are dominating Internet traffic
  • both run over HTTP
  • Contribute up to 60 % of the volume

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 3

slide-4
SLIDE 4

Background

CDN deployment

C C C C C C C C C Client C C C C C C C C C

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 4

slide-5
SLIDE 5

Background

CDN deployment

C C C C C C C C C Client C C C C C C C C C

Caches

  • Inside ISPs
  • By subnet
  • By location
  • Assignment via DNS
  • By DNS redirection

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 4

slide-6
SLIDE 6

Background

CDN cache selection

DNS based cache selection

1 Client queries resolver 2 Redirect to CDN 3 CDN chooses cache(s)

  • Return via resolver

4 Connect to cache

CDN DNS

  • auth. DNS

Internet resolver

1

Client

2 3

C

4 Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 5

slide-7
SLIDE 7

Background

CDN cache selection

DNS based cache selection

1 Client queries resolver 2 Redirect to CDN 3 CDN chooses cache(s)

  • Return via resolver

4 Connect to cache

CDN DNS

  • auth. DNS

Internet resolver

1

Client

2 3

C

4

Known metrics

  • Cache load
  • Content availability

Unknown metrics

  • Exact position
  • Path properties

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 5

slide-8
SLIDE 8

Outline

1 Background 2 Diversity in cache locations 3 Leveraging diversity with PaDIS 4 Evaluation

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 6

slide-9
SLIDE 9

Diversity in cache locations

Data

AS Edge Router Internet/other ASes Broadband Access Router Other Customers of AS Monitoring Point Customers Downstream

  • f Monitoring Point

Click stream data

  • Anonymized trace from a POP in a large European ISP.
  • Trace spans over 20.000 customers and 14 days
  • total of 1.2 billion requests (89 million/day)
  • Examine top 10,000 hostnames
  • Exposed location diversity
  • Potential for content delivery

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 7

slide-10
SLIDE 10

Diversity in cache locations

Location diversity per hostname

1e-05 0.0001 0.001 0.01 0.1 1 1 2 3 4 5 6 7 8

CCDF

  • Avg. Number Locations per Hostname

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 8

slide-11
SLIDE 11

Diversity in cache locations

Location diversity per content provider

0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 1 10 100

CDF # of Different Locations Ubiquitous Caches

  • Serve anything
  • Fetch missing

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 9

slide-12
SLIDE 12

Leveraging diversity with PaDIS

Opportunities for ISPs

Current situation

  • CDNs do not expose location diversity
  • Cache selection without accurate client position
  • Unknown path properties to content consumer

⇒ Can content delivery be improved with location diversity ?

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 10

slide-13
SLIDE 13

Leveraging diversity with PaDIS

Opportunities for ISPs

Current situation

  • CDNs do not expose location diversity
  • Cache selection without accurate client position
  • Unknown path properties to content consumer

⇒ Can content delivery be improved with location diversity ? Provider-aided Distance Information System (PaDIS)

  • PaDIS can utilize the diversity in paths to locations
  • Improves application performance and Quality of experience
  • Reduce page load delay
  • Reduce download time for large files
  • Removes the need for in-accurate active measurement
  • ISPs gain influence on the path selection to locations

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 10

slide-14
SLIDE 14

Leveraging diversity with PaDIS

Status Quo

ISP DNS Resolver Client External DNS 1 2 3 4

Steps

1 DNS Query 2 Find auth. DNS server 3 Receive auth. DNS answer 4 DNS resolver forwards reply

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 11

slide-15
SLIDE 15

Leveraging diversity with PaDIS

PaDIS usage example

PaDIS ISP DNS Resolver Client External DNS 1 2 3 6 4 5

Steps

1 DNS Query 2 Find auth. DNS server 3 Receive auth. DNS answer 4 Send Answer to PaDIS 5 PaDIS aggregates and reorders

known IPs

6 DNS resolver sends top ranked IPs

back to client

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 11

slide-16
SLIDE 16

Leveraging diversity with PaDIS

PaDIS usage example

PaDIS Properties

  • Operated by the ISP
  • Up-to-date network information
  • Knowledge of CDN caches
  • No architecture change needed
  • Transparent to consumer and CDN

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 12

slide-17
SLIDE 17

Evaluation

Experiment setup for CDN

C C C C C C C C C Client

1 2

C C C C C C C C C resolver

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 13

slide-18
SLIDE 18

Evaluation

Experiment setup for CDN

C C C C C C C C C Client

1 3

C C C C C C C C C resolver PaDIS PaDIS

2

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 14

slide-19
SLIDE 19

Evaluation

Experiment setup for CDN

C C C C C C C C C Client

1 3

C C C C C C C C C resolver PaDIS PaDIS

2

Statistics

  • 124 locations
  • 11 files

Algorithm

  • Download file from all locations
  • Compare CDN selection with PaDIS

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 14

slide-20
SLIDE 20

Evaluation

Selected result for CDN

Downloading a 510K file from 124 locations every hour

0.5 1.0 1.5 2.0 2.5 3.0

510K

time download time in s

recommended PaDIS

00:00 12:00 24:00

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 15

slide-21
SLIDE 21

Evaluation

Expanding the scope

Using PaDIS on a One-Click-Hoster (OCH)

OCH File ISP-3 ISP-1 ISP-2 ISP

P e e r i n g L i n k Peering Link Peering Link Peering Link

OCH Repeat experiment setup with an OCH

  • Select peering link instead of cache location
  • Repeatedly download a (60 Mbyte) File via all peerings
  • Evaluate link selection
  • Compare download times

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 16

slide-22
SLIDE 22

Evaluation

Download time Evaluation

Downloading a 60MByte file every two hours via all peering links

20 50 100 200 Thu Fri Sat Sun Mon Tue Wed Thu

Download Time (in Seconds) Time direct Peering via ISP-1 via ISP-2 via ISP-3

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 17

slide-23
SLIDE 23

Evaluation

Summary

Summary

  • CDNs do not expose location diversity consumers
  • PaDIS can expose and utilize the diversity
  • Localize traffic
  • Decrease delay and download times
  • Give power back to the ISP
  • The experiments (CDN + OCH) show a signifcant reduction in

download time Future work

  • Quantify traffic reduction for ISPs when using PaDIS
  • Can PaDIS be used for traffic engineering by ISPs ?

Poese et al (TUB/DT) Improving Content Delivery Using Provider-aided Distance Information Nov 1 2010 18