ISPs, Backbones and Peering 14-740: Fundamentals of Computer - - PowerPoint PPT Presentation

isps backbones and peering
SMART_READER_LITE
LIVE PREVIEW

ISPs, Backbones and Peering 14-740: Fundamentals of Computer - - PowerPoint PPT Presentation

ISPs, Backbones and Peering 14-740: Fundamentals of Computer Networks Bill Nace Material from Computer Networking: A Top Down Approach, 6 th edition. J.F. Kurose and K.W. Ross Administrivia Norton2010 Paper Review for today Lab0 is


slide-1
SLIDE 1

Material from Computer Networking: A Top Down Approach, 6th edition. J.F. Kurose and K.W. Ross

ISPs, Backbones and Peering

14-740: Fundamentals of Computer Networks Bill Nace

slide-2
SLIDE 2

Administrivia

  • Norton2010 Paper Review for today
  • Lab0 is posted

2

slide-3
SLIDE 3

Last Lecture

  • Internet TCP/IP architecture
  • Layering not strictly enforced
  • “Hourglass” -- IP ueber alles
  • Allows rapid innovation at layers below
  • Flexible applications / services above
  • IETF process
  • “Rough consensus and running code”
  • End-to-end argument
  • Does it still apply?

3

slide-4
SLIDE 4

Another take on Layered Architecture

slide-5
SLIDE 5

traceroute

  • ISPs and Backbones
  • Peering and Settlements
  • Peering Evolution
  • Interconnections

5

slide-6
SLIDE 6

A Packet’s Journey

  • Packets travel across many networks
  • Particular protocols will be studied later
  • This lecture motivates why routing

mechanics are necessary

CMU Pgh PennRen Some NW Tier 1 ISP Tier 1 ISP Tier 1 ISP Some ISP Little ISP Cheap ISP Huge ISP CMU Kobe A B C E F D G H J

6

slide-7
SLIDE 7

CMU’s Infrastructure

  • Two 10 Gigabit Ethernet links

(singlemode fiber) to Pittsburgh Supercomputer Center

  • From Cisco 6500s located in Cyert

and Stever House

  • “Redundancy” links to PennRen /

Level3 over 1Gbps rate-limited 10 Gigabit Ethernet

  • Money
  • $40K per year to PennRen
  • A PA state education network
  • $100K to PSC, $100K to Level3
  • $300K per year on fiber leases

1Gbps/10Gbps 10Gbps 10Gbps 1Gbps Internal External CMU Internal PennRen PSC Internet2 Level3 Comodity Internet

slide-8
SLIDE 8

Backbones

  • In the beginning ... of Internet time
  • Single backbone: NSFNet
  • Everyone on the “Internet” was on NSFNet
  • A backbone network enables all connected

end-hosts (users and companies) to communicate with each other

  • No interconnection problems

8

slide-9
SLIDE 9

Backbones (2)

  • Commercial backbone providers emerged
  • Technology transfer!
  • A “Good Thing”
  • If US Government was managing the

Internet, might not be so successful

  • We all expect universal Internet

connectivity

9

slide-10
SLIDE 10

Interfaces: Transit

  • Transit / provider-customer
  • ISP sells access to another ISP or

company

  • e.g. CMU buys transit (or access to

Internet) from Level3

10

slide-11
SLIDE 11

Interfaces: Peering

  • Reciprocal access to each other’s customers
  • Usually free exchange of traffic
  • DO NOT serve as transit for 3rd party data
  • E.g. Google and MSN peer with each other, so email

messages between Gmail and Hotmail are transferred directly, without going through their transit providers

  • These relationships are confidential business secrets
  • Roughly hierarchical, though the topology is flattening

11

slide-12
SLIDE 12

Tier 1 ISP

  • Internet backbone providers
  • Peers with every other Tier-1 in “Internet Region”
  • Who is a major ISP in your country?
  • US?
  • India?
  • China?
  • Careful: “Tier-1” is an overloaded and misleading term

12

slide-13
SLIDE 13

Images courtesy of Level-3

slide-14
SLIDE 14

Images courtesy of Verizon

>4200 networks in 142 nations, many at OC-768 speeds

slide-15
SLIDE 15

Image courtesy of tatacommunications.com/network

Tata: "Discover the World's Largest Global Footprint"

slide-16
SLIDE 16

“Typical” Infrastructure

  • High speed links
  • Level3 operates 40Gbps DWDM networks
  • High performance routers
  • Over-provisioned bandwidth
  • 40 ms delay within region
  • <1% packet loss
  • Global presence (or at least multi-continent)

16

slide-17
SLIDE 17

“Typical” Tier-1 Relationships

  • Directly connected to other Tier-1 ISPs (i.e.

peer with)

  • Connected to a large number of Tier-2 ISPs
  • Vertically integrated: sell services directly to

customers

  • International in coverage
  • Ecosystem: do not buy transit from another

provider in order to reach the whole Internet

17

slide-18
SLIDE 18

Why do Tier-1 ISPs need to peer with each other?

  • No single Tier-1 ISP can reach the whole

Internet on its own

  • Internet is a network of networks
  • But Tier-1 ISPs have a restrictive peering policy
  • Do not peer with other non-Tier-1 ISPs
  • They are potential revenue generating

customers

  • No incentive to accept additional peers

18

slide-19
SLIDE 19

What is a Tier-2 ISP?

  • Network infrastructure is usually regional
  • Customer of Tier-1 ISP(s) – needs to buy transit
  • Provider of customers – also re-sells this transit
  • Peers with other Tier-2 ISPs – settlement free

19

Tier 1 ISP Tier 1 ISP Tier 1 ISP IXP Tier-2 ISP Tier-2 ISP Tier-2 ISP Tier-2 ISP

Tier-2 ISP pays Tier-1 for connectivity to rest

  • f internet

Multi-connection relationships possible Tier-2 ISPs also peer

  • privately. Interconnection

can be direct or via IXP

slide-20
SLIDE 20

Thinking time

20

  • Why do Tier-2 ISPs need to buy transit

from a Tier-1 provider?

slide-21
SLIDE 21

Thinking time

21

  • Why do Tier-2 ISPs peer with each other?
slide-22
SLIDE 22

Open Peering Policy

  • Tier-2 ISPs have an open peering policy
  • Peer with anyone possible
  • Costs of peering have to be balanced against

gains for a Tier-2 ISP

  • Management cost: usually settlement-free

peering means both parties should send approx equal amounts of traffic to each other

  • Maintenance cost: extra equipment,

transmission capacity to meeting point, exchange and other fees

22

slide-23
SLIDE 23

Content Providers

  • Do not sell transit
  • Category A: Focus on content creation
  • Do not want to operate a network
  • Do not have expertise in maintaining peering

relationships — router, policy, negotiations, …

  • No Peering Policy
  • Category B: Sophisticated, large-scale players
  • Use peering to improve user experience
  • Open Peering Policy

23

slide-24
SLIDE 24

Peering Ecosystem

Tier 1 ISPs Tier 2 ISPs Content / Enterprise Companies

Full Mesh Peering Partial Mesh Peering Generally No Peering Must Buy Transit Transit Free Must Buy Transit

Internet Region

Things are never so clear-cut . . .

slide-25
SLIDE 25

traceroute

  • ISPs and Backbones
  • Peering and Settlements
  • Peering Evolution
  • Interconnections

25

slide-26
SLIDE 26

US Evolution

  • 1999/2000 economic collapse
  • Telecom sector
  • Need to rethink their business model
  • Need to cut costs
  • General dotcom bust
  • Lots of cheap equipment on eBay
  • Transit rates drop
  • Upstream provider @Home for cable companies went

bankrupt

  • Peer-to-peer file sharing grows exponentially in popularity

26

slide-27
SLIDE 27

Transit Prices are Falling

  • Price per Mbs ➙ 63% per year decline
  • Luckily, volume is increasing even more
  • Somewhat bad for Tier-1 ISPs

27

slide-28
SLIDE 28

Content Companies are Peering

  • Network savvy, large scale enterprises
  • MSN, Yahoo, Google, Ebay, Walmart, …
  • Yahoo has an open peering policy
  • Reduce transit costs
  • Improve end-user experience
  • Good for content companies
  • Bad for Tier-1 ISPs

28

slide-29
SLIDE 29

traceroute

  • ISPs and Backbones
  • Peering and Settlements
  • Peering Evolution
  • Interconnections

29

slide-30
SLIDE 30

Interconnection

  • How do two networks interconnect with

each other?

  • We are talking about routers in two

different companies, under separate administrative control

30

slide-31
SLIDE 31

Public Peering

  • U.S. government decided to let commercial companies

take over management of the backbone networks

  • 1991: Commercial Internet Exchange (CIX)
  • 1 router in Santa Clara, CA
  • 1995: Network Access Points (NAPs) in SF

, Chicago, NY, D.C.

  • More recent: Internet Exchange Point (IXP)
  • 30 in US, 6 in Japan
  • “More is good” because of congestion, at one point

20% of traffic going through the 1st NAP was dropped!

31

slide-32
SLIDE 32

ISP Connections

Tier 1 ISP Tier 1 ISP Tier 1 ISP IXP (Meet-me room) Tier 1 ISP

Tier-1 providers interconnect privately (Peer) Tier-1 providers also interconnect at Internet Exchange Points (IXP) (30 in US)

slide-33
SLIDE 33

Private Peering

  • Two networks bypass IXPs and directly peer
  • In response to congestion at some IXPs
  • Business reasons
  • Also more cost-effective
  • There are limited number of IXPs at major regions
  • Can privately peer in other locations
  • Sometimes take a hybrid approach
  • Public exchange for some peers
  • Private meeting point for others

33

slide-34
SLIDE 34

Provider-customer Interconnection

  • Point-of-presence (PoP)
  • Customer typically leases a high-speed

link from a 3rd party telecomm provider

  • Directly connects a router at a provider’s

PoP

34

slide-35
SLIDE 35

Various Methods

  • How do two networks interconnect with

each other?

  • Many methods: Public Peering, Private

Peering, Provider-customer PoP

  • There are really no industry-specific

regulations, mostly purely driven by commercial and economic forces

35

slide-36
SLIDE 36

How does the world connect to Facebook? Facebook’s network IXP in Germany IXP in Japan IXP in Sweden Level3 Amazon Directly Connected Peer?

Image courtesy of Teun Vink (teun.tv)

slide-37
SLIDE 37

Lesson Objectives

  • Now, you should be able to:
  • analyze business practices of various enterprises

using the multi-tier network model (Tier-1, 2, etc) and common peering practices

  • describe the relationships and associated

motivations for enterprises on the internet

  • analyze the effect of recent trends in internet usage

patterns on the various business enterprises on the internet

  • describe interconnection methods between

enterprise networks

37