open connect everywhere a glimpse at the internet
play

Open Connect Everywhere: A Glimpse at the Internet Ecosystem through - PowerPoint PPT Presentation

Feb 25, 2023 •384 likes •733 views

Open Connect Everywhere: A Glimpse at the Internet Ecosystem through the Lens of the Netflix CDN Timm Bttger, Felix Cuadrado, Gareth Tyson, Ignacio Castro, Steve Uhlig steve.uhlig@qmul.ac.uk Queen Mary University of London, UK Agenda

  1. Open Connect Everywhere: A Glimpse at the Internet Ecosystem through the Lens of the Netflix CDN Timm Böttger, Felix Cuadrado, Gareth Tyson, Ignacio Castro, Steve Uhlig steve.uhlig@qmul.ac.uk Queen Mary University of London, UK

  2. Agenda • Motivation • Background • Methodology • Server deployment • Traffic • Conclusion Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 2 through the Lens of the Netflix CDN

  3. Research Questions • Where did Netflix choose to deploy servers? • What does this tell us about the Internet Ecosystem? Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 3 through the Lens of the Netflix CDN

  4. World-Wide Content Availability Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 4 through the Lens of the Netflix CDN

  5. Architectural Decisions Architectures Architectures Centralised Distributed Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 5 through the Lens of the Netflix CDN

  6. Concentrate Your Resources Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 6 through the Lens of the Netflix CDN

  7. Try to be Everywhere • 216,000 servers • In over 120 countries • Within more than 1,500 networks Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 7 through the Lens of the Netflix CDN

  8. Agenda • Motivation • Background • Methodology • Server deployment • Traffic • Conclusion Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 8 through the Lens of the Netflix CDN

  9. The Old Netflix • Netflix used to rely on datacentres plus CDN partners Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 9 through the Lens of the Netflix CDN

  10. Today’s Netflix Architecture • “Datacentre-free” since January 2016 • Many services on Amazon Web Services • Netflix deployed its own CDN: OpenConnect Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 10 through the Lens of the Netflix CDN

  11. Netflix OpenConnect Delivery Options ISP A ISP B the ”Internet” IXP Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 11 through the Lens of the Netflix CDN

  12. Out of scope: Netflix Client Redirection Video Server Video Server Video Server DNS Server ipv4_1-lagg0-c020.1.lhr001.ix.nflxvideo.net Application Logic Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 12 through the Lens of the Netflix CDN

  13. Agenda • Motivation • Background • Methodology • Server deployment • Traffic • Conclusion Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 13 through the Lens of the Netflix CDN

  14. Deployment: Exploiting the Naming Scheme • DNS names of servers used by Netflix: • ipv4_1-lagg0-c020.1. lhr 001. ix .nflxvideo.net • ipv4_1-cxl0-c045.1. fra 001. ix .nflxvideo.net • ipv6_1-lagg0-c002.1. lhr 005. bt.isp .nflxvideo.net • Using a DNS crawler, we discovered • 4,777 servers • 243 locations • 48 countries • 123 ISPs Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 14 through the Lens of the Netflix CDN

  15. Traffic: Exploiting IPID • IPID  Field of the IPv4 header  Originally used for fragmentation  Can be incremented arbitrarily, though often incrementally [RFC6864] • All Netflix caches run FreeBSD 10 • Checked that consistent values of the IPID field returned • 1 sample per server every 30 mins to reduce overhead Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 15 through the Lens of the Netflix CDN

  16. Agenda • Motivation • Background • Methodology • Server deployment • Traffic • Conclusion Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 16 through the Lens of the Netflix CDN

  17. Global Netflix deployment (locations) Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 17 through the Lens of the Netflix CDN

  18. Global Netflix deployment (size) Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 18 through the Lens of the Netflix CDN

  19. Deployment according to Netflix Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 19 through the Lens of the Netflix CDN

  20. Servers deployed at IXP locations Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 20 through the Lens of the Netflix CDN

  21. Map of IXP locations worldwide Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 21 through the Lens of the Netflix CDN

  22. Servers deployed at ISP locations Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 22 through the Lens of the Netflix CDN

  23. Global relative IXP/ISP deployment • Few IXP locations • Many ISP locations • More servers at IXPs than ISPs overall • Though continents differ Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 23 through the Lens of the Netflix CDN

  24. Server deployment in North America Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 24 through the Lens of the Netflix CDN

  25. Server deployment in Europe Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 25 through the Lens of the Netflix CDN

  26. Northern Europe Country Network (IXP/ISP) # of servers Norway Telenor (ISP) 40 13 Country Network (IXP/ISP) # of servers Altibox (ISP) Denmark TDC (ISP) 24 Getas (ISP) 10 5 5 Stofa (ISP) Broadnet (ISP) Comx (ISP) 3 Bkk (ISP) 2 Nianet (ISP) 3 Ntebredband (ISP) 2 Hi3g (ISP) 2 Signal (ISP) 2 Telenordk (ISP) 2 Sweden IXP 60 2 22 Trefor (ISP) Comhem (ISP) Waoo (ISP) 2 Telenor (ISP) 16 13 5 Finland IXP Bahnhof (ISP) 8 4 Dna (ISP) Bredband2 (ISP) Fne (ISP) 2 Alltele (ISP) 3 2 Nordunetas (ISP) Telecom3 (ISP) 2 Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 26 through the Lens of the Netflix CDN

  27. ISP deployment in largest markets worldwide • USA: Tier-1 ISPs do not deploy…they have their own CDN agenda. • Canada: Significant ISP deployment due to no IXP deployment (US-based Equinix is used) • UK: Significant ISP deployment, because it’s a large enough market to require ISP deployment • Mexico: Significant deployment, absence actually means ISP merging Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 27 through the Lens of the Netflix CDN

  28. Deployment: take-home message • Still a datacentre-based approach (through IXPs)  Few IXP locations with significant number of servers  Complemented by ISP deployment • Every region/market is different, though many share similarities Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 28 through the Lens of the Netflix CDN

  29. Agenda • Motivation • Background • Methodology • Server deployment • Traffic • Conclusion Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 29 through the Lens of the Netflix CDN

  30. Estimated global traffic pattern • North America dominates • Followed by Europe (UK mostly) • Central/South America unexpectedly third (Mexico and Brazil) Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 30 through the Lens of the Netflix CDN

  31. Traffic per country • Total traffic:  Expected: US, CA, GB, AU  Interesting: MX, BR • Share of IXP/ISP traffic reflects server deployment figures Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 31 through the Lens of the Netflix CDN

  32. Traffic: take-home message • North America dominates, as expected • Strong Central/South American market • IXP traffic dominates, reflecting server deployment figures • Peak traffic dominates, though evidence of limited back-end traffic Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 32 through the Lens of the Netflix CDN

  33. Agenda • Motivation • Background • Methodology • Server deployment • Traffic • Conclusion Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 33 through the Lens of the Netflix CDN

  34. Conclusion • First ever mapping of Netflix’s OpenConnect CDN  Physical server distribution  Traffic estimation • Different markets require region-specific deployments  Differences between the local Internet Ecosystems  Marked contrast/complementarity in IXP/ISP deployments • Exposing Netflix’ overall server placement strategy  Appears focused on utilising IXP footprint  Complemented by ISP deployment  Actually: deploying within ISPs takes time, so importance of IXP deployment reflects the phase in the ongoing process of deploying within ISPs • Full paper at arXiv - http://tiny.cc/netflix-maps Open Connect Everywhere: A Glimpse at the Internet Ecosystem 27/07/2016 34 through the Lens of the Netflix CDN

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Welcome to ICANN A glimpse of today s Internet Dec 2011: More than 225 million domain

Welcome to ICANN A glimpse of today s Internet Dec 2011: More than 225 million domain

Welcome to ICANN A glimpse of today s Internet Dec 2011: More than 225 million domain names Source: VeriSign Domain Name Industry Brief, March 2012 2 Who is in charge of Internet? Governed through a distributed system Not governed

712 views • 25 slides
A glimpse into convex geometry 5 \ A glimpse into convex geometry Two

A glimpse into convex geometry 5 \ A glimpse into convex geometry Two

A glimpse into convex geometry A glimpse into convex geometry 5 \ A glimpse into convex geometry Two basis reference: 1. Keith Ball, An elementary introduction to modern convex geometry 2. Chuanming Zong, What is known

1k views • 67 slides
open platform, open tools and open data for an open Internet Tiziana Refice (tiziana@google.com)

open platform, open tools and open data for an open Internet Tiziana Refice (tiziana@google.com)

open platform, open tools and open data for an open Internet Tiziana Refice (tiziana@google.com) ISMA 2012 What & who is M-Lab? Measurement Lab (M-Lab) is a collaborative, researcher-driven effort to empower Internet users , researchers ,

483 views • 17 slides
Internet Overview Linking the world one computer at a time Unit Objectives: What is the

Internet Overview Linking the world one computer at a time Unit Objectives: What is the

Internet Overview Linking the world one computer at a time Unit Objectives: What is the Internet How to connect. Define things facilitated on the Internet Describe how to connect to the Internet from your home, and the use

742 views • 17 slides
TCP/IP The Physical Internet A Network of Networks LAN However you connect your machine to

TCP/IP The Physical Internet A Network of Networks LAN However you connect your machine to

TCP/IP The Physical Internet A Network of Networks LAN However you connect your machine to your network You are connected to everyone else on that network We o>en call this a Local Area Network (LAN) To connect to the Internet

615 views • 27 slides
THE INTERNET IS FOR EVERYONE Join us to keep the Internet open, thriving, and benefitting people

THE INTERNET IS FOR EVERYONE Join us to keep the Internet open, thriving, and benefitting people

THE INTERNET IS FOR EVERYONE Join us to keep the Internet open, thriving, and benefitting people around the globe. Conference on Global Internet Interconnection Center for Information Technology Policy Princeton University 11 March 2016

517 views • 20 slides
TravelSpirit and the Open Internet of Mobility Open internet of mobility Call SmartCard

TravelSpirit and the Open Internet of Mobility Open internet of mobility Call SmartCard

TravelSpirit and the Open Internet of Mobility Open internet of mobility Call SmartCard Contactless App Data Payment MaaS Journey Platform Operator Planner aggregator facilitator Service planner Open data feeds Platform

339 views • 7 slides
A Glimpse Of The Future Presented By Duncan Forbes Slide 1 A Glimpse Of The Future

A Glimpse Of The Future Presented By Duncan Forbes Slide 1 A Glimpse Of The Future

A Glimpse Of The Future Presented By Duncan Forbes Slide 1 A Glimpse Of The Future Objectives Strengthen European scientific and technological capability to develop innovative concepts Exploration of new market

288 views • 9 slides
THE INTERNET IS FOR EVERYONE Join us to keep the Internet open, thriving, and benefitting people

THE INTERNET IS FOR EVERYONE Join us to keep the Internet open, thriving, and benefitting people

THE INTERNET IS FOR EVERYONE Join us to keep the Internet open, thriving, and benefitting people around the globe. Our Mission To promote the open development, evolution, and use of the Internet for the benefit of all people throughout the

299 views • 25 slides
The Value of an Open Internet for India Research Questions What is the value of the internet

The Value of an Open Internet for India Research Questions What is the value of the internet

Key findings of the report The Value of an Open Internet for India Research Questions What is the value of the internet in India? Does an open internet increase its value? If yes, what is the value of an open internet for India?

426 views • 32 slides
Open Broadband, LLC Better Internet. Better North Carolina. http://openbb.net 704-237-0102 Open

Open Broadband, LLC Better Internet. Better North Carolina. http://openbb.net 704-237-0102 Open

Open Broadband, LLC Better Internet. Better North Carolina. http://openbb.net 704-237-0102 Open Broadband Footprint March 2019 Open Broadband Deployment Model - Hybrid Multiple Carriers Network Hub(s) Leased Fiber Circuit(s) Charlotte Data

380 views • 12 slides
CBCN4103 It is a global collection of networks, both big and small, that connect together in

CBCN4103 It is a global collection of networks, both big and small, that connect together in

CBCN4103 It is a global collection of networks, both big and small, that connect together in many different ways to form the single entity that we know as "the Internet." Who owns it? The Internet ernet Society, a

833 views • 42 slides
* Created by: Louis M Jack B Hope M Keira P Harry M * CREATE,CONNECT AND SHARE RESPECT: A

* Created by: Louis M Jack B Hope M Keira P Harry M * CREATE,CONNECT AND SHARE RESPECT: A

* Created by: Louis M Jack B Hope M Keira P Harry M * CREATE,CONNECT AND SHARE RESPECT: A BETTER INTERNET STARTS WITH YOU! Tuesday was Safer Internet Day! A chance for us all to think about what we love about the internet, all the

287 views • 13 slides
Project Things A secure gateway to connect your things to Internet February 2, 2019

Project Things A secure gateway to connect your things to Internet February 2, 2019

Project Things A secure gateway to connect your things to Internet February 2, 2019 <https://fosdem.org/2019/schedule/event/project_things> Speakers Dipesh Monga @ Mozilla Techspeakers Philippe Coval @ Samsung OpenSource 2 The hidden

558 views • 28 slides
Welcome to the workshop! Serverless Architecture by Example Open up your laptop, connect to

Welcome to the workshop! Serverless Architecture by Example Open up your laptop, connect to

Welcome to the workshop! Serverless Architecture by Example Open up your laptop, connect to wifj, and open your (recent) web browser Log in to the Google Cloud console: https://console.cloud.google.com/edu Set up a new Gmail account

1.07k views • 72 slides
Oklahoma Connect & Learn Initiative Open Range/OUSF/E-Rate Training Agenda Discussion Topics

Oklahoma Connect & Learn Initiative Open Range/OUSF/E-Rate Training Agenda Discussion Topics

Oklahoma Connect & Learn Initiative Open Range/OUSF/E-Rate Training Agenda Discussion Topics Oklahoma Connect & Learn Initiative Oklahoma State Department of Education Open Range Office of Management & Enterprise Services

129 views • 9 slides
to make the ISP 10:00-11:30am, 4 June 2020 actionable Item (presenter) Estimated start Welcome

to make the ISP 10:00-11:30am, 4 June 2020 actionable Item (presenter) Estimated start Welcome

Welcome to the AERs webinar: Draft guidelines to make the ISP 10:00-11:30am, 4 June 2020 actionable Item (presenter) Estimated start Welcome (Jim Cox) 10:00 Overview (Richard Khoe) 10:05 ISP cost benefit analysis (Nishana Perera)

630 views • 39 slides
Collaboration with ISPs for Large-Scale Deployment of eduroam in Japan Hideaki Goto NII /

Collaboration with ISPs for Large-Scale Deployment of eduroam in Japan Hideaki Goto NII /

31st APAN meeting Feb. 21-25, 2011, Hong Kong Collaboration with ISPs for Large-Scale Deployment of eduroam in Japan Hideaki Goto NII / Tohoku University, Japan 1 eduroam JP National eduroam operation and promotion 19 institutions

165 views • 12 slides
Introduction What is the Internet? Define network edge: hosts, access net, physical media

Introduction What is the Internet? Define network edge: hosts, access net, physical media

Computer Networks Chapter 1: Introduction CSC 249 January 25, 2018 Introduction What is the Internet? Define network edge: hosts, access net, physical media Define the network core & Internet structure First glimpse at the

414 views • 18 slides
Cameras in embedded systems: Device tree and ACPI view Sakari Ailus - Intel A typical embedded

Cameras in embedded systems: Device tree and ACPI view Sakari Ailus - Intel A typical embedded

Cameras in embedded systems: Device tree and ACPI view Sakari Ailus - Intel A typical embedded system with a camera Image Signal Processor Raw camera sensor Lens voice coil vana camera regulator module vdig lens GPIO reset

439 views • 39 slides
Near-Data Processing for Differentiable Machine Learning Models Hyeokjun Choe 1 , Seil Lee 1 ,

Near-Data Processing for Differentiable Machine Learning Models Hyeokjun Choe 1 , Seil Lee 1 ,

Near-Data Processing for Differentiable Machine Learning Models Hyeokjun Choe 1 , Seil Lee 1 , Hyunha Nam 1 , Seongsik Park 1 , Seijoon Kim 1 , Eui-Young Chung 2 and Sungroh Yoon 1 , 3 1 Electrical and Computer Engineering, Seoul National

520 views • 49 slides
19/06/2019 European Centre for Disease Prevention and Control (ECDC) ECDCs mission and vision:

19/06/2019 European Centre for Disease Prevention and Control (ECDC) ECDCs mission and vision:

19/06/2019 European Centre for Disease Prevention and Control (ECDC) ECDCs mission and vision: ECDC's mission is to identify , assess and communicate current and emerging threats to human health posed by infectious diseases . Migration

279 views • 3 slides
7/8/2019 1 2 3 4 5 6 1 7/8/2019 7 8 9 10 11 12 2 7/8/2019 13 14 15 16 17 18

7/8/2019 1 2 3 4 5 6 1 7/8/2019 7 8 9 10 11 12 2 7/8/2019 13 14 15 16 17 18

7/8/2019 1 2 3 4 5 6 1 7/8/2019 7 8 9 10 11 12 2 7/8/2019 13 14 15 16 17 18 3 7/8/2019 19 20 21 22 23 24 4 7/8/2019 25 26 27 28 29 30 5 7/8/2019 31 32 33 34 35 36 6 7/8/2019 37 38 39 40 41 42 7

540 views • 8 slides
7/8/2019 1 2 3 4 5 6 1 7/8/2019 7 8 9 10 11 12 2 7/8/2019 13 14 15 16 17 18

7/8/2019 1 2 3 4 5 6 1 7/8/2019 7 8 9 10 11 12 2 7/8/2019 13 14 15 16 17 18

7/8/2019 1 2 3 4 5 6 1 7/8/2019 7 8 9 10 11 12 2 7/8/2019 13 14 15 16 17 18 3 7/8/2019 19 20 21 22 23 24 4 7/8/2019 25 26 5

389 views • 5 slides

More recommend