Failures, Latency and Happy Eyeballs Q/A Acknowledgements Happy - PowerPoint PPT Presentation

Motivation IETF 99 July 2017 Samknows Limited, London, UK Sam Crawford Samknows Limited, London, UK Steffje Jacob Eravuchira Jacobs University Bremen, Germany Jürgen Schönwälder Joint work with Prague, CZ TU Munich Contribution Vaibhav Bajpai Failures, Latency and Happy Eyeballs Q/A Acknowledgements Happy Eyeballs Latency Partial Failures Complete Failures 1 / 16 A Longitudinal View of Dual-stacked Websites −

Motivation Acknowledgements Contribution Motivation Q/A shaded region represents the duration of the longitudinal study. Happy Eyeballs Complete Failures Latency 2 / 16 Partial Failures Google IPv6 Adoption 15% ▶ Literature focus largely on IPv6 adoption. 10% 5% ▶ Very little work on measuring IPv6 performance. 0% ▶ Tiis study closes the gap. 2009 2010 2011 2012 2013 2014 2015 2016 2017 NETWORK TYPE # RESIDENTIAL 78 NREN / RESEARCH 10 BUSINESS / DATACENTER 08 OPERATOR LAB 04 IXP 01 RIR # RIPE 60 ARIN 29 APNIC 10 AFRINIC 01 LACNIC 01 ∼ 100 dual-stacked SamKnows probes ( ∼ 66 difgerent origin ASes)

Motivation Q/A shifuing signifjcant traffjc overnight over IPv6. A CDN plays a leading role in technology adoption and Contribution Motivation 3 / 16 Acknowledgements Happy Eyeballs Latency Partial Failures Complete Failures Google IPv6 Adoption 3.0% ALEXA 1M with AAAA entries Native IPv6 Weekends - Weekdays 2.0% 20.0% 1.0% W6D W6LD 15.0% 0.0% 10.0% -1.0% 5.0% 0.06% Teredo/6to4 0.04% 0.0% 0.02% 2010 2011 2012 2013 2014 2015 2016 2017 0.0% -0.02% 2008 2009 2010 2011 2012 2013 2014 2015 2016 top 1000K 12.1 top 100K 17.4 top 10K 20.4 ▶ Tie drifu of IPv6 penetration is increasing. top 1K 25.7 top 0.1K 40.0 Country Distribution 0% 10% 20% 30% 40% Websites Canada: 3.70 % Canada: 3.70 % Botswana: 1.85 % Botswana: 1.85 % Taiwan: 1.85 % Taiwan: 1.85 % Japan: 29.63 % Japan: 29.63 % ▶ Cloudfmare Efgect (shaded region) Zambia: 1.85 % Zambia: 1.85 % Bulgaria: 1.85 % Bulgaria: 1.85 % Sri Lanka: 3.70 % Sri Lanka: 3.70 % ▶ Tie dent created by Cloudfmare > W6D (or W6LD). South Africa: 1.85 % South Africa: 1.85 % Australia: 3.70 % Australia: 3.70 % ▶ Cloudfmare added AAAA entries for all websites [1]. Kenya: 1.85 % Kenya: 1.85 % Argentina: 3.70 % Argentina: 3.70 % Pakistan: 1.85 % Pakistan: 1.85 % Brazil: 16.67 % Brazil: 16.67 % Peru: 20.37 % Peru: 20.37 % United States: 1.85 % United States: 1.85 % Malaysia: 3.70 % Malaysia: 3.70 % Highcharts.com ▶ Prefjxes blacklisted by Google over IPv6 (2017)

Motivation Q/A of failures and performance of dual-stacked websites. Tiis is the fjrst study to provide a longitudinal view (4 years) Contribution Research Contribution 4 / 16 Acknowledgements Happy Eyeballs Latency Partial Failures Complete Failures ▶ Complete Failures ▶ Partial Failures ▶ Failures silently exist; clients do not notice them due to IPv4 fallback. ▶ Can websites with partial failures be deemed IPv6-ready? ▶ Quantifjcation of failures helpful for upcoming IPv6-only networks. ▶ Latency ▶ Happy Eyeballs

Motivation Q/A Metrics should account for changes in IPv6-readiness. Contribution Complete Failures 5 / 16 Acknowledgements Partial Failures Latency Complete Failures Happy Eyeballs www.bing.com 10 3 10 2 10 1 ALEXA 1M with AAAA entries 10 0 50.0% W6D W6LD www.detik.com 40.0% HTTP Failure 10 3 30.0% 20.0% 10.0% 10 2 0.0% www.engadget.com TCP Connect Times (ms) 10 3 2010 2011 2012 2013 2014 2015 2016 2017 10 2 10 1 10 0 ▶ Failures reduced from 40% (2009) to 3% today. www.nifty.com 10 3 10 2 Failing AAAA Websites www.qq.com 1.0 10 4 [Mar '17] 10 3 0.8 10 2 0.6 CDF 10 1 0.4 10 0 4.3K 0.2 www.sakura.ne.jp 10 3 0.0 0.1K 1K 10K 100K 1000K ALEXA Rank 10 2 Jul Jul Jul Jan Jan Jan Jan 2013 2014 2015 2016 ▶ 88% failing websites rank > 100K. IPv6 IPv4 ▶ 1% rank < 10K, six websites rank < 300.

Motivation Acknowledgements Contribution Complete Failures | WL6D websites Q/A 6 / 16 Happy Eyeballs Complete Failures Partial Failures Latency ▶ ∼ 3K websites participated on the W6LD (2012). ▶ Promise to permanently enable production-ready IPv6 on the Internet. Failing W6LD Websites W6LD websites − 1.0 0.8 ▶ 8% (259) do not have A or AAAA entries in DNS. 0.6 CDF 0.4 253 0.2 0.0 W6LD websites (with A and AAAA entries) − 1K 10K 100K 1M 10M 100M ALEXA Rank ▶ 1% (36) TCP timeout over both AF. ▶ 3% failing websites rank < 10K. ▶ 8% (253) TCP timeout over IPv6. ▶ 75% rank > 100K, 61% rank > 1M.

Motivation overestimation of IPv6 adoption numbers Contribution IPv4 W6LD Success Rate (%) Webpage # tools that identify such partial failures failures can be deemed IPv6-ready 7 / 16 Partial Failures Complete Failures Latency Happy Eyeballs Acknowledgements Q/A Partial Failures IPv6 ( ↓ ) ALEXA top 100 websites with AAAA entries. 01 www.bing.com 0 100 ✓ 02 www.detik.com 0 100 ✓ ▶ 27% show some rate of failure over IPv6. 03 www.engadget.com 0 100 ✓ 04 www.nifty.com 0 100 ▶ 9% exhibit more than 50% failures over IPv6. 05 www.qq.com 0 100 06 www.sakura.ne.jp 0 100 07 www.flipkart.com 09 99 ✓ 08 www.folha.uol.com.br 13 100 1.0 09 www.aol.com 48 100 IPv6 (100) ✓ 0.8 0.6 IPv4 (100) CDF 0.4 10 www.comcast.net 52 100 ✓ 0.2 11 www.yahoo.com 72 100 ✓ 0.0 12 www.mozilla.org 84 100 ✓ 13 www.orange.fr 86 100 ✓ 0 20 40 60 80 100 14 www.seznam.cz 89 100 ✓ Success Rate (%) 15 www.mobile.de 90 100 ✓ 16 www.wikimedia.org 90 100 ▶ Limiting to root webpage can lead to 17 www.t-online.de 93 100 ✓ 18 www.free.fr 95 100 19 www.usps.com 95 100 ▶ Unclear whether websites with partial 20 www.vk.com 95 100 ✓ 21 www.wikipedia.org 95 100 ✓ 22 www.wiktionary.org 95 100 ▶ ISOC now supporting [2] development of 23 www.elmundo.es 96 100 ✓ 24 www.uol.com.br 96 100 ✓ 25 www.marca.com 97 100 ✓ 26 www.terra.com.br 98 100 ✓ 27 www.youm7.com 99 100

Motivation Q/A error on DNS resolution Contribution Partial Failures | Root Cause Analysis 8 / 16 Acknowledgements Latency Complete Failures Partial Failures Happy Eyeballs Website failing over IPv6 Network Level Content Level Service Level www.bing.com (100%) CURLE_OK www.detik.com (100%) CURLE_COULDNT_RESOLVE_HOST www.engadget.com (100%) CURLE_COULDNT_CONNECT www.nifty.com (100%) CURLE_OPERATION_TIMEDOUT www.qq.com (100%) CURLE_GOT_NOTHING www.sakura.ne.jp (100%) CURLE_RECV_ERROR www.flipkart.com (91%) www.folha.uol.com.br (87%) ▶ Failures due to www.aol.com (52%) */css www.comcast.net (48%) */html www.yahoo.com (28%) */javascript, */json www.mozilla.org (16%) */octet-stream www.orange.fr (14%) */plain www.seznam.cz (11%) image/*, */rdf www.mobile.de (10%) */xml www.wikimedia.org (10%) */javascript, image/* www.t-online.de (7%) */json and www.free.fr (5%) www.usps.com (5%) SAME ORIGIN */css content. www.vk.com (5%) CROSS ORIGIN www.wikipedia.org (5%) www.wiktionary.org (5%) www.elmundo.es (4%) www.uol.com.br (4%) www.marca.com (3%) www.terra.com.br (2%) www.youm7.com (1%) 0 30 60 90 0 30 60 90 0 30 60 90 Contribution (%) ▶ Failures silently exist; clients do not notice them due to IPv4 fallback. ▶ Identifjcation of operational issues relevant for upcoming IPv6-only networks

Motivation Partial Failures | Root Cause Analysis Contribution Webpage # default for all same-origin webpage elements. that belong to the same origin source and fail over IPv6. 9 / 16 Q/A Partial Failures Acknowledgements Happy Eyeballs Latency Complete Failures SAME ORIGIN Same Origin ( ↓ ) www.bing.com (100%) *.bing.com www.detik.com (100%) *.detik.com 01 www.bing.com 100% www.engadget.com (100%) *.engadget.com 02 www.detik.com 100% www.nifty.com (100%) *.nifty.com www.qq.com (100%) *.qq.com 03 www.engadget.com 100% www.sakura.ne.jp (100%) *.sakura.ne.jp 04 www.nifty.com 100% www.flipkart.com (91%) *.flipkart.com www.folha.uol.com.br (87%) *.uol.com.br 05 www.usps.com 100% www.aol.com (52%) *.aol.com 06 www.qq.com 100% www.comcast.net (48%) *.comcast.net www.yahoo.com (28%) *.yahoo.com 07 www.sakura.ne.jp 100% www.mozilla.org (16%) *.mozilla.org 08 www.comcast.net 85% www.orange.fr (14%) *.orange.fr www.seznam.cz (11%) *.seznam.cz 09 www.yahoo.com 83% www.mobile.de (10%) *.mobile.de 10 www.terra.com.br 74% www.wikimedia.org (10%) *.wikimedia.org www.t-online.de (7%) *.t-online.de 11 www.marca.com 70% www.free.fr (5%) *.free.fr 12 www.wikimedia.org 65% www.usps.com (5%) *.usps.com www.vk.com (5%) *.vk.com www.wikipedia.org (5%) *.wikipedia.org www.wiktionary.org (5%) *.wiktionary.org 13 www.elmundo.es 37% www.elmundo.es (4%) *.elmundo.es 14 www.vk.com 31% www.uol.com.br (4%) *.uol.com.br www.marca.com (3%) *.marca.com 15 www.t-online.de 30% www.terra.com.br (2%) *.terra.com.br 16 www.youm7.com 24% www.youm7.com (1%) *.youm7.com 17 www.wiktionary.org 22% 0 30 60 90 Contribution (%) 18 www.wikipedia.org 22% 19 www.free.fr 13% 20 www.folha.uol.com.br 12% ▶ 12% of websites have more than 50% webpage elements 21 www.mozilla.org 7% 22 www.uol.com.br 7% 23 www.mobile.de 7% 24 www.aol.com 5% ▶ CDN infrastructure does not have IPv6 turned on by 25 www.orange.fr 5% 26 www.seznam.cz 4% 27 www.flipkart.com 1%