The Lockdown Effect: Implications of the COVID-19 Pandemic on Internet Traffic
Narseo Vallina-Rodriguez (IMDEA Networks) and Juan Tapiador (UC3M)
Jornadas REDIMadrid 2020 Š 20 Oct 2020
The Lockdown Effect: Implications of the COVID-19 Pandemic on - - PowerPoint PPT Presentation
The Lockdown Effect: Implications of the COVID-19 Pandemic on Internet Traffic Narseo Vallina-Rodriguez (IMDEA Networks) and Juan Tapiador (UC3M) Jornadas REDIMadrid 2020 20 Oct 2020 Lots of data, lots of data crunchers Anja Feldmann Oliver
Narseo Vallina-Rodriguez (IMDEA Networks) and Juan Tapiador (UC3M)
Jornadas REDIMadrid 2020 Š 20 Oct 2020
Lots of data, lots of data crunchers
Anja Feldmann MPII Daniel Wagner DE-CIX Oliver Gasser MPII Matthias Wichtlhuber DE-CIX Franziska Lichtblau MPII Juan Tapiador Universidad Carlos III de Madrid Enric Pujol BENOCS Narseo Vallina Rodriguez IMDEA Networks, ICSI Ingmar Poese BENOCS Oliver Hohlfeld Brandenburg University
Christoph Dietzel DE-CIX Georgios Smaragdakis TU Berlin, MPII
1
COVID-19 and the Internet
2
COVID-19 and the Internet
2
COVID-19 and the Internet
2
COVID-19 and the Internet
2
COVID-19 and the Internet
The Internet is essential in all these efforts, but how well does it cope?
2
Goals of this presentation
networks
3
Goals of this presentation
networks
3
Goals of this presentation
networks
3
4
4
Interconnecting networks
4
IXPs: Central Europe, Southern Europe, US East Coast
Data has been analyzed strictly on premise and results are aggregated.
5
Interconnecting networks
6
Residential customers working from home Interconnecting networks
6
Large European ISP
(BNGs)
Data has been analyzed strictly on premise and results are aggregated.
7
Residential customers working from home
Interconnecting networks
8
Service network interconnecting universities and research institutions Residential customers working from home
Interconnecting networks
8
REDIMadrid university network
centers (Madrid region)
The network operators provided anonymized flow data.
9
Analyzing the pandemic across time
Our analysis is based on four weeks representing the course of the pandemic from February 2020 to June 2020.
10
Analyzing the pandemic across time
base: February before the lockdown Our analysis is based on four weeks representing the course of the pandemic from February 2020 to June 2020.
10
Analyzing the pandemic across time
base: February before the lockdown March: During the lockdown Our analysis is based on four weeks representing the course of the pandemic from February 2020 to June 2020.
10
Analyzing the pandemic across time
base: February before the lockdown March: During the lockdown April: First relaxation of restrictions Our analysis is based on four weeks representing the course of the pandemic from February 2020 to June 2020.
10
Analyzing the pandemic across time
base: February before the lockdown March: During the lockdown April: First relaxation of restrictions June: Minimum restiction level Our analysis is based on four weeks representing the course of the pandemic from February 2020 to June 2020.
10
Analyzing the pandemic across time
base: February before the lockdown March: During the lockdown April: First relaxation of restrictions June: Minimum restiction level ISP-CE IXP-CE IXP-SE IXP-US EDU base Feb 20–26 Feb 20–26 Feb 20–26 Feb 20–26 Feb 20–26 March Mar 19–25 Mar 19–25 Mar 12–18 Mar 19–25 Mar 12–18 April Apr 09–15 Apr 23–29 Apr 23–29 Apr 23–29 Apr 23–29 June Jun 18–24 Jun 18–24 Jun 18–24 Jun 18–24 n/a Our analysis is based on four weeks representing the course of the pandemic from February 2020 to June 2020.
10
Traffic changes January 2019 to June 2020
2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50 52 54 56 58 60 62 64 66 68 70 72 74 76 78 80 Calendar week 0.6 0.8 1.0 1.2 1.4 1.6 Normalized traffic volume COVID-19 outbreak in Europe Initial responses and lockdowns
ISP, Europe (>15M fixed-network lines)
11
Traffic changes January 2019 to June 2020
2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50 52 54 56 58 60 62 64 66 68 70 72 74 76 78 80 Calendar week 0.6 0.8 1.0 1.2 1.4 1.6 Normalized traffic volume COVID-19 outbreak in Europe Initial responses and lockdowns
ISP, Europe (>15M fixed-network lines)
Once the lockdown started the ISP saw an increase in traffic which normally spans over multiple months.
11
Traffic changes January 2019 to June 2020
2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50 52 54 56 58 60 62 64 66 68 70 72 74 76 78 80 Calendar week 0.6 0.8 1.0 1.2 1.4 1.6 Normalized traffic volume COVID-19 outbreak in Europe Initial responses and lockdowns
ISP, Europe (>15M fixed-network lines) IXP, Central Europe (>900 members) IXP, South Europe (>170 members) IXP, US East Coast (>250 members)
11
Traffic changes January 2019 to June 2020
2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50 52 54 56 58 60 62 64 66 68 70 72 74 76 78 80 Calendar week 0.6 0.8 1.0 1.2 1.4 1.6 Normalized traffic volume COVID-19 outbreak in Europe Initial responses and lockdowns
ISP, Europe (>15M fixed-network lines) IXP, Central Europe (>900 members) IXP, South Europe (>170 members) IXP, US East Coast (>250 members)
Similar behaviour for the IXPs; for the IXP CE and IXP US the traffic levels keep elevated.
11
Traffic changes January 2019 to June 2020
2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50 52 54 56 58 60 62 64 66 68 70 72 74 76 78 80 Calendar week 0.6 0.8 1.0 1.2 1.4 1.6 Normalized traffic volume COVID-19 outbreak in Europe Initial responses and lockdowns
ISP, Europe (>15M fixed-network lines) IXP, Central Europe (>900 members) IXP, South Europe (>170 members) IXP, US East Coast (>250 members) Mobile operator, Europe (>40M customers)
11
Traffic changes January 2019 to June 2020
2 4 6 8 10 12 14 16 18 20 22 24 26 28 30 32 34 36 38 40 42 44 46 48 50 52 54 56 58 60 62 64 66 68 70 72 74 76 78 80 Calendar week 0.6 0.8 1.0 1.2 1.4 1.6 Normalized traffic volume COVID-19 outbreak in Europe Initial responses and lockdowns
ISP, Europe (>15M fixed-network lines) IXP, Central Europe (>900 members) IXP, South Europe (>170 members) IXP, US East Coast (>250 members) Mobile operator, Europe (>40M customers)
Once the lockdown started mobile traffic decreased measurably and increases with the first relaxations in mid April.
11
Traffic volumes before and after the lockdown
Day of Week Normalized Traffic Volume 2 4 6 8 10 Thu Fri Sat Sun Mon Tue Wed Base: 2020−02−20 2020−02−26
12
Traffic volumes before and after the lockdown
Day of Week Normalized Traffic Volume 2 4 6 8 10 Thu Fri Sat Sun Mon Tue Wed Base: 2020−02−20 2020−02−26 March: 2020−03−19 2020−03−25
12
Traffic volumes before and after the lockdown
Day of Week Normalized Traffic Volume 2 4 6 8 10 Thu Fri Sat Sun Mon Tue Wed Base: 2020−02−20 2020−02−26 March: 2020−03−19 2020−03−25 30% peak increase
12
Traffic volumes before and after the lockdown
Day of Week Normalized Traffic Volume 2 4 6 8 10 Thu Fri Sat Sun Mon Tue Wed Base: 2020−02−20 2020−02−26 March: 2020−03−19 2020−03−25 April: 2020−04−09 2020−04−15
12
Traffic volumes before and after the lockdown
Day of Week Normalized Traffic Volume 2 4 6 8 10 Thu Fri Sat Sun Mon Tue Wed Base: 2020−02−20 2020−02−26 March: 2020−03−19 2020−03−25 April: 2020−04−09 2020−04−15 June: 2020−06−18 2020−06−24
12
Lockdown: Change in workday vs. weekend pattern (ISP)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 Hour of the day 0.0 0.2 0.4 0.6 0.8 1.0 Normalized traffic volume Wednesday Feb 19 13
Lockdown: Change in workday vs. weekend pattern (ISP)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 Hour of the day 0.0 0.2 0.4 0.6 0.8 1.0 Normalized traffic volume Wednesday Feb 19 Saturday Feb 22 13
Lockdown: Change in workday vs. weekend pattern (ISP)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 Hour of the day 0.0 0.2 0.4 0.6 0.8 1.0 Normalized traffic volume Wednesday Feb 19 Saturday Feb 22
13
Lockdown: Change in workday vs. weekend pattern (ISP)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 Hour of the day 0.0 0.2 0.4 0.6 0.8 1.0 Normalized traffic volume Wednesday Feb 19 Saturday Feb 22
13
Lockdown: Change in workday vs. weekend pattern (ISP)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 Hour of the day 0.0 0.2 0.4 0.6 0.8 1.0 Normalized traffic volume Wednesday Feb 19 Saturday Feb 22 Wednesday Mar 25 (lockdown)
13
Lockdown: Change in workday vs. weekend pattern (ISP)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 Hour of the day 0.0 0.2 0.4 0.6 0.8 1.0 Normalized traffic volume Wednesday Feb 19 Saturday Feb 22 Wednesday Mar 25 (lockdown)
13
Changes in workday vs. weekday patterns at the ISP
14
Changes in workday vs. weekday patterns at the ISP
14
Changes in workday vs. weekday patterns at the ISP
14
Changes in workday vs. weekday patterns at the ISP
recovering after mid-May
14
Changes in workday vs. weekday patterns: ISP vs. IXP
ISP
Jan 1 Feb 1 Mar 1 Apr 1 May 1 Jun 1 Date 0.00 0.25 0.05 0.75 1.00
Sat-Sun Mon-Fri 0.00 0.25 0.05 0.75 1.00
with weekend-like pattern
}
with workday-like pattern
}
Mon-Fri Sat-Sun
IXP
Jan 1 Feb 1 Mar 1 Apr 1 May 1 Jun 1 Date 0.00 0.25 0.05 0.75 1.00
Sat-Sun Mon-Fri 0.00 0.25 0.05 0.75 1.00
with weekend-like pattern
}
with workday-like pattern
}
Mon-Fri Sat-Sun
15
Changes in workday vs. weekday patterns: ISP vs. IXP
ISP
Jan 1 Feb 1 Mar 1 Apr 1 May 1 Jun 1 Date 0.00 0.25 0.05 0.75 1.00
Sat-Sun Mon-Fri 0.00 0.25 0.05 0.75 1.00
with weekend-like pattern
}
with workday-like pattern
}
Mon-Fri Sat-Sun
IXP
Jan 1 Feb 1 Mar 1 Apr 1 May 1 Jun 1 Date 0.00 0.25 0.05 0.75 1.00
Sat-Sun Mon-Fri 0.00 0.25 0.05 0.75 1.00
with weekend-like pattern
}
with workday-like pattern
}
Mon-Fri Sat-Sun
15
Classify traffic by application class
16
Classify traffic by application class
16
Classify traffic by application class
16
Classify traffic by application class
Thu Fri Sat Sun Mon Tue Wed
C D N E d u c a t i
a l S
i a l m e d i a G a m i n g V
E m a i l C
l . w
k i n g W e b c
f
Base week ISP
T h u F r i S a t S u n M
T u e W e d
CDN Educational Social media Gaming VoD Email
Web conf
Base week IXP
16
Classify traffic by application class
Thu Fri Sat Sun Mon Tue Wed
C D N E d u c a t i
a l S
i a l m e d i a G a m i n g V
E m a i l C
l . w
k i n g W e b c
f
Base week ISP
T h u F r i S a t S u n M
T u e W e d
CDN Educational Social media Gaming VoD Email
Web conf
Base week IXP
16
Classify traffic by application class
Thu Fri Sat Sun Mon Tue Wed
C D N E d u c a t i
a l S
i a l m e d i a G a m i n g V
E m a i l C
l . w
k i n g W e b c
f
Base week ISP
T h u F r i S a t S u n M
T u e W e d
CDN Educational Social media Gaming VoD Email
Web conf
Base week IXP
16
Classify traffic by application class
Thu Fri Sat Sun Mon Tue Wed
C D N E d u c a t i
a l S
i a l m e d i a G a m i n g V
E m a i l C
l . w
k i n g W e b c
f
Base week ISP
T h u F r i S a t S u n M
T u e W e d
CDN Educational Social media Gaming VoD Email
Web conf
Base week IXP
16
Changes in application classes: Central European ISP
Thu Fri Sat Sun Mon Tue Wed
CDN Educational Social media Gaming VoD Email
Web conf
Central European ISP −− Downstream Diff1: March − Base
−100 −90 −80 −70 −60 −50 −40 −30 −20 −10 10 20 30 40 50 60 70 80 90 100 110 120 130 140 150 160 170 180 190 200
17
Changes in application classes: Central European ISP
Thu Fri Sat Sun Mon Tue Wed
CDN Educational Social media Gaming VoD Email
Web conf
Central European ISP −− Downstream Diff1: March − Base
−100 −90 −80 −70 −60 −50 −40 −30 −20 −10 10 20 30 40 50 60 70 80 90 100 110 120 130 140 150 160 170 180 190 200
March:
conf., coll. working, educational traffic
VoD and gaming
17
Changes in application classes: Central European ISP
Thu Fri Sat Sun Mon Tue Wed Thu Fri Sat Sun Mon Tue Wed
CDN Educational Social media Gaming VoD Email
Web conf
Central European ISP −− Downstream Diff1: March − Base Diff2: April − Base
−100 −90 −80 −70 −60 −50 −40 −30 −20 −10 10 20 30 40 50 60 70 80 90 100 110 120 130 140 150 160 170 180 190 200
March:
conf., coll. working, educational traffic
VoD and gaming
17
Changes in application classes: Central European ISP
Thu Fri Sat Sun Mon Tue Wed Thu Fri Sat Sun Mon Tue Wed
CDN Educational Social media Gaming VoD Email
Web conf
Central European ISP −− Downstream Diff1: March − Base Diff2: April − Base
−100 −90 −80 −70 −60 −50 −40 −30 −20 −10 10 20 30 40 50 60 70 80 90 100 110 120 130 140 150 160 170 180 190 200
March:
conf., coll. working, educational traffic
VoD and gaming April:
pronounced
media
17
Changes in application classes: Central European ISP
Thu Fri Sat Sun Mon Tue Wed Thu Fri Sat Sun Mon Tue Wed Thu Fri Sat Sun Mon Tue Wed
CDN Educational Social media Gaming VoD Email
Web conf
Central European ISP −− Downstream Diff1: March − Base Diff2: April − Base Diff3: June − Base
−100 −90 −80 −70 −60 −50 −40 −30 −20 −10 10 20 30 40 50 60 70 80 90 100 110 120 130 140 150 160 170 180 190 200
March:
conf., coll. working, educational traffic
VoD and gaming April:
pronounced
media
17
Changes in application classes: Central European ISP
Thu Fri Sat Sun Mon Tue Wed Thu Fri Sat Sun Mon Tue Wed Thu Fri Sat Sun Mon Tue Wed
CDN Educational Social media Gaming VoD Email
Web conf
Central European ISP −− Downstream Diff1: March − Base Diff2: April − Base Diff3: June − Base
−100 −90 −80 −70 −60 −50 −40 −30 −20 −10 10 20 30 40 50 60 70 80 90 100 110 120 130 140 150 160 170 180 190 200
March:
conf., coll. working, educational traffic
VoD and gaming April:
pronounced
media June:
but more focused on working hours
working
and social media
17
Changes in application classes: Central European IXP
18
Changes in application classes: Central European IXP
March:
and gaming
educational traffic
18
Changes in application classes: Central European IXP
March:
and gaming
educational traffic
18
Changes in application classes: Central European IXP
March:
and gaming
educational traffic April & June:
media traffic
18
Changes in application classes: Central European IXP
March:
and gaming
educational traffic April & June:
media traffic
18
Changes in application classes: Central European IXP
March:
and gaming
educational traffic April & June:
media traffic
18
Case Study: Gaming traffic at a Southern European IXP
02-16 02-23 03-01 03-08 03-15 03-22 03-29 04-05 04-12 04-19 04-26 week 0.0 1.0 2.0 3.0 4.0 5.0 normalized unique IPs IXP SE
local lockdown COVID-19
traffic per hour daily minimum daily maximum daily average
19
Case Study: Gaming traffic at a Southern European IXP
02-16 02-23 03-01 03-08 03-15 03-22 03-29 04-05 04-12 04-19 04-26 week 0.0 1.0 2.0 3.0 4.0 5.0 normalized unique IPs IXP SE
local lockdown COVID-19
traffic per hour daily minimum daily maximum daily average
volume
19
VPN traffic: Central European IXP
VPN identification
VPN services
20
VPN traffic: Central European IXP
VPN identification
VPN services
20
VPN traffic: Central European IXP
VPN identification
VPN services
hours
20
VPN traffic: Central European IXP
VPN identification
VPN services
hours
20
VPN traffic: Central European IXP
VPN identification
VPN services
hours
20
Ingress-egress traffic ratio: REDIMadrid
Ingress vs. egress traffic ratio 5 10 15 20 Thu Fri Sat Sun Mon Tue Wed
transition 2020−03−12 2020−03−18
21
Ingress-egress traffic ratio: REDIMadrid
Ingress vs. egress traffic ratio 5 10 15 20 Thu Fri Sat Sun Mon Tue Wed
transition 2020−03−12 2020−03−18
21
Ingress-egress traffic ratio: REDIMadrid
Ingress vs. egress traffic ratio 5 10 15 20 Thu Fri Sat Sun Mon Tue Wed
transition 2020−03−12 2020−03−18
21
Protocol changes: REDIMadrid
Transition phase Easter
0.10 0.25 0.50 1.00 2.00 5.00 10.00 2 7 / 2 / 2 2 4 / 3 / 2 2 1 1 / 3 / 2 2 1 8 / 3 / 2 2 2 5 / 3 / 2 2 1 / 4 / 2 2 8 / 4 / 2 2 1 5 / 4 / 2 2
Date Relative daily growth (Log) Traffic class
Eyeball ISPs (VPN, In) Eyeball ISPs (Web, In) Hypergiants (Web, Out) Push notifications (Out) QUIC (Out)
22
Protocol changes: REDIMadrid
Transition phase Easter
0.10 0.25 0.50 1.00 2.00 5.00 10.00 2 7 / 2 / 2 2 4 / 3 / 2 2 1 1 / 3 / 2 2 1 8 / 3 / 2 2 2 5 / 3 / 2 2 1 / 4 / 2 2 8 / 4 / 2 2 1 5 / 4 / 2 2
Date Relative daily growth (Log) Traffic class
Eyeball ISPs (VPN, In) Eyeball ISPs (Web, In) Hypergiants (Web, Out) Push notifications (Out) QUIC (Out)
remote desktop (5.9x), and SSH (9.1x) traffic.
22
Protocol changes: REDIMadrid
Transition phase Easter
0.10 0.25 0.50 1.00 2.00 5.00 10.00 2 7 / 2 / 2 2 4 / 3 / 2 2 1 1 / 3 / 2 2 1 8 / 3 / 2 2 2 5 / 3 / 2 2 1 / 4 / 2 2 8 / 4 / 2 2 1 5 / 4 / 2 2
Date Relative daily growth (Log) Traffic class
Eyeball ISPs (VPN, In) Eyeball ISPs (Web, In) Hypergiants (Web, Out) Push notifications (Out) QUIC (Out)
remote desktop (5.9x), and SSH (9.1x) traffic.
(65% of push notifications’ traffic)
22
People change → traffic changes
23
People change → traffic changes
23
People change → traffic changes
conferencing see significant increase in traffic
23
People change → traffic changes
conferencing see significant increase in traffic
applications
23
People change → traffic changes
conferencing see significant increase in traffic
applications
sole focus on hypergiants is not sufficient
23
People change → traffic changes
conferencing see significant increase in traffic
applications
sole focus on hypergiants is not sufficient Our vantage points reveal that the impact of the COVID-19 panedmic is directly reflected in changes to Internet traffic patterns.
23
Traffic changes → networks change
24
Traffic changes → networks change
24
Traffic changes → networks change
1,500 Gbps
24
Traffic changes → networks change
1,500 Gbps
24
Traffic changes → networks change
1,500 Gbps
Well-provisioned networks can accomodate sudden changes in demand if they’re planned with spare capacity and quick reaction times.
24
Traffic changes → networks change
1,500 Gbps
Well-provisioned networks can accomodate sudden changes in demand if they’re planned with spare capacity and quick reaction times.
Contact emails: narseo.vallina@imdea.org jestevez@inf.uc3m.es Paper link: arXiv:2008.10959
24