A Machine Learning Based Approach to Mobile Network Analysis Zengwen - - PowerPoint PPT Presentation

a machine learning based approach to mobile network
SMART_READER_LITE
LIVE PREVIEW

A Machine Learning Based Approach to Mobile Network Analysis Zengwen - - PowerPoint PPT Presentation

A Machine Learning Based Approach to Mobile Network Analysis Zengwen Yuan 1 , Yuanjie Li 1 , Chunyi Peng 2 , Songwu Lu 1 , Haotian Deng 2 , Zhaowei Tan 1 , Taqi Raza 1 1 2 Overview 2 Overview 2 Background Overview 2 Background


slide-1
SLIDE 1

A Machine Learning Based Approach to Mobile Network Analysis

Zengwen Yuan1, Yuanjie Li1, Chunyi Peng2, Songwu Lu1, Haotian Deng2, Zhaowei Tan1, Taqi Raza1

1 2

slide-2
SLIDE 2

Overview

2

slide-3
SLIDE 3

Background

Overview

2

slide-4
SLIDE 4

Background Why machine learning for mobile network analysis

Overview

2

slide-5
SLIDE 5

Background Why machine learning for mobile network analysis Mobile network analysis: state-of-the-a; and our approach

Overview

2

slide-6
SLIDE 6

Background Why machine learning for mobile network analysis Mobile network analysis: state-of-the-a; and our approach Case study: analyzing latency for mobile networks

  • How mobile apps work over LTE
  • How to breakdown app-perceived latency
  • Challenges and ML scheme
  • Primary results from crowdsourcing

Overview

2

slide-7
SLIDE 7

Background Why machine learning for mobile network analysis Mobile network analysis: state-of-the-a; and our approach Case study: analyzing latency for mobile networks

  • How mobile apps work over LTE
  • How to breakdown app-perceived latency
  • Challenges and ML scheme
  • Primary results from crowdsourcing

Conclusion

Overview

2

slide-8
SLIDE 8

Ubiquitous cellular networks connect everyone, everything

3

slide-9
SLIDE 9

The race to 5G opens many new oppoCunities

4

slide-10
SLIDE 10

Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack Web server

Internet

??

Cellular network (4G LTE)

User space

Yet, access to mobile network analytics is barred

5

What’s going on in the 3G/4G/5G network??

Oh we cannot tell you unless you sign an NDA… Researcher (you) No privilege no talk, sorry! Chipset/Mobile OS Operators

slide-11
SLIDE 11

Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack Web server

Internet

??

Cellular network (4G LTE)

User space

Yet, access to mobile network analytics is barred

5

What’s going on in the 3G/4G/5G network??

Oh we cannot tell you unless you sign an NDA… Researcher (you) No privilege no talk, sorry! Chipset/Mobile OS Operators

3G/4G operations remain closed both in device chipsets and network infrastructures :(

slide-12
SLIDE 12

Plus, mobile networks are complex & distributed

More complex functions on both control and data planes Operations are distributed across layers

6

Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack

User space

TCP/IP Protocol Stack Application Protocols Radio Resource Control (RRC) Mobility Management (EMM) Session Management (ESM) Packet Convergence (PDCP) Radio Link Control (RLC) Medium Access Control (MAC) Physical Layer Protocols (PHY) Control Plane Data Plane Signaling

slide-13
SLIDE 13

Moreover, analytics tasks are app speciNc

7

slide-14
SLIDE 14

Analytics for mobile networks is problem-speciCc, for example:

Moreover, analytics tasks are app speciNc

7

slide-15
SLIDE 15

Analytics for mobile networks is problem-speciCc, for example:

  • Web browsers:

✦ Why the time-to-first-byte (TTFB) is so long? ✦ What’s the major component of latency? ✦ …

Moreover, analytics tasks are app speciNc

7

slide-16
SLIDE 16

Analytics for mobile networks is problem-speciCc, for example:

  • Web browsers:

✦ Why the time-to-first-byte (TTFB) is so long? ✦ What’s the major component of latency? ✦ …

  • Instant message apps:

✦ Does the recipient read my message? ✦ Is my message delivered in time? ✦ …

Moreover, analytics tasks are app speciNc

7

slide-17
SLIDE 17

State-of-the-aC mobile network analytics

8

slide-18
SLIDE 18

Current 4G network analytics is primarily “infrastructure-based”:

State-of-the-aC mobile network analytics

8

slide-19
SLIDE 19

Current 4G network analytics is primarily “infrastructure-based”:

State-of-the-aC mobile network analytics

8

Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack Web server

Internet

Cellular network (4G LTE)

Base stations Gateway Gateway User profile server Mobility controller

User space

slide-20
SLIDE 20

Current 4G network analytics is primarily “infrastructure-based”:

State-of-the-aC mobile network analytics

8

Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack Web server

Internet

Cellular network (4G LTE)

Base stations Gateway Gateway User profile server Mobility controller

User space

slide-21
SLIDE 21

Current 4G network analytics is primarily “infrastructure-based”:

State-of-the-aC mobile network analytics

8

Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack Web server

Internet

Cellular network (4G LTE)

Base stations Gateway Gateway User profile server Mobility controller

User space

Not Scalable

slide-22
SLIDE 22

Current 4G network analytics is primarily “infrastructure-based”:

State-of-the-aC mobile network analytics

8

Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack Web server

Internet

Cellular network (4G LTE)

Base stations Gateway Gateway User profile server Mobility controller

User space

Not Scalable Incomplete View

slide-23
SLIDE 23

Current 4G network analytics is primarily “infrastructure-based”:

State-of-the-aC mobile network analytics

8

Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack Web server

Internet

Cellular network (4G LTE)

Base stations Gateway Gateway User profile server Mobility controller

User space

Not Scalable Incomplete View Opaqueness

slide-24
SLIDE 24

ML-based approach is a must-have feature for mobile network analytics

9

Not Scalable Incomplete View Opaqueness

Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack

User space

Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space
slide-25
SLIDE 25

Device-centric ML approach brings new hope

ML-based approach is a must-have feature for mobile network analytics

9

Not Scalable Incomplete View Opaqueness

Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack

User space

Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space
slide-26
SLIDE 26

Device-centric ML approach brings new hope

ML-based approach is a must-have feature for mobile network analytics

9

Not Scalable Incomplete View Opaqueness Scalability

Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack

User space

Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space
slide-27
SLIDE 27

Device-centric ML approach brings new hope

ML-based approach is a must-have feature for mobile network analytics

9

Not Scalable Incomplete View Opaqueness Scalability Device QoE View

Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack

User space

Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space
slide-28
SLIDE 28

Device-centric ML approach brings new hope

ML-based approach is a must-have feature for mobile network analytics

9

Not Scalable Incomplete View Opaqueness Scalability Device QoE View Availability

Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack

User space

Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space
slide-29
SLIDE 29

It is probably true that machine learning is a must-have approach, rather than a nice-to-have one, to our Celd for mobile network analysis

slide-30
SLIDE 30

Our proposal: two-level device-centric ML approach

11

Mobile Apps Baseband Mobile OS TCP/IP stack

LTE interface

Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space
slide-31
SLIDE 31

Local level: sensing mobile network data inside each sma;phone

  • Via hardware-software coordination (e.g. MobileInsight [ACM MobiCom’16])
  • Via higher-layer (application/transport/IP) and lower-layer (cellular-specific) integration
  • Via ML-assisted data plane prediction from control plane protocol reconstruction

Our proposal: two-level device-centric ML approach

11

Mobile Apps Baseband Mobile OS TCP/IP stack

LTE interface

Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space
slide-32
SLIDE 32

Local level: sensing mobile network data inside each sma;phone

  • Via hardware-software coordination (e.g. MobileInsight [ACM MobiCom’16])
  • Via higher-layer (application/transport/IP) and lower-layer (cellular-specific) integration
  • Via ML-assisted data plane prediction from control plane protocol reconstruction

Global level:

  • Crowdsourcing-based dataset
  • Cloud-synthesized insights

Our proposal: two-level device-centric ML approach

11

Mobile Apps Baseband Mobile OS TCP/IP stack

LTE interface

Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space
slide-33
SLIDE 33

Local analysis

12 Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack

User space

slide-34
SLIDE 34

Step 1: open up the “black-box” operations

  • At/above IP network data: TCPDUMP
  • Below IP network data: MobileInsight

Local analysis

12 Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack

User space

slide-35
SLIDE 35

Step 1: open up the “black-box” operations

  • At/above IP network data: TCPDUMP
  • Below IP network data: MobileInsight

Local analysis

12 Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack

User space

slide-36
SLIDE 36

Step 1: open up the “black-box” operations

  • At/above IP network data: TCPDUMP
  • Below IP network data: MobileInsight

Step 2: automated data preprocessing

  • Data cleansing and integration of two sources

Local analysis

12 Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack

User space

slide-37
SLIDE 37

Step 1: open up the “black-box” operations

  • At/above IP network data: TCPDUMP
  • Below IP network data: MobileInsight

Step 2: automated data preprocessing

  • Data cleansing and integration of two sources

Local analysis

12 Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack

User space

Preprocessing

slide-38
SLIDE 38

Step 1: open up the “black-box” operations

  • At/above IP network data: TCPDUMP
  • Below IP network data: MobileInsight

Step 2: automated data preprocessing

  • Data cleansing and integration of two sources

Step 3: local ML-based analysis

  • Control plane for protocol operations
  • Data plane for performance

Local analysis

12 Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack

User space

Preprocessing

slide-39
SLIDE 39

Step 1: open up the “black-box” operations

  • At/above IP network data: TCPDUMP
  • Below IP network data: MobileInsight

Step 2: automated data preprocessing

  • Data cleansing and integration of two sources

Step 3: local ML-based analysis

  • Control plane for protocol operations
  • Data plane for performance

Local analysis

12 Mobile Apps

Baseband Mobile OS

TCP/IP stack

LTE interface

Application Stack

User space

Preprocessing ML analysis

slide-40
SLIDE 40

Global analysis

Enabled by cloud-based crowdsourcing (e.g. cniCloud [HotWireless’17]) Analytical Insights for:

  • Geographical location
  • Operators
  • Phone models

13

SQL Query SQL Response

Fine-grained logging & sharing Efficient Data Management Structured Query

slide-41
SLIDE 41

Case study: latency analysis in mobile networks

slide-42
SLIDE 42

Every millisecond of latency maSers!

Mobile network users want fast access

  • 1 second latency in page response → 7% reduction

in PageView [KissMetrics 2011]

Developers lose revenue due to long latency

  • Every 100 ms costs Amazon 1% ($1.6 bn) in sales
  • An extra 400 ms latency drops daily Google

searches per user by 0.6%

Latency does maZer a lot!

15

slide-43
SLIDE 43

Background: how do mobile apps work over 4G LTE?

What happens under the hood? How LTE impacts perceived latency on mobile web/IM app?

16

Safari WhatsApp

modem chipset mobile OS

TCP/IP stack

LTE interface

Application (HTTP/DNS) Web server

Internet

slide-44
SLIDE 44

Background: how do mobile apps work over 4G LTE?

What happens under the hood? How LTE impacts perceived latency on mobile web/IM app?

16

Safari WhatsApp

modem chipset mobile OS

TCP/IP stack

LTE interface

Application (HTTP/DNS) Web server

Internet

slide-45
SLIDE 45

Background: how do mobile apps work over 4G LTE?

What happens under the hood? How LTE impacts perceived latency on mobile web/IM app?

16

Safari WhatsApp

modem chipset mobile OS

TCP/IP stack

LTE interface

Application (HTTP/DNS) Web server

Internet

?

slide-46
SLIDE 46

Background: how do mobile apps work over 4G LTE?

What happens under the hood? How LTE impacts perceived latency on mobile web/IM app?

16

Safari WhatsApp

modem chipset mobile OS

TCP/IP stack

LTE interface

Application (HTTP/DNS) Web server

Internet

?

slide-47
SLIDE 47

Background: how do mobile apps work over 4G LTE?

What happens under the hood? How LTE impacts perceived latency on mobile web/IM app?

16

Safari WhatsApp

modem chipset mobile OS

TCP/IP stack

LTE interface

Application (HTTP/DNS) Web server

Internet

slide-48
SLIDE 48

Background: how do mobile apps work over 4G LTE?

What happens under the hood? How LTE impacts perceived latency on mobile web/IM app?

16

Safari WhatsApp

modem chipset mobile OS

TCP/IP stack

LTE interface

Application (HTTP/DNS) Web server

Internet

slide-49
SLIDE 49

Cellular network (4G LTE)

Background: how do mobile apps work over 4G LTE?

What happens under the hood? How LTE impacts perceived latency on mobile web/IM app?

16

Safari WhatsApp

modem chipset mobile OS

TCP/IP stack

LTE interface

Application (HTTP/DNS) Web server

Internet

slide-50
SLIDE 50

Cellular network (4G LTE)

Background: how do mobile apps work over 4G LTE?

What happens under the hood? How LTE impacts perceived latency on mobile web/IM app?

16

Safari WhatsApp

modem chipset mobile OS

TCP/IP stack

LTE interface

Application (HTTP/DNS) Web server

Internet

Base stations Gateway Gateway User profile server Mobility controller

slide-51
SLIDE 51

Cellular network (4G LTE)

Background: how do mobile apps work over 4G LTE?

What happens under the hood? How LTE impacts perceived latency on mobile web/IM app?

16

Safari WhatsApp

modem chipset mobile OS

TCP/IP stack

LTE interface

Application (HTTP/DNS) Web server

Internet

(a) (b)

Base stations Gateway Gateway User profile server Mobility controller

slide-52
SLIDE 52

Cellular network (4G LTE)

Background: how do mobile apps work over 4G LTE?

What happens under the hood? How LTE impacts perceived latency on mobile web/IM app?

16

Safari WhatsApp

modem chipset mobile OS

TCP/IP stack

LTE interface

Application (HTTP/DNS) Web server

Internet

(a) (b) (c) (c) (c)

Base stations Gateway Gateway User profile server Mobility controller

slide-53
SLIDE 53

Cellular network (4G LTE)

(d) (d) (d)

Background: how do mobile apps work over 4G LTE?

What happens under the hood? How LTE impacts perceived latency on mobile web/IM app?

16

Safari WhatsApp

modem chipset mobile OS

TCP/IP stack

LTE interface

Application (HTTP/DNS) Web server

Internet

(a) (b) (c) (c) (c)

Base stations Gateway Gateway User profile server Mobility controller

slide-54
SLIDE 54

Cellular network (4G LTE)

(d) (d) (d)

Background: how do mobile apps work over 4G LTE?

What happens under the hood? How LTE impacts perceived latency on mobile web/IM app?

16

Safari WhatsApp

modem chipset mobile OS

TCP/IP stack

LTE interface

Application (HTTP/DNS) Web server

Internet

(a) (b) (c) (c) (c)

Base stations Gateway Gateway User profile server Mobility controller

(f) (e)

slide-55
SLIDE 55

Cellular network (4G LTE)

(d) (d) (d)

Background: how do mobile apps work over 4G LTE?

What happens under the hood? How LTE impacts perceived latency on mobile web/IM app?

16

Safari WhatsApp

modem chipset mobile OS

TCP/IP stack

LTE interface

Application (HTTP/DNS) Web server

Internet

(a) (b) (c) (c) (c)

Base stations Gateway Gateway User profile server Mobility controller

(f) (e)

LTE control-plane operations pose sizable latency on mobile apps

slide-56
SLIDE 56

Timing breakdown of control plane operations

17

slide-57
SLIDE 57

Timing breakdown of control plane operations

17

P1a: RRC connection setup request

slide-58
SLIDE 58

Timing breakdown of control plane operations

17

P1a: RRC connection setup request (Random Access)

slide-59
SLIDE 59

Timing breakdown of control plane operations

17

P1a: RRC connection setup request (Random Access) P1b: RRC connection setup

slide-60
SLIDE 60

Timing breakdown of control plane operations

17

P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete

slide-61
SLIDE 61

Timing breakdown of control plane operations

17

P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete

  • P2. Service request
slide-62
SLIDE 62

Timing breakdown of control plane operations

17

  • P3. Authentication (non-mandatory)

P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete

  • P2. Service request
slide-63
SLIDE 63

Timing breakdown of control plane operations

17

  • P3. Authentication (non-mandatory)
  • P4. Initial Context Setup

P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete

  • P2. Service request
slide-64
SLIDE 64

Timing breakdown of control plane operations

17

  • P5a. Security mode command
  • P3. Authentication (non-mandatory)
  • P4. Initial Context Setup

P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete

  • P2. Service request
slide-65
SLIDE 65

Timing breakdown of control plane operations

17

  • P5a. Security mode command
  • P3. Authentication (non-mandatory)
  • P4. Initial Context Setup

P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete

  • P2. Service request
  • P5b. Security mode complete
slide-66
SLIDE 66

Timing breakdown of control plane operations

17

  • P5a. Security mode command
  • P3. Authentication (non-mandatory)
  • P4. Initial Context Setup

P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete

  • P2. Service request
  • P5b. Security mode complete
  • P6a. RRC connection reconfig
slide-67
SLIDE 67

Timing breakdown of control plane operations

17

  • P5a. Security mode command
  • P3. Authentication (non-mandatory)
  • P4. Initial Context Setup

P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete

  • P2. Service request
  • P5b. Security mode complete
  • P6a. RRC connection reconfig

P6b RRC connection reconfig complete

slide-68
SLIDE 68

Timing breakdown of control plane operations

17

  • P5a. Security mode command
  • P3. Authentication (non-mandatory)
  • P4. Initial Context Setup

P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete

  • P2. Service request
  • P5b. Security mode complete
  • P6a. RRC connection reconfig

P6b RRC connection reconfig complete

Data bearer

Data bearer

slide-69
SLIDE 69

Timing breakdown of control plane operations

17

  • P5a. Security mode command
  • P3. Authentication (non-mandatory)
  • P4. Initial Context Setup

P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete

  • P2. Service request
  • P5b. Security mode complete
  • P6a. RRC connection reconfig

P6b RRC connection reconfig complete

Data bearer

Data bearer

UL data

slide-70
SLIDE 70

Timing breakdown of control plane operations

17

  • P5a. Security mode command
  • P3. Authentication (non-mandatory)
  • P4. Initial Context Setup

P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete

  • P2. Service request
  • P5b. Security mode complete
  • P6a. RRC connection reconfig

P6b RRC connection reconfig complete

Data bearer

Data bearer

UL data

slide-71
SLIDE 71

Timing breakdown of control plane operations

17

  • P5a. Security mode command
  • P3. Authentication (non-mandatory)
  • P4. Initial Context Setup

P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete

  • P2. Service request
  • P5b. Security mode complete
  • P6a. RRC connection reconfig

P6b RRC connection reconfig complete

Data bearer

Data bearer

UL data

slide-72
SLIDE 72

Timing breakdown of control plane operations

17

  • P5a. Security mode command
  • P3. Authentication (non-mandatory)
  • P4. Initial Context Setup

P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete

T

  • P2. Service request
  • P5b. Security mode complete
  • P6a. RRC connection reconfig

P6b RRC connection reconfig complete

Data bearer

Data bearer

UL data

slide-73
SLIDE 73

Timing breakdown of control plane operations

17

  • P5a. Security mode command
  • P3. Authentication (non-mandatory)
  • P4. Initial Context Setup

P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete

T

  • P2. Service request
  • P5b. Security mode complete
  • P6a. RRC connection reconfig

P6b RRC connection reconfig complete

Data bearer

Data bearer

UL data

slide-74
SLIDE 74

Timing breakdown of control plane operations

17

  • P5a. Security mode command
  • P3. Authentication (non-mandatory)
  • P4. Initial Context Setup

P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete

T

  • P2. Service request
  • P5b. Security mode complete
  • P6a. RRC connection reconfig

P6b RRC connection reconfig complete

T

Data bearer

Data bearer

UL data

slide-75
SLIDE 75

Learning latency: latency data sensing

18

Three-tiered timing data collection:

  • App-specific semantic timing (e.g. Navigation Timing API, IM timing model)
  • TCP/IP stack timing (from TCPDUMP)
  • LTE stack timing (from MobileInsight)

DNS query

TCP connection TCP SYN

Data access request

LTE data

SYN ACK HTTP request

LTE control plane LTE data plane

OS

  • verhead

HTTP transmission Page rendering

TCP data

TCP layer

unloadEventStart fetchStart domainLookupStart domainLookupEnd connectStart connectEnd requestStart responseEnd responseStart domInteractive loadEventEnd

slide-76
SLIDE 76

Challenge: timestamp alignment

19

How to align timestamps at these layers?

  • Domain-specific event tracing and mapping
  • Machine-learning assisted

App TCP/IP LTE chipset Base station Web server

  • LTE control

plane msgs

network request

LTE data plane pkts Server’s ACK

Tapp Ttcpdump TLTE

  • App

log tcpdump log MobileInsight log

network response

slide-77
SLIDE 77

Pinpoint latency boSleneck in LTE: An example

20

slide-78
SLIDE 78

Pinpoint latency boSleneck in LTE: An example

Run a small webpage (4 KB) in Chrome on Android

  • User is static, under good 4G LTE signal (-95 dBm), T-Mobile

20

slide-79
SLIDE 79

Pinpoint latency boSleneck in LTE: An example

Run a small webpage (4 KB) in Chrome on Android

  • User is static, under good 4G LTE signal (-95 dBm), T-Mobile

Total Latency: 473 msec

  • Clicking URL → page loading complete, Steps (a)—(f)

20

slide-80
SLIDE 80

Pinpoint latency boSleneck in LTE: An example

Run a small webpage (4 KB) in Chrome on Android

  • User is static, under good 4G LTE signal (-95 dBm), T-Mobile

Total Latency: 473 msec

  • Clicking URL → page loading complete, Steps (a)—(f)

Pinpointing the latency boZleneck

  • How to breakdown?

20

slide-81
SLIDE 81

Control-plane latency breakdown: local analysis I

21

slide-82
SLIDE 82

Control-plane latency breakdown: local analysis I

Major component from Navigation Timing API: DNS lookup, 250 ms out of 473 ms

21

slide-83
SLIDE 83

Control-plane latency breakdown: local analysis I

Major component from Navigation Timing API: DNS lookup, 250 ms out of 473 ms Is the DNS server slow to handle connection?

21

slide-84
SLIDE 84

Control-plane latency breakdown: local analysis I

Major component from Navigation Timing API: DNS lookup, 250 ms out of 473 ms Is the DNS server slow to handle connection? Fu;her breakdown: LTE service request takes 172 ms before the DNS setup

21

slide-85
SLIDE 85

Control-plane latency breakdown: local analysis I

Major component from Navigation Timing API: DNS lookup, 250 ms out of 473 ms Is the DNS server slow to handle connection? Fu;her breakdown: LTE service request takes 172 ms before the DNS setup

21

Queueing Stalled DNS Lookup Initial Connection Request Sent Waiting (TTFB) Content Download

8.98 ms 2.97 ms 250.04 ms 30.11 ms 0.36 ms 137.41 ms 43.48 ms

LTE Data Access Latency LTE service request

slide-86
SLIDE 86

Data-plane latency breakdown: local analysis II

Fu;her zoom in and breakdown the remaining LTE data access latency (291 ms):

22 DNS-Wait Grant DNS (IPv6) DNS-Wait Grant DNS (IPv4) APP-OS overhead TCP SYN-Wait Grant TCP SYN-Send Data TCP ACK (local processing) HTTP GET (send request) HTTP GET-Wait Grant HTTP GET-req sent HTTP-server RTT+ DL latency LTE-to-TCP overhead HTTP page DL transmission HTTP DL retransmission

2.02 ms 11 ms 18 ms 0.02 ms

First bit of HTTP response

0.36 ms 12 ms 8 ms 110 ms 6.1 ms 40 ms 3 ms 16 ms 17 ms 26 ms 12 ms

slide-87
SLIDE 87

Latency mapping for failures: local analysis III

Example: data plane suspension due to radio reconnection and head-of-line blocking during handover

23

slide-88
SLIDE 88

Latency mapping for failures: local analysis III

Example: data plane suspension due to radio reconnection and head-of-line blocking during handover

23

Blocking Request Sent Waiting Grant Uplink Transmission Handover Disruption — No data Handover Disruption — Duplicate recv’d data Waiting (TTFB, due to parallel TCP connection) Content Download 5.05 ms 0.58 ms 4 ms 130 ms 263 ms 36 ms 275 ms 33.16 ms

slide-89
SLIDE 89

Machine learning scheme

We leverage domain-speciCc knowledge for ML-based predictions Control plane: predict handover using a decision tree classiCer

  • Features from 3GPP standards
  • Predicts handover 100ms before it occurs with >99% accuracy

Data plane: predict NACK/ACK hip at MAC layer

24

slide-90
SLIDE 90

Synthesizer: global crowdsourcing analysis

25

slide-91
SLIDE 91

Synthesizer: global crowdsourcing analysis

Four US carriers + Google Project Fi

25

slide-92
SLIDE 92

Synthesizer: global crowdsourcing analysis

Four US carriers + Google Project Fi 23 phone models, 95,057 data sessions

25

slide-93
SLIDE 93

Synthesizer: global crowdsourcing analysis

Four US carriers + Google Project Fi 23 phone models, 95,057 data sessions Overall latency: 77 — 2956 ms in 500K samples

25

slide-94
SLIDE 94

Synthesizer: global crowdsourcing analysis

Four US carriers + Google Project Fi 23 phone models, 95,057 data sessions Overall latency: 77 — 2956 ms in 500K samples

  • Varies among different mobile carriers

25

Average Latency by LTE Data Access Setup (no mobility)

50 100 150 200 AT&T T-mobile Sprint VerizonProject Fi

162 153

147

165 196

slide-95
SLIDE 95

Synthesizer: global crowdsourcing analysis

Four US carriers + Google Project Fi 23 phone models, 95,057 data sessions Overall latency: 77 — 2956 ms in 500K samples

  • Varies among different mobile carriers
  • Insensitive to varying radio link quality

25

  • 130-120-110-100 -90 -80 -70 -60 -50 -40

50 100 200 500 1,000 3,000

Signal Strength (dBm) Total Latency (ms)

slide-96
SLIDE 96

LTE data access latency: how frequent?

Frequent data access setup operations

  • every 58.8 sec (median); 133.6 sec (average)
  • cause: frequently entering power-saving mode

Sho1-lived Radio connectivity lifetime

  • every 10.8 sec (median); 17.3 sec (average)
  • cause: inactivity timer (regulated by standards)

26

slide-97
SLIDE 97

LTE data access latency: how frequent?

Frequent data access setup operations

  • every 58.8 sec (median); 133.6 sec (average)
  • cause: frequently entering power-saving mode

Sho1-lived Radio connectivity lifetime

  • every 10.8 sec (median); 17.3 sec (average)
  • cause: inactivity timer (regulated by standards)

26

slide-98
SLIDE 98

LTE data access latency: how frequent?

Frequent data access setup operations

  • every 58.8 sec (median); 133.6 sec (average)
  • cause: frequently entering power-saving mode

Sho1-lived Radio connectivity lifetime

  • every 10.8 sec (median); 17.3 sec (average)
  • cause: inactivity timer (regulated by standards)

26

slide-99
SLIDE 99

Overall latency and breakdown for major carriers

27

AT&T T-Mobile Sprint Verizon Project Fi

slide-100
SLIDE 100

Findings Summary

Tradio: Radio connectivity setup

  • It contributes 67.5 −1665.0 ms of the overall LTE access latency.
  • On average, it contributes 39.7%, 44.0%, 61.9%, 64.2% and 43.7% of total latency in T-Mobile,

AT&T, Verizon, Sprint and Project-Fi, respectively.

Tctrl: Connectivity state transfer

  • It contributes 28.75 ms to 2286.25ms of the overall LTE access latency.
  • On average, it contributes 60.3%, 56.0%, 38.1%, 35.8% and 56.3% of total latency in T-Mobile,

AT&T, Verizon, Sprint and Project-Fi, respectively.

28

slide-101
SLIDE 101

Impact on mobile Web app: Chrome

Average page loading time for tested webpage: 411 ms

  • LTE data access setup: 174 ms
  • 42.3% total latency perceived

Similar results for Safari latency on iOS

29

DNS query

TCP connection TCP SYN

Data access request

LTE data

SYN ACK HTTP request

LTE control plane LTE data plane

OS

  • verhead

HTTP transmission Page rendering

TCP data

TCP layer

unloadEventStart fetchStart domainLookupStart domainLookupEnd connectStart connectEnd requestStart responseEnd responseStart domInteractive loadEventEnd

25 50 75 100 200 400 600 800

Normalized sorted sample (%) Latency (ms)

Total latency LTE latency

slide-102
SLIDE 102

Impact on instant-messaging: WhatsApp

Average time Crst data packet being ACKed: 341 ms

  • LTE data access setup: 175 ms
  • 51.4% total latency perceived

30

DNS query

TCP connection

SYN

Data access request

LTE data SYN ACK

LTE control plane LTE data plane

OS

  • verhead

SSL Data TCP data

TCP layer

App init

TCP ACK

  • SSL

Data TCP ACK

  • App connect

w/ server New message idle Server ACK

Latency

Next message

25 50 75 100 200 400 600 800

Normalized sorted sample (%) Latency (ms)

Total latency LTE latency

slide-103
SLIDE 103

Discussion: reducing LTE latency

Data plane walk-arounds

  • Mask the data setup latency by waking device in connected mode in advance

Control plane acceleration

  • Speed up connectivity state transfer between the base station and the mobility controller (e.g. DPCM [ACM

MobiCom’17])

  • Handover prediction

Other issues

  • Extending to other network metrics (e.g. loss, throughput, …)
  • Theoretical bounds
  • Privacy issues

31

slide-104
SLIDE 104

Conclusion: ML-based analysis for next-gen mobile networks

Mobile networks are successful and will continue to prosper (5G, self driving, …) Mobile network analysis: paradigm shin to device-centric, ML-based scheme

  • Device-centric: unveil the tightly-guided operation issues over 4G/5G mobile networks
  • Two-tiered approach: a more open solution approach for the research community

32

slide-105
SLIDE 105

Q & A

slide-106
SLIDE 106

Backup