A Machine Learning Based Approach to Mobile Network Analysis
Zengwen Yuan1, Yuanjie Li1, Chunyi Peng2, Songwu Lu1, Haotian Deng2, Zhaowei Tan1, Taqi Raza1
1 2
A Machine Learning Based Approach to Mobile Network Analysis Zengwen - - PowerPoint PPT Presentation
A Machine Learning Based Approach to Mobile Network Analysis Zengwen Yuan 1 , Yuanjie Li 1 , Chunyi Peng 2 , Songwu Lu 1 , Haotian Deng 2 , Zhaowei Tan 1 , Taqi Raza 1 1 2 Overview 2 Overview 2 Background Overview 2 Background
Zengwen Yuan1, Yuanjie Li1, Chunyi Peng2, Songwu Lu1, Haotian Deng2, Zhaowei Tan1, Taqi Raza1
1 2
2
Background
2
Background Why machine learning for mobile network analysis
2
Background Why machine learning for mobile network analysis Mobile network analysis: state-of-the-a; and our approach
2
Background Why machine learning for mobile network analysis Mobile network analysis: state-of-the-a; and our approach Case study: analyzing latency for mobile networks
2
Background Why machine learning for mobile network analysis Mobile network analysis: state-of-the-a; and our approach Case study: analyzing latency for mobile networks
Conclusion
2
3
4
Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack Web server
Internet
Cellular network (4G LTE)
User space
5
What’s going on in the 3G/4G/5G network??
Oh we cannot tell you unless you sign an NDA… Researcher (you) No privilege no talk, sorry! Chipset/Mobile OS Operators
Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack Web server
Internet
Cellular network (4G LTE)
User space
5
What’s going on in the 3G/4G/5G network??
Oh we cannot tell you unless you sign an NDA… Researcher (you) No privilege no talk, sorry! Chipset/Mobile OS Operators
6
Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack
User space
TCP/IP Protocol Stack Application Protocols Radio Resource Control (RRC) Mobility Management (EMM) Session Management (ESM) Packet Convergence (PDCP) Radio Link Control (RLC) Medium Access Control (MAC) Physical Layer Protocols (PHY) Control Plane Data Plane Signaling
7
7
✦ Why the time-to-first-byte (TTFB) is so long? ✦ What’s the major component of latency? ✦ …
7
✦ Why the time-to-first-byte (TTFB) is so long? ✦ What’s the major component of latency? ✦ …
✦ Does the recipient read my message? ✦ Is my message delivered in time? ✦ …
7
8
8
8
Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack Web server
Internet
Cellular network (4G LTE)
Base stations Gateway Gateway User profile server Mobility controller
User space
8
Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack Web server
Internet
Cellular network (4G LTE)
Base stations Gateway Gateway User profile server Mobility controller
User space
8
Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack Web server
Internet
Cellular network (4G LTE)
Base stations Gateway Gateway User profile server Mobility controller
User space
Not Scalable
8
Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack Web server
Internet
Cellular network (4G LTE)
Base stations Gateway Gateway User profile server Mobility controller
User space
Not Scalable Incomplete View
8
Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack Web server
Internet
Cellular network (4G LTE)
Base stations Gateway Gateway User profile server Mobility controller
User space
Not Scalable Incomplete View Opaqueness
9
Not Scalable Incomplete View Opaqueness
Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack
User space
Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space9
Not Scalable Incomplete View Opaqueness
Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack
User space
Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space9
Not Scalable Incomplete View Opaqueness Scalability
Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack
User space
Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space9
Not Scalable Incomplete View Opaqueness Scalability Device QoE View
Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack
User space
Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space9
Not Scalable Incomplete View Opaqueness Scalability Device QoE View Availability
Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack
User space
Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space11
Mobile Apps Baseband Mobile OS TCP/IP stackLTE interface
Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space11
Mobile Apps Baseband Mobile OS TCP/IP stackLTE interface
Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space11
Mobile Apps Baseband Mobile OS TCP/IP stackLTE interface
Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space Mobile Apps Baseband Mobile OS TCP/IP stack LTE interface Application Stack User space12 Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack
User space
12 Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack
User space
12 Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack
User space
12 Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack
User space
12 Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack
User space
Preprocessing
12 Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack
User space
Preprocessing
12 Mobile Apps
Baseband Mobile OS
TCP/IP stack
LTE interface
Application Stack
User space
Preprocessing ML analysis
13
SQL Query SQL Response
Fine-grained logging & sharing Efficient Data Management Structured Query
in PageView [KissMetrics 2011]
searches per user by 0.6%
15
16
Safari WhatsApp
modem chipset mobile OS
TCP/IP stack
LTE interface
Application (HTTP/DNS) Web server
16
Safari WhatsApp
modem chipset mobile OS
TCP/IP stack
LTE interface
Application (HTTP/DNS) Web server
16
Safari WhatsApp
modem chipset mobile OS
TCP/IP stack
LTE interface
Application (HTTP/DNS) Web server
16
Safari WhatsApp
modem chipset mobile OS
TCP/IP stack
LTE interface
Application (HTTP/DNS) Web server
16
Safari WhatsApp
modem chipset mobile OS
TCP/IP stack
LTE interface
Application (HTTP/DNS) Web server
Internet
16
Safari WhatsApp
modem chipset mobile OS
TCP/IP stack
LTE interface
Application (HTTP/DNS) Web server
Internet
Cellular network (4G LTE)
16
Safari WhatsApp
modem chipset mobile OS
TCP/IP stack
LTE interface
Application (HTTP/DNS) Web server
Internet
Cellular network (4G LTE)
16
Safari WhatsApp
modem chipset mobile OS
TCP/IP stack
LTE interface
Application (HTTP/DNS) Web server
Internet
Base stations Gateway Gateway User profile server Mobility controller
Cellular network (4G LTE)
16
Safari WhatsApp
modem chipset mobile OS
TCP/IP stack
LTE interface
Application (HTTP/DNS) Web server
Internet
(a) (b)
Base stations Gateway Gateway User profile server Mobility controller
Cellular network (4G LTE)
16
Safari WhatsApp
modem chipset mobile OS
TCP/IP stack
LTE interface
Application (HTTP/DNS) Web server
Internet
(a) (b) (c) (c) (c)
Base stations Gateway Gateway User profile server Mobility controller
Cellular network (4G LTE)
(d) (d) (d)
16
Safari WhatsApp
modem chipset mobile OS
TCP/IP stack
LTE interface
Application (HTTP/DNS) Web server
Internet
(a) (b) (c) (c) (c)
Base stations Gateway Gateway User profile server Mobility controller
Cellular network (4G LTE)
(d) (d) (d)
16
Safari WhatsApp
modem chipset mobile OS
TCP/IP stack
LTE interface
Application (HTTP/DNS) Web server
Internet
(a) (b) (c) (c) (c)
Base stations Gateway Gateway User profile server Mobility controller
(f) (e)
Cellular network (4G LTE)
(d) (d) (d)
16
Safari WhatsApp
modem chipset mobile OS
TCP/IP stack
LTE interface
Application (HTTP/DNS) Web server
Internet
(a) (b) (c) (c) (c)
Base stations Gateway Gateway User profile server Mobility controller
(f) (e)
17
17
P1a: RRC connection setup request
17
P1a: RRC connection setup request (Random Access)
17
P1a: RRC connection setup request (Random Access) P1b: RRC connection setup
17
P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete
17
P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete
17
P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete
17
P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete
17
P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete
17
P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete
17
P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete
17
P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete
P6b RRC connection reconfig complete
17
P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete
P6b RRC connection reconfig complete
Data bearer
Data bearer
17
P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete
P6b RRC connection reconfig complete
Data bearer
Data bearer
UL data
17
P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete
P6b RRC connection reconfig complete
Data bearer
Data bearer
UL data
17
P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete
P6b RRC connection reconfig complete
Data bearer
Data bearer
UL data
17
P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete
P6b RRC connection reconfig complete
Data bearer
Data bearer
UL data
17
P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete
P6b RRC connection reconfig complete
Data bearer
Data bearer
UL data
17
P1a: RRC connection setup request (Random Access) P1b: RRC connection setup P1c: RRC connection setup complete
P6b RRC connection reconfig complete
Data bearer
Data bearer
UL data
18
DNS query
TCP connection TCP SYN
Data access request
LTE data
SYN ACK HTTP request
LTE control plane LTE data plane
OS
HTTP transmission Page rendering
TCP data
TCP layer
unloadEventStart fetchStart domainLookupStart domainLookupEnd connectStart connectEnd requestStart responseEnd responseStart domInteractive loadEventEnd
19
App TCP/IP LTE chipset Base station Web server
plane msgs
network request
LTE data plane pkts Server’s ACK
Tapp Ttcpdump TLTE
log tcpdump log MobileInsight log
network response
20
20
20
20
21
21
21
21
21
Queueing Stalled DNS Lookup Initial Connection Request Sent Waiting (TTFB) Content Download
8.98 ms 2.97 ms 250.04 ms 30.11 ms 0.36 ms 137.41 ms 43.48 ms
LTE Data Access Latency LTE service request
22 DNS-Wait Grant DNS (IPv6) DNS-Wait Grant DNS (IPv4) APP-OS overhead TCP SYN-Wait Grant TCP SYN-Send Data TCP ACK (local processing) HTTP GET (send request) HTTP GET-Wait Grant HTTP GET-req sent HTTP-server RTT+ DL latency LTE-to-TCP overhead HTTP page DL transmission HTTP DL retransmission
2.02 ms 11 ms 18 ms 0.02 ms
First bit of HTTP response
0.36 ms 12 ms 8 ms 110 ms 6.1 ms 40 ms 3 ms 16 ms 17 ms 26 ms 12 ms
23
23
Blocking Request Sent Waiting Grant Uplink Transmission Handover Disruption — No data Handover Disruption — Duplicate recv’d data Waiting (TTFB, due to parallel TCP connection) Content Download 5.05 ms 0.58 ms 4 ms 130 ms 263 ms 36 ms 275 ms 33.16 ms
24
25
25
25
25
25
Average Latency by LTE Data Access Setup (no mobility)
50 100 150 200 AT&T T-mobile Sprint VerizonProject Fi
162 153
147
165 196
25
50 100 200 500 1,000 3,000
Signal Strength (dBm) Total Latency (ms)
26
26
26
27
AT&T T-Mobile Sprint Verizon Project Fi
AT&T, Verizon, Sprint and Project-Fi, respectively.
AT&T, Verizon, Sprint and Project-Fi, respectively.
28
29
DNS query
TCP connection TCP SYN
Data access request
LTE data
SYN ACK HTTP request
LTE control plane LTE data plane
OS
HTTP transmission Page rendering
TCP data
TCP layer
unloadEventStart fetchStart domainLookupStart domainLookupEnd connectStart connectEnd requestStart responseEnd responseStart domInteractive loadEventEnd
25 50 75 100 200 400 600 800
Normalized sorted sample (%) Latency (ms)
Total latency LTE latency
30
DNS query
TCP connection
SYN
Data access request
LTE data SYN ACK
LTE control plane LTE data plane
OS
SSL Data TCP data
TCP layer
App init
TCP ACK
Data TCP ACK
w/ server New message idle Server ACK
Latency
Next message
25 50 75 100 200 400 600 800
Normalized sorted sample (%) Latency (ms)
Total latency LTE latency
Data plane walk-arounds
Control plane acceleration
MobiCom’17])
Other issues
31
32