VIDEO AND WEB SERVICE QUALITY MONITORING USING ITU-T STANDARDS AT - - PowerPoint PPT Presentation
VIDEO AND WEB SERVICE QUALITY MONITORING USING ITU-T STANDARDS AT DEUTSCHE TELEKOM Werner Robitza 1 , Bernhard Feiten 2 , Alexander Raake 1 , Ulf Wstenhagen 2 , Peter List 2 , Steve Gring 1 , Rakesh Rao 1 1 Technische Universitt Ilmenau, 2
Werner Robitza1, Bernhard Feiten2, Alexander Raake1, Ulf Wüstenhagen2, Peter List2, Steve Göring1, Rakesh Rao1
1Technische Universität Ilmenau, 2 Deutsche Telekom AG
2
… make this provable, tangible and understandable for millions of customers. GLOBALLY, IP VIDEO TRAFFIC WILL BE 82 PERCENT OF ALL CONSUMER INTERNET TRAFFIC BY 2021
WHITE PAPER: CISCO, “VNI FORECAST AND METHODOLOGY, 2016-2021”
3
Advanced Concepts, Applications and
Service Design Quality Elements Key Performance Indicators (KPIs) Quality of Service Service Perception Quality Features Key Quality Indicators (KQIs) Quality of Experience
User perspective: Provider perspective:
4
https://youtube.googleblog.com
HTTP Adaptive Streaming (HAS) as the leading technology for video streaming today. QoE may be degraded due to:
§
Inaccessible services
§
Initial loading delays, stalling events
§
Reduced video resolution / quality switching
Bitrate / quality level
t
Initial loading delay Stalling Quality switches
5
ARCHITECTURE
§ First standardized QoE model for HAS § Predicts Mean Opinion Scores for sequences up to 5 min length
Quality Parameter Exctraction Integral Quality Audio Quality Module Integration Module Video Quality Module Stalling Impact Audiovisual Integration A/V Quality Stalling Quality
6
YT, Vimeo, Amazon Prime, DASH Network Emulator Network Traces P.1203 (Modes 0, 1) Subjective ratings Performance
7
8
§
Distributed quality monitoring system
§
Fully automated probes across Germany
§
Measure video streams and website calls, directly from the browser, like a customer would do
§
Different KPIs and KQIs measured:
§
DNS times, ping
§
Upload and download speed tests
§
Video loading times
§
Video quality according to P.1203
… and many more
9
Monitoring of different video providers over the period of several days MOS Different baseline for MOS due to player/window size or maximum delivered video resolution
10
11
§
What is the customer’s video QoE for a given bandwidth?
§
Not universally answerable!
§
Depends on the service / technology, client device, …
§
Example case: YouTube streaming to desktop clients
QoE Management Workshop at QoMEX 2018
TEST ARCHITECTURE
P.1203 QoE Test PC Logs Traffic Shaper Measurement Add-on for Chrome Video bitstreams
12
0% 25% 50% 75% 100% 256 384 512 768 1024 1536 2048 3072 4096 8192 16384 37499
Download Resolution
hd1080 hd720 large medium small tiny
13
14
15
§
Deutsche Telekom as a leading provider in Germany
§
QoE as an important measure for network quality
§
Development of QoE metrics like P.1203
§
Focus on QoE in monitoring systems:
§
Client-centric monitoring as complement to network-centric solutions
§
Predicting QoE from network parameters
OUTLOOK
§
ITU competition P.NATS Phase 2 / AVHD-AS: New models for 4K/UHD and new codecs
§
Monitoring of encrypted video streams – predicting QoE from network-centric monitoring systems
Acknowledgements for their supporting work: Dhananjay Kittur (BTH Sweden), Alexander Dethof (TU Berlin), Marie-Neige Garcia (TU Berlin), and the colleagues in ITU-T Study Group 12, Q14 for jointly developing the P.1203 recommendation.
16