Title: Scalable Video Coding based DASH for efficient usage of - - PowerPoint PPT Presentation

▶
title scalable video coding based dash for efficient
SMART_READER_LITE
LIVE PREVIEW

Title: Scalable Video Coding based DASH for efficient usage of - - PowerPoint PPT Presentation

Jan 12, 2023 117 likes •484 views

Image Processing - Multimedia Communications Title: Scalable Video Coding based DASH for efficient usage of network resources Presenter: Yago Snchez (yago.sanchez@hhi.fraunhofer.de) Fraunhofer Heinrich Hertz Institute, Yago Snchez, Thomas

slide-1
SLIDE 1

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 1 Yago Sánchez

Title: Scalable Video Coding based DASH for efficient usage of network resources

Presenter: Yago Sánchez (yago.sanchez@hhi.fraunhofer.de) Fraunhofer Heinrich Hertz Institute, Yago Sánchez, Thomas Schierl Berlin, Germany Cooperation with: Bell Labs - Alcatel Lucent, Werner Van Leekwijck Orange-FT, Yannick Le Louédec

slide-2
SLIDE 2

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 2 Yago Sánchez

Outline

  • Motivation
  • Dynamic Adaptive Streaming over HTTP (DASH)
  • Scalable Video Coding (SVC)
  • DASH using SVC
  • Benefits of SVC-based DASH
  • Conclusion
slide-3
SLIDE 3

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 3 Yago Sánchez

Motivation

  • HTTP Streaming allows providing an Internet TV service at low cost
  • No complex server requirements: servers are simple web servers
  • HTTP caches can be re-used: load at servers reduced
  • Complexity moved to the client: clients decide what to download
  • Ease of deployment: no traversal issues with Firewalls and NATs as for

RTP/UDP HTTP Streaming and in particular DASH has raised interest of researchers and market

slide-4
SLIDE 4

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 4 Yago Sánchez

Dynamic Adaptive Streaming over HTTP (DASH) – Part I

  • Standardized in MPEG
  • Multiple versions of the same content are offered
  • DASH defines: XML Document MPD and Segment formats
slide-5
SLIDE 5

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 5 Yago Sánchez

Dynamic Adaptive Streaming over HTTP (DASH) – Part I

  • Standardized in MPEG
  • Multiple versions of the same content offered
  • DASH defines: XML Document MPD and Segment formats

Period ... Period Period Period Media Presentation Structure and Description of the Media Presentation on DASH

slide-6
SLIDE 6

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 6 Yago Sánchez

Dynamic Adaptive Streaming over HTTP (DASH) – Part I

  • Standardized in MPEG
  • Multiple versions of the same content offered
  • DASH defines: XML Document MPD and Segment formats

Period ... Period Period Period Media Presentation AdaptationSet ... Structure and Description of the Media Presentation on DASH AdaptationSet AdaptationSet

slide-7
SLIDE 7

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 7 Yago Sánchez

Dynamic Adaptive Streaming over HTTP (DASH) – Part I

  • Standardized in MPEG
  • Multiple versions of the same content offered
  • DASH defines: XML Document MPD and Segment formats

Period ... Period Period Period Media Presentation AdaptationSet ... Representation ... Structure and Description of the Media Presentation on DASH AdaptationSet AdaptationSet Representation Representation

slide-8
SLIDE 8

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 8 Yago Sánchez

Dynamic Adaptive Streaming over HTTP (DASH) – Part I

  • Standardized in MPEG
  • Multiple versions of the same content offered
  • DASH defines: XML Document MPD and Segment formats

Media Segment Period ... Period Period Period Media Presentation AdaptationSet ... Representation ... ... Initialization Segment Structure and Description of the Media Presentation on DASH AdaptationSet AdaptationSet Representation Representation Media Segment

slide-9
SLIDE 9

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 9 Yago Sánchez

Dynamic Adaptive Streaming over HTTP (DASH) – Part II

  • Description of the available media: Media Presentation Description (MPD)
  • Segment Formats:
  • ISO base media File Format
  • MPEG2-TS
  • But it can be used with other formats: there is a guideline in DASH
slide-10
SLIDE 10

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 10 Yago Sánchez

Dynamic Adaptive Streaming over HTTP (DASH) – Part II

  • Description of the available media: Media Presentation Description (MPD)
  • Segment Formats:
  • ISO base media File Format
  • MPEG2-TS
  • But it can be used with other formats: there is a guideline in DASH

Example of DASH architecture

slide-11
SLIDE 11

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 11 Yago Sánchez

Problem description

  • Heterogeneous clients or variable access link characteristics
  • Different media components: languages, subtitles…

Traffic diversification: efficiency decrease in cache-performance and network traffic increase

Results obtained from European project OCEAN: http://www.ict-ocean.eu/ Media units = size of a film

  • f 90 minutes @ 500Kbps
slide-12
SLIDE 12

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 12 Yago Sánchez

Problem description

  • Heterogeneous clients or variable access link characteristics
  • Different media components: languages, subtitles…

Traffic diversification: efficiency decrease in cache-performance and network traffic increase Solution

  • Usage of SVC

Results obtained from european project OCEAN: http://www.ict-ocean.eu/ Media units = size of a film

  • f 90 minutes @ 500Kbps
slide-13
SLIDE 13

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 13 Yago Sánchez

Scalable Video Coding

  • Different qualities (temporal, spatial or fidelity) representations in a stream
  • Additive/incremental substreams or layers
  • i.e., subset of layers can be selected for different quality representations

scene

SVC

encoder

SVC decoder SVC decoder SVC decoder

256 kbit/s 512 kbit/s 1024 kbit/s

TV@ 60 Hz CIF@ 30 Hz CIF@ 15 Hz

Base layer Enhancement layer 1 Enhancement layer 2

Principle of Scalable Video Coding

slide-14
SLIDE 14

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 14 Yago Sánchez

Introduction to DASH using SVC – Part I

  • Efficient support of SVC within DASH is fulfilled
  • Layers of SVC are mapped to representations
  • Dependencies between representations indicated in MPD
slide-15
SLIDE 15

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 15 Yago Sánchez

DASH server

500, 1000, 1500 Kbps

AVC-based DASH

media rate over the time

DASH server

SVC-based DASH

media rate over the time 1650 Kbps -enhancement layer 2 1100 Kbps -enhancement layer 1 500 Kbps -base layer

DASH client DASH client

Introduction to DASH using SVC – Part I

  • Efficient support of SVC within DASH is fulfilled
  • Layers of SVC are mapped to representations
  • Dependencies between representations indicated in MPD
slide-16
SLIDE 16

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 16 Yago Sánchez

Introduction to DASH using SVC – Part II

  • Efficient support of SVC within DASH is fulfilled
  • Layers of SVC are mapped to representations
  • Dependencies between representations indicated in MPD

<?xml version="1.0" encoding="UTF-8"?>

<MPD …> … <Period> <AdaptationSet …> <Representation id="tag5“ …> <BaseURL>video-500k.mp4</BaseURL> </Representation> <Representation id="tag6“ …> <BaseURL>video-1000k.mp4</BaseURL> </Representation> <Representation id="tag7“ …> <BaseURL>video-1500k.mp4</BaseURL> </Representation> </AdaptationSet> </Period> </MPD> <?xml version="1.0" encoding="UTF-8"?> <MPD …> … <Period> <AdaptationSet …> <Representation id="tag5“ …> <BaseURL>video-500k.mp4</BaseURL> </Representation> <Representation id="tag6“dependencyId="tag5" …> <BaseURL>video-1100k.mp4</BaseURL> </Representation> <Representation id="tag7“dependencyId="tag5 tag6" …> <BaseURL>video-1650k.mp4</BaseURL> </Representation> </AdaptationSet> </Period> </MPD>

AVC-based DASH SVC-based DASH

slide-17
SLIDE 17

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 17 Yago Sánchez

Usage of network resources - Part I

  • Outbound traffic at DASH server
  • Cache efficiency, measured as cache-hit-ratio

DASH server HTTP cache DASH clients

Minimize traffic Maximize efficiency

slide-18
SLIDE 18

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 18 Yago Sánchez

Usage of network resources - Part II (AVC based DASH)

  • 3 versions for each content
  • 2 files: contenta (Ca red) and contentb (Cb blue)

DASH server HTTP cache DASH clients Ca@1500Kbps Ca@1000Kbps Cb@1000Kbps Cb@500Kbps 5000Kbps 2500Kbps time traffic AVC

slide-19
SLIDE 19

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 19 Yago Sánchez

Usage of network resources - Part III (SVC based DASH)

  • 3 versions for each content
  • 2 files: contenta (Ca red) and contentb (Cb blue)

DASH server HTTP cache DASH clients Ca@1650Kbps Ca@1100Kbps Cb@1650Kbps Cb@500Kbps 5000Kbps 2500Kbps time traffic AVC SVC

slide-20
SLIDE 20

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 20 Yago Sánchez

Usage of network resources - Part IV (Comparison of cache usage)

  • Same limited cache storage capacity for AVC and SVC
  • In the example, different content versions
  • 20 for SVC
  • 9 for AVC single-layer
  • Expected higher cache-hit-ratio for SVC-based DASH
  • The transit-link traffic is further reduced by enhanced cache performance

HTTP cache

HTTP cache

AVC based DASH SVC based DASH

DASH client DASH clients

slide-21
SLIDE 21

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 21 Yago Sánchez

Simulation Set up

  • More than 5000 video files among users can choose
  • Users requests based on traces of a real implementation
  • 3400 request per day on average
  • 4 Representations offered at the server
  • Two different environments:
  • Static clients with different equipment capabilities
  • Dynamic clients with varying available throughput
  • Results obtained within European project OCEAN:

http://www.ict-ocean.eu/

HTTP cache DASH server DASH clients

...

slide-22
SLIDE 22

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 22 Yago Sánchez

Results – Part I

  • Static clients (no adaptation)
  • Clients with different equipment capabilities: 25% of each type

0,1 0,2 0,3 0,4 0,5 0,6 0,7 0,8 0,9 1 1000 2000 3000 4000

cache-hit-ratio cache capacity (C) [media units] MR-VoD layer1 layer3 SVC-VoD layer2 layer4 AVC-VoD

slide-23
SLIDE 23

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 23 Yago Sánchez

Results – Part I

  • Static clients (no adaptation)
  • Clients with different equipment capabilities: 25% of each type

0,1 0,2 0,3 0,4 0,5 0,6 0,7 0,8 0,9 1 1000 2000 3000 4000

cache-hit-ratio cache capacity (C) [media units] MR-VoD layer1 layer3 SVC-VoD layer2 layer4 AVC-VoD

3x

slide-24
SLIDE 24

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 24 Yago Sánchez

Results – Part II

  • Dynamic clients adapting to network conditions
  • Varying throughput simulated
  • Rates distribution for clients (r1,r2,r3,r4) = (9.1%,9.4%,19.1%,62.3%),

where ri<rj if i<j

0,1 0,2 0,3 0,4 0,5 0,6 0,7 0,8 0,9 1 1000 2000 3000 4000

cache-hit-ratio cache capacity (C) [media units] MR-VoD layer1 layer3 SVC-VoD layer2 layer4 AVC-VoD

slide-25
SLIDE 25

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 25 Yago Sánchez

Conclusion – Why is this relevant for W3C?

  • Internet traffic increasing significantly
  • Video streaming will take a large proportion of the traffic
  • DASH expected to be a very successful technology boosting ubiquitous

Internet TV

  • With diversification of devices and access technologies several versions of

each content are foreseen

  • SVC is a key technology that allows reduction of the traffic in the network
  • Service Providers can reduce their costs due to traffic reduction
  • W3C considered to play a very important role on allowing ubiquitous

Internet TV and boosting DASH success

slide-26
SLIDE 26

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 26 Yago Sánchez

Thank you for your attention!

Contact: Yago Sanchez– yago.sanchez@hhi.fraunhofer.de www.hhi.fraunhofer.de/ip/mc Fraunhofer Heinrich Hertz Institute Berlin, Germany

slide-27
SLIDE 27

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 27 Yago Sánchez

Traffic Prediction

  • Global Internet video streaming traffic shows an explosive growth
  • With improvement in Mobile technologies, internet and video streaming

ubiquitous and foreseen growth is huge

Source: Cisco White Paper: Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2009-2014 Figure 2

slide-28
SLIDE 28

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 28 Yago Sánchez

Example of a MPD for SVC

<?xml version="1.0" encoding="UTF-8"?> <MPD xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="urn:mpeg:DASH:schema:MPD:2011" xsi:schemaLocation="urn:mpeg:DASH:schema:MPD:2011" type="static" mediaPresentationDuration="PT3256S" minBufferTime="PT1.2S" profiles="urn:mpeg:dash:profile:isoff-on-demand:2011"> <BaseURL>http://cdn1.example.com/</BaseURL> <BaseURL>http://cdn2.example.com/</BaseURL> <!-- In this Period the SVC stream is split into three representations --> <Period> <AdaptationSet subsegmentAlignment="true" minBandwidth="512000” maxBandwidth="1024000" width="640" height="480" frameRate="30" lang="en"> <!-- Independent Representation --> <Representation mimeType="video/mp4" codecs="avc1.4D401E,mp4a.0x40" id="tag5“ bandwidth="512000"> <BaseURL>video-512k.mp4</BaseURL> </Representation> <!-- Representation dependent on above --> <Representation mimeType="video/mp4" codecs="avc2.56401E" id="tag6“ dependencyId="tag5" bandwidth="768000"> <BaseURL>video-768k.mp4</BaseURL> </Representation> <!-- Representation dependent on both above --> <Representation mimeType="video/mp4" codecs="avc2.56401E" id="tag7“ dependencyId="tag5 tag6" bandwidth="1024000"> <BaseURL>video-1024k.mp4</BaseURL> </Representation> </AdaptationSet> </Period> </MPD>

slide-29
SLIDE 29

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 29 Yago Sánchez

Different representations/Operation Points (OP)

  • OPs also based on smaller parts of layers

GOP Border GOP Border

T0 T1 T2 T3

slide-30
SLIDE 30

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 30 Yago Sánchez

GOP Border GOP Border

T0 T1 T2 T3

OP 0 Different representations/Operation Points (OP)

  • OPs also based on smaller parts of layers
slide-31
SLIDE 31

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 31 Yago Sánchez

GOP Border GOP Border

T0 T1 T2 T3

OP 1 Different representations/Operation Points (OP)

  • OPs also based on smaller parts of layers
slide-32
SLIDE 32

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 32 Yago Sánchez

GOP Border GOP Border

T0 T1 T2 T3

OP 2 Different representations/Operation Points (OP)

  • OPs also based on smaller parts of layers
slide-33
SLIDE 33

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 33 Yago Sánchez

GOP Border GOP Border

T0 T1 T2 T3

OP 3 Different representations/Operation Points (OP)

  • OPs also based on smaller parts of layers
slide-34
SLIDE 34

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 34 Yago Sánchez

GOP Border GOP Border

T0 T1 T2 T3

OP 5 Different representations/Operation Points (OP)

  • OPs also based on smaller parts of layers
slide-35
SLIDE 35

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 35 Yago Sánchez

GOP Border GOP Border

T0 T1 T2 T3

OP 7 Different representations/Operation Points (OP)

  • OPs also based on smaller parts of layers
slide-36
SLIDE 36

Image Processing - Multimedia Communications

SVC-based DASH for efficient usage of network resources 2011-09-20 | Page 36 Yago Sánchez

Results – Part III

  • Dynamic clients adapting to network conditions
  • Varying throughput simulated
  • Rates distribution for clients (r1,r2,r3,r4) = (25%,25%,25%,25%),

where ri<rj if i<j

0,1 0,2 0,3 0,4 0,5 0,6 0,7 0,8 0,9 1 1000 2000 3000 4000

cache-hit-ratio cache capacity (C) [media units] MR-VoD layer1 layer3 SVC-VoD layer2 layer4 AVC-VoD