S * * YNELIXIS COAST COAST COAST COAST Future Content Networks - - PowerPoint PPT Presentation

▶
s
SMART_READER_LITE
LIVE PREVIEW

S * * YNELIXIS COAST COAST COAST COAST Future Content Networks - - PowerPoint PPT Presentation

Feb 12, 2024 273 likes •487 views

S YNELIXIS S * * YNELIXIS COAST COAST COAST COAST Future Content Networks COAST: Content aware Searching, Retrieval and Streaming Theodore Zahariadis Theodore Zahariadis zahariad@synelixis.com COMET-ENVISION Workshop L London, 10

slide-1
SLIDE 1

COAST COAST COAST COAST

S SYNELIXIS

YNELIXIS * *

Future Content Networks COAST: Content‐aware Searching, Retrieval and Streaming

Theodore Zahariadis Theodore Zahariadis

zahariad@synelixis.com COMET-ENVISION Workshop L d 10 N b 2011

1 COMET-ENVISION Workshop, London, 10 November 2011

London, 10 November 2011

slide-2
SLIDE 2

COAST COAST COAST COAST

h “ ” Who is “COAST”

ST Mi l i (I l )

  • ST Microelectronics

(Italy)

  • Synelixis Solutions Ltd

(Greece)

  • Yahoo! Iberia

(Spain)

S SYNELIXIS

YNELIXIS * *

( p )

  • NEC Europe Ltd

(UK)

  • Telefonica I+D

(Spain)

  • Fraunhofer HHI

(Germany)

  • Politecnico di Torino

(Italy)

  • Technische Universität Berlin

(Germany)

  • Technische Universität Berlin

(Germany)

  • Fundacion Barcelona Media

(Spain)

  • University of California, Los Angeles

(USA)

  • Seoul National University

(S. Korea) 9 Participants from 5 EU countries + 1 from USA and 1 from S. Korea

2

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

p 3 Industries, 1 Operator, 1 SME, 4 Research Institutes, 2 non‐EU participants

slide-3
SLIDE 3

COAST COAST COAST COAST

Limitations of today’s Internet Architecture

R1 R2 R3 Search Engine 1 Search Engine 2 R1 C t t ISP Network R4 R5 User A Content Server 1 User A User B Content Server 2

  • If the content could be stored/cached closer to the end users, not
  • nly at the end‐points as local proxies, but transparently in the

network (routers, servers, nodes, data centres) then content delivery

3

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

network (routers, servers, nodes, data centres) then content delivery would have been much more efficient.

slide-4
SLIDE 4

COAST COAST COAST COAST

Limitations of today’s Internet Architecture

R2 R3 Search Engine 1 Search Engine 2 R1 R2 ISP Network R4 R5 User A Content Server 1 User A User B Content Server 2

  • If the routers could identify/analyse what content is flowing through

them, the search engines would gain much better knowledge of content location and provide information even on “live” video streams

4

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

location and provide information even on live video streams.

slide-5
SLIDE 5

COAST COAST COAST COAST

Limitations of today’s Internet Architecture

R2 R3 Search Engine 1 Search Engine 2 R1 R2 ISP Network R4 R5 User A Content Server 1 User A User B Content Server 2

  • If the network could dynamically identify what is the best end‐to‐

end path (less congestion, lower delay, more bandwidth), it would have provided a better way to deliver the data

5

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

have provided a better way to deliver the data.

slide-6
SLIDE 6

COAST COAST COAST COAST

Limitations of today’s Internet Architecture

R2 R3 Search Engine 1 Search Engine 2 R1 R2 ISP Network R4 R5 User A Content Server 1

  • If the content could be interactively adapted not only statically

User A User B Content Server 2

  • If the content could be interactively adapted, not only statically

based on the network and terminal capabilities, but also based on the interactive content selection by the user, the PQoS would be higher

6

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

higher.

slide-7
SLIDE 7

COAST COAST COAST COAST

Step 1: Distribution of autonomous content

  • Dynamic Adaptive Streaming over HTTP
  • Streaming based on media segments (e g MP4FF)
  • Streaming based on media segments (e.g. MP4FF)
  • Media Presentation Description (MPD) indicates all options
  • Client driven adaptation by dynamic selection of alternatives

7

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

  • Client driven adaptation by dynamic selection of alternatives
slide-8
SLIDE 8

COAST COAST COAST COAST

Step 1: DASH Client, functional blocks

MPD Network/User Parser HTTP Source context Buffer Mngmt Source Adapt. Decision Browser Integration HTTP Get Demux Decoder Video Out

8

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

slide-9
SLIDE 9

COAST COAST COAST COAST

Step 2: COAST URL (CURL)

U i C t t B d id tifi f COAST t t

  • Unique Content Based identifier for COAST contents
  • Enable fast identification of the content within COAST overlay

Fast calculation (not calculated each time the content is requested) ( q )

  • Avoid data replication Unique association with the object
  • Integrity of the object

B k d tibl ith th t t  N h f th t t fil f t

  • Backward compatible with the content  No change of the content file format

Filename.ext CM‐CID‐Filename.ext

COAST Marker: Provides fast Content ID: self‐certifying identifier. MD5/ SHA‐1 based‐ hash function on the file's content or a combination of Provides fast identification of UID: COAST‐24806

9

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

low level descriptors.

slide-10
SLIDE 10

COAST COAST COAST COAST

Step 2: COAST URL (CURL)

http://www.abc.com/Filename.ext COAST http://www.abc.com/CM‐CID‐Filename.ext CURL

Trigger COAST related functionalities Original URL can easily be extracted

10

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

slide-11
SLIDE 11

COAST COAST COAST COAST

Step 2: COAST URL (CURL)

http://my.domain.net/dance.mp3 http://my.domain.net/COAST248036_37a8d10c39e921da187c6929adcb0bfa59cf2192_dance.mp3 http://my.domain.net/clip.avi http://my.domain.net/COAST948036_37a8d10c39e921ff187c6929adcb0bfa60cf2352_clip.avi http://my.domain.net/homepage.html http://my.domain.net/COAST248036_84d53e26a9976fc3250ba5cc462e7bb5f7862780_homepage.html

  • Fast
  • Fast
  • Efficient: Unique represenation

k d bl

  • Backwards compatible
  • User Unfriently (?)

11

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

slide-12
SLIDE 12

COAST COAST COAST COAST

Step 2: COAST URL (CURL) in MPD

12

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

slide-13
SLIDE 13

COAST COAST COAST COAST

Step 3: DPI/Content identification

  • DPI: PF_RING based implementation
  • Simple interface to ring PKT capture
  • High‐performance
  • Mature and tested code base
  • Compatible with linux 2.6.x kernels up to

36 Easy to port to newer kernels

13

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

.36. Easy to port to newer kernels.

slide-14
SLIDE 14

COAST COAST COAST COAST

Step 3: DPI/Content identification

  • Four gigabit Ethernet

Ports Ports

  • Standard PCI host

Interface

  • Gigabit serial I/O

14

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

slide-15
SLIDE 15

COAST COAST COAST COAST

Step 4: Overlay Support

  • Heterogeneity in the network nodes capabilities
  • Heterogeneity in topology/bandwidth capabilities

g y p gy/ p

  • Heterogeneity in processing & storage capabilities
  • Heterogeneity in the delivery/streaming requirements

g y y/ g q

  • Heterogeneity in the security requirements
  • Heterogeneity in the network/domain administration

Heterogeneity in the network/domain administration

  • We need an abstract universal representation of nodes

We need an abstract universal representation of nodes and virtual grouping of collaborating nodes to create homogeneous sub‐networks.

15

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

slide-16
SLIDE 16

COAST COAST COAST COAST

Step 4: Overlay Support Step 4: Overlay Support

S hi Content Aware Network Layers Information Overlay Searching, Network Monitoring, Cache Optimization Distributed Content/Services Content Discovery & Caching, Delivery Distributed Content/Services Aware Overlay IP routing Service/Network Provider Infrastructure P2P content Streaming & Delivery P2P Grouping Content Server 1 / Content/Service Prosumer A Delivery

16

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

Server 1 Content/Service Prosumer C Content/Service Prosumer B Prosumer A

slide-17
SLIDE 17

COAST COAST COAST COAST

Step 4: Overlay Support

External Publishing Searching Search Engine Cache Optimizer Publishing F t E d Cache Locator I f ti Servers e.g. ALTO Network Monitor Publishing, Searching, Network Monitoring, Cache Locator & Optimization Front-End Information Overlay

CN CN CN

Content Discovery, Caching, Adaptation & Enrichment Content/Service Distributed Overlay

CN CN

IP routing

CEP

Service/Network Infrastructure P2P Streaming, Caching Automatic Publishing /

CEP CEP

Content Server 1 Caching

17

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

Content/Service Prosumer C Content/Service Prosumer B Content/Service Prosumer A Server 1

slide-18
SLIDE 18

COAST COAST COAST COAST

Step 5: Content Caching

External Search Engine Cache Optimizer Publishing Front-End I f ti Servers e.g. ALTO Network Monitor Front End Information Overlay

CN CN CN

Discovery/DPI Tier 1 – Caching Adaptation & Enrichment Content/Service Distributed Overlay

CN CN CEP

Service/Network Infrastructure Tier 0 – Caching P2P Streaming Automatic Publishing /

CEP CEP

Content Server 1 P2P Streaming

18

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

Content/Service Prosumer C Content/Service Prosumer B Content/Service Prosumer A Server 1

slide-19
SLIDE 19

COAST COAST COAST COAST

Step 5: Content Caching

External Strip UCL from Search Engine Cache Optimizer Publishing Front-End I f ti Servers e.g. ALTO Network Monitor Strip UCL from CURL and go to the

  • riginal HTTTP

server Front End Information Overlay

CN CN CN

Check at CDN Level at Tier 1 Content/Service Distributed Overlay

CN CN CEP

Service/Network Infrastructure Automatic Publishing Check locally at Tier 0 /

CEP CEP

Content Server 1

19

S SYNELIXIS

YNELIXIS * *

COMET-ENVISION Workshop, London, 10 November 2011

Content/Service Prosumer C Content/Service Prosumer B Content/Service Prosumer A Server 1

slide-20
SLIDE 20

Thank You!

Theodore B. Zahariadis Synelixis Solutions zahariad [@] synelixis.com y

20 COMET-ENVISION Workshop, London, 10 November 2011