S YNELIXIS S * * YNELIXIS COAST COAST COAST COAST Future Content Networks COAST: Content ‐ aware Searching, Retrieval and Streaming Theodore Zahariadis Theodore Zahariadis zahariad@synelixis.com COMET-ENVISION Workshop L London, 10 November 2011 d 10 N b 2011 COMET-ENVISION Workshop, London, 10 November 2011 1
COAST COAST COAST COAST Who is “COAST” h “ ” • ST Mi ST Microelectronics l i (I (Italy) l ) S YNELIXIS S * * • Synelixis Solutions Ltd (Greece) YNELIXIS • Yahoo! Iberia (Spain) ( p ) • NEC Europe Ltd (UK) • Telefonica I+D (Spain) • Fraunhofer HHI (Germany) • Politecnico di Torino (Italy) • • Technische Universität Berlin Technische Universität Berlin (Germany) (Germany) • Fundacion Barcelona Media (Spain) • University of California, Los Angeles (USA) • Seoul National University (S. Korea) 9 Participants from 5 EU countries + 1 from USA and 1 from S. Korea p 3 Industries, 1 Operator, 1 SME, 4 Research Institutes, 2 non ‐ EU participants S YNELIXIS * S * 2 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
COAST COAST COAST COAST Limitations of today’s Internet Architecture Search Search Engine 1 Engine 2 R3 R2 R1 R1 C Content t t R5 Server 1 R4 ISP Network User A User A Content User B Server 2 • If the content could be stored/cached closer to the end users , not only at the end ‐ points as local proxies, but transparently in the network (routers, servers, nodes, data centres) then content delivery network (routers, servers, nodes, data centres) then content delivery would have been much more efficient. S YNELIXIS * S * 3 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
COAST COAST COAST COAST Limitations of today’s Internet Architecture Search Search Engine 1 Engine 2 R3 R2 R2 R1 Content R5 Server 1 R4 ISP Network User A User A Content User B Server 2 • If the routers could identify/analyse what content is flowing through them , the search engines would gain much better knowledge of content location and provide information even on “live” video streams location and provide information even on live video streams. S YNELIXIS * S * 4 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
COAST COAST COAST COAST Limitations of today’s Internet Architecture Search Search Engine 1 Engine 2 R3 R2 R2 R1 Content R5 Server 1 R4 ISP Network User A User A Content User B Server 2 • If the network could dynamically identify what is the best end ‐ to ‐ end path (less congestion, lower delay, more bandwidth), it would have provided a better way to deliver the data have provided a better way to deliver the data. S YNELIXIS * S * 5 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
COAST COAST COAST COAST Limitations of today’s Internet Architecture Search Search Engine 1 Engine 2 R3 R2 R2 R1 Content R5 Server 1 R4 ISP Network User A User A Content User B Server 2 • • If the content could be interactively adapted not only statically If the content could be interactively adapted , not only statically based on the network and terminal capabilities, but also based on the interactive content selection by the user, the PQoS would be higher higher. S YNELIXIS * S * 6 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
COAST COAST COAST COAST Step 1: Distribution of autonomous content • Dynamic Adaptive Streaming over HTTP • Streaming based on media segments (e g MP4FF) • Streaming based on media segments (e.g. MP4FF) • Media Presentation Description (MPD) indicates all options • Client driven adaptation by dynamic selection of alternatives • Client driven adaptation by dynamic selection of alternatives S YNELIXIS * S * 7 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
COAST COAST COAST COAST Step 1: DASH Client, functional blocks Network/User MPD context Parser HTTP Source Source Buffer Adapt. Browser Mngmt Decision Integration HTTP Get Demux Decoder Video Out S YNELIXIS * S * 8 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
COAST COAST COAST COAST Step 2: COAST URL (CURL) • Unique Content Based identifier for COAST contents U i C t t B d id tifi f COAST t t • Enable fast identification of the content within COAST overlay Fast calculation (not calculated each time the content is requested) ( q ) • Avoid data replication Unique association with the object • Integrity of the object • Backward compatible with the content No change of the content file format t N B k d tibl ith th t h f th t t fil f t Filename.ext COAST Marker : CM ‐ CID ‐ Filename.ext Provides fast Provides fast identification of UID: COAST ‐ 24806 Content ID : self ‐ certifying identifier. MD5/ SHA ‐ 1 based ‐ hash function on the file's content or a combination of low level descriptors. S YNELIXIS * S * 9 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
COAST COAST COAST COAST Step 2: COAST URL (CURL) http://www.abc.com/Filename.ext COAST http://www.abc.com/CM ‐ CID ‐ Filename.ext Trigger COAST related CURL functionalities Original URL can easily be extracted S YNELIXIS * S * 10 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
COAST COAST COAST COAST Step 2: COAST URL (CURL) http://my.domain.net/dance.mp3 http://my.domain.net/COAST248036_37a8d10c39e921da187c6929adcb0bfa59cf2192_dance.mp3 http://my.domain.net/clip.avi http://my.domain.net/COAST948036_37a8d10c39e921ff187c6929adcb0bfa60cf2352_clip.avi http://my.domain.net/homepage.html http://my.domain.net/COAST248036_84d53e26a9976fc3250ba5cc462e7bb5f7862780_homepage.html • Fast • Fast • Efficient: Unique represenation • Backwards compatible k d bl • User Unfriently (?) S YNELIXIS * S * 11 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
COAST COAST COAST COAST Step 2: COAST URL (CURL) in MPD S YNELIXIS * S * 12 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
COAST COAST COAST COAST Step 3: DPI/Content identification • DPI: PF_RING based implementation • Simple interface to ring PKT capture • High ‐ performance • Mature and tested code base • Compatible with linux 2.6.x kernels up to .36. Easy to port to newer kernels. 36 Easy to port to newer kernels S YNELIXIS * S * 13 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
COAST COAST COAST COAST Step 3: DPI/Content identification • Four gigabit Ethernet Ports Ports • Standard PCI host Interface • Gigabit serial I/O S YNELIXIS * S * 14 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
COAST COAST COAST COAST Step 4: Overlay Support • Heterogeneity in the network nodes capabilities • Heterogeneity in topology/bandwidth capabilities g y p gy/ p • Heterogeneity in processing & storage capabilities • Heterogeneity in the delivery/streaming requirements g y y/ g q • Heterogeneity in the security requirements • Heterogeneity in the network/domain administration Heterogeneity in the network/domain administration • We need an abstract universal representation of nodes We need an abstract universal representation of nodes and virtual grouping of collaborating nodes to create homogeneous sub ‐ networks. S YNELIXIS * S * 15 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
COAST COAST COAST COAST Step 4: Overlay Support Step 4: Overlay Support S Searching, hi Content Aware Network Monitoring, Network Layers Cache Optimization Information Overlay Content Discovery & Caching, Delivery Distributed Content/Services Distributed Content/Services Aware Overlay IP routing Service/Network P2P content Provider Infrastructure Streaming & Delivery Delivery P2P Grouping Content Content/Service Server 1 Server 1 Prosumer A Prosumer A Content/Service / Content/Service Prosumer C Prosumer B S YNELIXIS * S * 16 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
COAST COAST COAST COAST Step 4: Overlay Support External Publishing Searching Publishing, Searching, Servers Network Monitoring, Search Cache e.g. ALTO Cache Locator & Cache Engine Optimizer Optimization Locator Network Publishing Monitor F Front-End t E d I f Information ti Overlay Content Discovery, Caching, Adaptation CN & Enrichment CN CN CN CN Content/Service Distributed Overlay IP routing Automatic Publishing Service/Network P2P Streaming, Infrastructure CEP Caching Caching CEP CEP Content Server 1 Server 1 Content/Service / Content/Service Content/Service Prosumer B Prosumer C Prosumer A S YNELIXIS * S * 17 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
COAST COAST COAST COAST Step 5: Content Caching External Servers Search Cache e.g. ALTO Engine Optimizer Network Publishing Monitor Front End Front-End I f Information ti Discovery/DPI Overlay Tier 1 – Caching Adaptation & CN CN Enrichment CN CN CN Content/Service Distributed Overlay Automatic Publishing Service/Network Tier 0 – Caching Infrastructure CEP P2P Streaming P2P Streaming CEP CEP Content Server 1 Server 1 Content/Service / Content/Service Content/Service Prosumer B Prosumer C Prosumer A S YNELIXIS * S * 18 COMET-ENVISION Workshop, London, 10 November 2011 YNELIXIS
Recommend
More recommend
