Nubomedia: the cloud infrastructure for WebRTC and IMS multimedia - PowerPoint PPT Presentation

Nubomedia: the cloud infrastructure for WebRTC and IMS multimedia real-time communications Luis Lopez lulop@kurento.org

Human communications 2 http://www.kurento.org

The value of technology 3 http://www.kurento.org

Multimedia communication technologies 5G HD 3D Video 4G HD Video 3G Video 2G Audio 4 http://www.kurento.org

The Kurento vision From this … … to this Knowledge 5 http://www.kurento.org

Cooking Kurento 6 http://www.kurento.org

WebRTC: present and future Before WebRTC After WebRTC Next natural step… Developing the client side Begin End Begin End • Unified APIs • Unified APIs • Standards • Standards • FOSS • FOSS • Multiplatform • Multiplatform Developing the infrastructure Begin End side • Unified APIs • Standards • FOSS • Multiplatform 7 http://www.kurento.org

WebRTC infrastructures Peer-to-Peer WebRTC Application (without media infrastructure) WebRTC video stream WebRTC Application based on media infrastructure media infrastructure 8 http://www.kurento.org

Function of WebRTC media servers Transcoding media server VP8 H.264 MCU/SFU media server Recording media server 9 http://www.kurento.org

Kurento as a WebRTC media server What common WebRTC Current media servers Media is Media Servers do: Media goes Transcoding here MCU/SFU there • Transcoding Recording • MCU • Recording Media is What future Media Future media servers Rich Media here Servers will do: goes there Transcoding, • Flexible processing MCU/SFU, Recording, • Augmented reality Enrich, • Blending Augment, • Mixing Analyze, Context • Analyzing Combine, Media Transform, Content • Etc. Adapt, … Events Commands 10 http://www.kurento.org

Why is this important Advertising Broadcasting Making calls Gaming WARNING! Overcrowded eLearning Blue Ocean Content and Making WebRTC entertainment calls IoT M2M Smart cities P2M Emergencies Multimedia Security Blue Ocean

WebRTC as a disruptive technology General purpose Specific purpose RTC RTC multimedia Services multimedia services Number of users Disruption direction of WebRTC Who cares about the immense minority? Commodity, no business Many business opportunities here opportunities here 12 http://www.kurento.org

Kurento Media Server  Media Element  Media pipeline • Provides a specific media • Chain of media elements functionality implementing the desired media › Send/receive media logic. • The Media API provides the › Process media capability of creating media › Transform media pipelines by joining media • Exchange media through elements of the toolbox › Sources › Sinks Media Element Sink SRC 13 http://www.kurento.org

Creating applications basing on Kurento Media Server Application 2 Application 1 Application 3 Toolbox of media elements 14 http://www.kurento.org

Creating applications with Kurento 15 http://www.kurento.org

16 http://www.kurento.org

What you should learn first • WebRTC basics – http://www.html5rocks.com/en/tutorials/webrtc/ basics/ • Signaling basics (STUN/TURN) – http://www.html5rocks.com/en/tutorials/webrtc/ infrastructure/

Starting with Kurento • Kurento official documentation – http://www.kurento.org/documentation • Kurento FIWARE documentation – Catalogue site • http://catalogue.fiware.org/enablers/stream-oriented- kurento – Documentation • http://catalogue.fiware.org/enablers/stream-oriented- kurento/documentation 18 http://www.kurento.org

Installing Kurento Media Server • Requirements – Ubuntu 14.04 box (sudo) – Internet connectivity • Install – sudo add-apt-repository ppa:kurento/kurento – sudo apt-get update – sudo apt-get install kurento-media-server • Launch – sudo service kurento-media-server start 19 http://www.kurento.org

Kurento “Hello World!” 20 http://www.kurento.org

Kurento “Hello World!” • Tutorial – http://www.kurento.org/docs/current/tutorials/js/tuto rial-1-helloworld.html • Code – https://github.com/Kurento/kurento-tutorial- js/tree/release-5.1/kurento-hello-world • Video – https://www.youtube.com/watch?v=vGEnkSOp_xc 21 http://www.kurento.org

Understanding this example Browser Application Code kurento-utils Kurento-client-js getUserMedia API PeerConnection API WebSocket API Media Signaling Kurento Media Server 22 http://www.kurento.org

Recording and playing SRC Sink Sink SRC SRC Sink 23 http://www.kurento.org

Recording and playing • Get code here – https://github.com/Kurento/kurento-tutorial- js/tree/release-5.1/kurento-hello-world-recorder- generator – WARNING: Example using generators!! • Video – https://www.youtube.com/watch?v=rDd2NjFXcS0 24 http://www.kurento.org

JavaScript Generators • Generators – Black magic for avoiding callback hell – Program asynchronously with synchronous philosophy • Warning – “Enable Experimental JavaScript” flag 25 http://www.kurento.org

One-to-many example WebRtcEndpoint 4 User 4 Sink WebRTC streaming SRC WebRtcEndpoint 3 User 3 Sink WebRTC streaming SRC WebRtcEndpoint 2 WebRtcEndpoint 1 User 1 User 2 SRC Sink WebRTC WebRTC streaming streaming Sink SRC Media Pipeline 26 http://www.kurento.org

One-to-many • Java EE – http://www.kurento.org/docs/current/tutorials/java/t utorial-3-one2many.html • Node.js – http://www.kurento.org/docs/current/tutorials/node/ utorial-3-one2many.html 27 http://www.kurento.org

Face overlay example Browser JavaScript • – http://www.kurento.org/docs/current/tutorials/js/tutorial-2-magicmirror.html • Java – http://www.kurento.org/docs/current/tutorials/java/tutorial-2-magicmirror.html • Node.js – http://www.kurento.org/docs/current/tutorials/node/tutorial-3-one2many.html • Video – https://www.youtube.com/watch?v=h84HFkvWGgw 28 http://www.kurento.org

Augmented Reality example Sink SRC SRC Sink • Video – https://www.youtube.com/watch?v=JlRg4PzeRKQ 29 http://www.kurento.org

Motion detector • Video – https://www.youtube.com/watch?v=r91nExNEHiw 30 http://www.kurento.org

Crowd detector CrowdEvents Sink SRC CrowdDetector RtspPlayer SRC SRC Sink • Video – https://www.youtube.com/watch?v=S6iWSCysgT0 31 http://www.kurento.org

Many other examples • Face segmentator (aka get a Kiss) – https://www.youtube.com/watch?v=WRmzzblZGDo • Room communications – https://www.youtube.com/watch?v=hkT8fLROdwo • B2B calls – https://www.youtube.com/watch?v=ocJBDo8K6eM • Etc. 32 http://www.kurento.org

Beyond media servers: WebRTC clouds and the problem of scalability WebRTC Application based on media infrastructure WebRTC Cloud 33 http://www.kurento.org

Cloud models for WebRTC infrastructures IaaS SaaS PaaS Provider Provider - Service - Computing resources Provider Developer - Development API - Installation Developer - Administration - Nothing to do - Security Developer - Application logic - Application logic 34 http://www.kurento.org

WebRTC PaaS APIs: Requirements Requirements of WebRTC PaaS APIs • – Functional requirements • Media transport – Media endpoint – Media replication – Media routing • Media persistence – Media storage – Media recovery • Media processing – Transcoding – Analysis – Augmentation – Non-functional requirements • Security • Dependability • Scalability 35 http://www.kurento.org

WebRTC multimedia session RFC 5117 • – A multimedia session is an association among a group of participants engaged in the communication via one or more RTP Sessions. • Characterized by – Communication topology • Graph of multimedia flows – Multimedia processing • Function of each edge of the graph of media flows Transport Transcode Record Analyze Etc. 36 http://www.kurento.org

Scalability of RTC multimedia services TV “Beyond RTC calls” Broadcasting Number of users per session “Broadcasting Non-RTC” CDNs “RTC calls” “Home-made Media Server based Services RTC” Phone system WebRTC PaaS Number of concurrent sessions 37 http://www.kurento.org

Scalability of RTC multimedia services TV “Beyond RTC calls” Broadcasting Number of users per session “Broadcasting Non-RTC” CDNs “RTC calls” “Home-made Media Server based Services RTC” Phone system WebRTC PaaS Number of concurrent sessions 38 http://www.kurento.org

The scalability problem in “call” clouds l Call Call Call Call Call Call Call Call Call Call Call Call Call Call Call Call

Anatomy of WebRTC PaaS for call models: Flat Architecture Application Server Broker Function Load Balancer Media Server Function Function Function Cloud Orchestrator IaaS Cloud Manager 40 http://www.kurento.org

Cloud functions: IaaS manager • Function Cloud Cloud Orchestrator Orchestrator – Provides APIs for IaaS management • Images • Instances Infrastructure as a Service APIs • Storage • Metrics Image Metrics and Security • Security Management KPIs Management • Etc. Computing Storage Networking Management Management Management • Requires IaaS Cloud Manager IaaS Cloud Manager – Physical infrastructure 41 http://www.kurento.org