the meego multimedia stack
play

The MeeGo Multimedia Stack Dr. Stefan Kost Nokia - The MeeGo - PowerPoint PPT Presentation

Jun 24, 2023 •231 likes •479 views

The MeeGo Multimedia Stack Dr. Stefan Kost Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe The MeeGo Multimedia Stack MeeGo Intro Architecture Development GStreamer Dr. Stefan Kost Nokia - The MeeGo Multimedia

  1. The MeeGo Multimedia Stack Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  2. The MeeGo Multimedia Stack MeeGo Intro Architecture Development GStreamer Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  3. Quick MeeGo Intro ● MeeGo = Moblin + Maemo ● Linux distribution for CE devices ● Netbook, Phone (Handset), Connected TV, In-Vehicle ● http://meego.com ● Linux Foundation hosted project Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  4. Architecture http://meego.com/developers/meego-architecture Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  5. Architecture - Multimedia ● Kernel ● V4l2, Alsa ● Middleware ● GStreamer, Pulseaudio, GUPnP ● API ● Qt, Qt Mobility Multimedia, Qt GStreamer Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  6. Development ● Hardware Adaptation ● Core OS Platform ● Applications Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  7. Development – HW Adaptation ● Linux Kernel ● Drivers ● user space libraries (alsa, v4l2) ● Middleware plugins ● GStreamer plugins (Codecs, Camera, Video) Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  8. Development - Platform ● libraries from the Linux eco system ● GStreamer, GUPnP, PulseAudio, Xiph codecs, … Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  9. Development - Applications ● QT interfaces are the official one ● Lower level interfaces might have less stability guarantees Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  10. GStreamer – Use Cases ● Media Playback ● Voice and Video Call ● Camera Still and Video Capture ● Video Editing ● Media Transcoding ● Metadata Indexing and Thumbnailing Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  11. GStreamer - Framework Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  12. Media Playback ● MeeGo OS: ● GStreamer playbin2 ● GStreamer components for streaming, parsing, demuxing and rendering ● Vendor specific: ● Hw accelerated codecs Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  13. VoIP / Video Call ● MeeGo OS: ● Telepathy ● Lots of GStreamer components ● Vendor specific: ● Accelerated voice and video codecs Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  14. Camera Still and Video capture ● MeeGo OS: ● GStreamer camerabin ● GStreamer elements for format conversion, metadata (XMP, EXIF), muxing, data routing ● Vendor specific: ● Camera source :/ ● Accelerated video and image encoders Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  15. Video Editing ● MeeGo OS: ● GStreamer gnonlin ● GStreamer components for muxing, demuxing, format conversion, … ● Vendor Specific ● Accelerated codecs Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  16. Metadata Indexing & Thumbnailing ● MeeGo Core OS: ● Tagreadbin (experimental) ● GStreamer components for parsing, demuxing ● Vendor specific: ● nothing Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  17. Hot Topics ● s/XVideoOverlays/TextureStreaming/ ? ● Bitstream passthrough ● Camera APIs ● Performance optimizations ● Accelerated Codecs & Filters ● Easy to use high level APIs Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  18. Hot Topic – Video Rendering ● Xvideo interface is getting old ● Inherent memcpy ● Hard to integrate with alpha in Uis ● Classic GL is not well suited either ● Texture upload ● Texture streaming needed Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  19. Hot Topic – Bitstream passthrough ● GStreamer normally renders RAW A/V locally ● Remote devices can also decode ● BT Headsets, HDMI TV, SPDIF → Receiver ● Initial support in PulseAudio from Intel ● GStreamers playbin2 needs work Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  20. Hot Topic – Camera APIs ● Phone cameras != USB webcams ● V4l2 needs to abstract features better ● Lots of work on GStreamers camerabin(2) Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  21. Hot Topic - Performance ● better performance = longer use time ● camera recording, music/video playback, call ● locking is slow on ARM ● overhead for audio part in calls ● low memory footprint = more stuff cached Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  22. Hot Topic – Accelerated Plugins ● Software Codecs and Filters ● GStreamer uses ORC to enable CPU SIMD use ● OpenCL would be interesting for GPU use Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  23. Hot Topic – Hight Level API ● Qt Mobility Multimedia ● Mediaplayer API ● Audiocapture API ● Camera API ● More feedback needed http://doc.qt.nokia.com/qtmobility-1.0/multimedia.html Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

  24. Thanks ! Any Questions ? Dr. Stefan Kost – Nokia - The MeeGo Multimedia Stack - CELF Embedded Linux Conference Europe

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Chapter 1 Introduction to Multimedia 1.1 What is Multimedia? 1.2 Multimedia and Hypermedia 1.3

Chapter 1 Introduction to Multimedia 1.1 What is Multimedia? 1.2 Multimedia and Hypermedia 1.3

Fundamentals of Multimedia, Chapter 1 Chapter 1 Introduction to Multimedia 1.1 What is Multimedia? 1.2 Multimedia and Hypermedia 1.3 World Wide Web 1.4 Overview of Multimedia Software Tools 1.5 Further Exploration 1 Li & Drew c

388 views • 18 slides
Multimedia Information Retrieval 1 What is multimedia information retrieval? 2 Basic Multimedia

Multimedia Information Retrieval 1 What is multimedia information retrieval? 2 Basic Multimedia

Multimedia Information Retrieval 1 What is multimedia information retrieval? 2 Basic Multimedia Search Technologies 3 Evaluation of MIR Systems 4 Added Value user interaction, visualisation and the MIR research landscape Multimedia

491 views • 26 slides
1 What is multimedia information retrieval? 1.1 Information retrieval 1.2 Multimedia 1.3

1 What is multimedia information retrieval? 1.1 Information retrieval 1.2 Multimedia 1.3

1 What is multimedia information retrieval? 1.1 Information retrieval 1.2 Multimedia 1.3 Semantic Gap? 1.4 Challenges of automated multimedia indexing 2 Basic multimedia search technologies 2.1 Meta-data driven retrieval 2.2 Piggy-back text

902 views • 56 slides
Streaming Multimedia Applications Multimedia Networking Multimedia Applications? What are

Streaming Multimedia Applications Multimedia Networking Multimedia Applications? What are

Streaming Multimedia Applications Multimedia Networking Multimedia Applications? What are they? An application that deals with one of more of the following data types: Text Images Audio Video Most common scenario

742 views • 62 slides
Multimedia Applications Multimedia Applications Srinidhi Varadarajan Multimedia Applications

Multimedia Applications Multimedia Applications Srinidhi Varadarajan Multimedia Applications

Multimedia Applications Multimedia Applications Srinidhi Varadarajan Multimedia Applications Multimedia Applications Multimedia requirements Streaming Phone over IP Recovering from Jitter and Loss RTP Diff-serv, Int-serv,

483 views • 27 slides
Distributed Multimedia Systems 8. Multimedia Applications Multimedia Applications - 1 Lszl

Distributed Multimedia Systems 8. Multimedia Applications Multimedia Applications - 1 Lszl

Distributed Multimedia Systems 8. Multimedia Applications Multimedia Applications - 1 Lszl Bszrmnyi Distributed Multimedia Systems Application Categorization Market-oriented view Kiosk, educational, cooperative work

694 views • 13 slides
Multimedia Systems Definition of Multimedia System A Multimedia System is a system capable of

Multimedia Systems Definition of Multimedia System A Multimedia System is a system capable of

MMGD0101 INTRODUCTION TO MULTIMEDIA Chapter 2 Multimedia Systems Definition of Multimedia System A Multimedia System is a system capable of processing multimedia data and applications. It is characterized by the processing, storage,

578 views • 16 slides
Stack and Queue Stack Overview Stack ADT Basic operations of stack Pushing, popping

Stack and Queue Stack Overview Stack ADT Basic operations of stack Pushing, popping

Stack and Queue Stack Overview Stack ADT Basic operations of stack Pushing, popping etc. Implementations of stacks using array linked list The Stack ADT A stack is a list with the restriction that insertions and

566 views • 44 slides
The Stack Eric McCreath The Stack The stack is a simple but useful data structure in computer

The Stack Eric McCreath The Stack The stack is a simple but useful data structure in computer

The Stack Eric McCreath The Stack The stack is a simple but useful data structure in computer science. The stack is an abstract data type that has two main operations. These are push which adds an element to the top of the stack and pop which

754 views • 8 slides
Stack ADT Tiziana Ligorio 1 Todays Plan Questons? Stack ADT 2 Abstract Data Types

Stack ADT Tiziana Ligorio 1 Todays Plan Questons? Stack ADT 2 Abstract Data Types

Stack ADT Tiziana Ligorio 1 Todays Plan Questons? Stack ADT 2 Abstract Data Types Bag List Stack 3 Stack 34 A data structure representing a stack of things Objects can be pushed onto the stack or popped from the stack

1.62k views • 116 slides
1 Array-based Stack (2.1.1) Algorithm pop (): if isEmpty () then A simple way of throw

1 Array-based Stack (2.1.1) Algorithm pop (): if isEmpty () then A simple way of throw

Elementary Data Structures Stacks, Queues, Vectors, Lists & Sequences Trees The Stack ADT (2.1.1) The Stack ADT stores arbitrary objects Insertions and deletions Auxiliary stack follow the last-in first-out operations: scheme

473 views • 13 slides
Multimedia Indexation Titus ZAHARIA, Pr. Titus.Zaharia@telecom-sudparis.eu Multimedia indexation

Multimedia Indexation Titus ZAHARIA, Pr. Titus.Zaharia@telecom-sudparis.eu Multimedia indexation

Multimedia Indexation Titus ZAHARIA, Pr. Titus.Zaharia@telecom-sudparis.eu Multimedia indexation Interactive multimedia Still i mage Video Audio Graphics (2D/3D, static or animated) Tera-bytes of digital AV data Multimedia

941 views • 70 slides
ADT Stack 1 Stacks of Coins and Plates 2 Stacks of Rocks and Books TOP OF THE STACK TOP OF

ADT Stack 1 Stacks of Coins and Plates 2 Stacks of Rocks and Books TOP OF THE STACK TOP OF

ADT Stack 1 Stacks of Coins and Plates 2 Stacks of Rocks and Books TOP OF THE STACK TOP OF THE STACK Add, remove rock and book from the top, or else 3 Stack at logical level A stack is an ADT in which elements add added and

1.06k views • 37 slides
ADT Stack 1 Stacks of Coins and Plates 2 Stacks of Rocks and Books TOP OF THE STACK TOP OF

ADT Stack 1 Stacks of Coins and Plates 2 Stacks of Rocks and Books TOP OF THE STACK TOP OF

ADT Stack 1 Stacks of Coins and Plates 2 Stacks of Rocks and Books TOP OF THE STACK TOP OF THE STACK Add, remove rock and book from the top, or else 3 Stack at logical level A stack is an ADT in which elements add added and

679 views • 19 slides
Call Stack Stack Bottom Memory region managed with stack discipline Procedures and the Call

Call Stack Stack Bottom Memory region managed with stack discipline Procedures and the Call

Call Stack Stack Bottom Memory region managed with stack discipline Procedures and the Call Stack higher %rsp holds lowest stack address addresses (address of "top" element) Topics stack grows Procedures toward lower

76 views • 5 slides
Stack 7 January 2019 OSU CSE 1 Stack The Stack component family allows you to manipulate

Stack 7 January 2019 OSU CSE 1 Stack The Stack component family allows you to manipulate

Stack 7 January 2019 OSU CSE 1 Stack The Stack component family allows you to manipulate strings of entries of any (arbitrary) type in LIFO (last-in-first-out) order A kind of dual to Queue Remember, "first" and

450 views • 33 slides
Architecture and evolution of the modern web browser Alan Grosskurth, Michael W. Godfrey David

Architecture and evolution of the modern web browser Alan Grosskurth, Michael W. Godfrey David

Architecture and evolution of the modern web browser Alan Grosskurth, Michael W. Godfrey David R. Cheriton School of Computer Science, University of Waterloo, Waterloo, ON N2L 3G1, Canada Abstract A reference architecture for a domain captures

466 views • 24 slides
Accessib ibil ilit ity a and Library W Websi sites: s: What You N Need eed to Kn Know

Accessib ibil ilit ity a and Library W Websi sites: s: What You N Need eed to Kn Know

Accessib ibil ilit ity a and Library W Websi sites: s: What You N Need eed to Kn Know Lauren Douglass, East Lansing Public Library Sonya Schryer Norris, Library of Michigan Febru ruary ry 6, 2018 Febru ruary ry 7, 2018

621 views • 43 slides
Some more XML applications and XML-related standards (XLink, XPointer, XForms) Patryk Czarnik

Some more XML applications and XML-related standards (XLink, XPointer, XForms) Patryk Czarnik

Some more XML applications and XML-related standards (XLink, XPointer, XForms) Patryk Czarnik XML and Applications 2014/2015 Lecture 12 19.01.2015 Standards for inter-document relations XPointer addressing documents and their

1k views • 22 slides
Fo ForeGraph: Exp xploring Large-sca scale Graph Proce cessi ssing on on Mul ulti-FP FPGA

Fo ForeGraph: Exp xploring Large-sca scale Graph Proce cessi ssing on on Mul ulti-FP FPGA

Fo ForeGraph: Exp xploring Large-sca scale Graph Proce cessi ssing on on Mul ulti-FP FPGA Arch chitect cture Guohao Dai 1 , Tianhao Huang 1 , Yuze Chi 2 , Ningyi Xu 3 , Yu Wang 1 , Huazhong Yang 1 1 Tsinghua University, 2 UCLA, 3 MSRA

1.02k views • 35 slides
Attribute Plugin for areaDetector Garth Brown, Kukhee Kim for Camera Team EPICS Collaboration

Attribute Plugin for areaDetector Garth Brown, Kukhee Kim for Camera Team EPICS Collaboration

EPICS Collaboration Meeting, Spring 2015 Time Source Callback and Attribute Plugin for areaDetector Garth Brown, Kukhee Kim for Camera Team EPICS Collaboration Meeting, Spring 2015 Abstract Timestamp tagging to data and aligning data to

303 views • 19 slides
Authenticating Micro-controllers P . Schaumont Bradley Department of Electrical and Computer

Authenticating Micro-controllers P . Schaumont Bradley Department of Electrical and Computer

Introduction Preliminaries Authentication Signing Outlook Authenticating Micro-controllers P . Schaumont Bradley Department of Electrical and Computer Engineering Virginia Tech Blacksburg, VA Design and Security of Cryptographic

752 views • 41 slides
Mayday RLink The best of both worlds Florian Battke , Stephan Symons, Kay Nieselt

Mayday RLink The best of both worlds Florian Battke , Stephan Symons, Kay Nieselt

Mayday RLink The best of both worlds Florian Battke , Stephan Symons, Kay Nieselt battke@informatik.uni-tuebingen.de July 8, 2009 1 Outline Outline Motivation 1 Design 2 Implementation 3 Evaluation 4 Outlook 5 2 Motivation

652 views • 49 slides
An embedded C++ domain-specific language for stream parallelism Authors : Dalvan Griebler 1 , 2 ,

An embedded C++ domain-specific language for stream parallelism Authors : Dalvan Griebler 1 , 2 ,

Introduction DSL Interface Implementation Results Related Work Conclusions References An embedded C++ domain-specific language for stream parallelism Authors : Dalvan Griebler 1 , 2 , Marco Danelutto 2 , Massimo Torquati 2 , Luiz Gustavo

611 views • 22 slides

More recommend