Distributed Multimedia Systems 8. Multimedia Applications - PowerPoint PPT Presentation

Distributed Multimedia Systems 8. Multimedia Applications Multimedia Applications - 1 László Böszörményi Distributed Multimedia Systems

Application Categorization • Market-oriented view – Kiosk, educational, cooperative work applications • Communication-oriented view – Interactive or distribution-oriented applications • “Media food chain” – Preparation – Composition – Integration – Communication – Consumption – Entertainment Multimedia Applications - 2 László Böszörményi Distributed Multimedia Systems

Media Preparation • Multimedia I/O hardware + software • Audio support – Multiple-channel digital sound tracks, interaction via helmet • Video support – Video board + digitizers (up to 60 fps HDTV) – Graphical displays • Normal, head-mounted, surrounded displays, holography • Scanner devices – Image scanners, photo scanners (>2000 pixels/inch) • Recognition devices • Tracking devices Multimedia Applications - 3 László Böszörményi Distributed Multimedia Systems

Media Composition: Text,Graphics, Image • Text editors – Fonts, text styles, text effects, graphical capabilities – E.g. MS Word, CorelDRAW, MacDraw … • Graphics editors (2D, 3D) – Manipulate on mathematical representations • Image editors (e.g. xv) – manipulate on pixels – Pixel replication – Sampling and filtering (high frequencies) – Aliasing (instead filtering: high → low frequencies) – Anti-aliasing (to smooth staircasing) – Increase of resolution, change intensity, color … • Image + graphics combined – E.g. Photoshop (Adobe), PhotoStyler (Aldus) Multimedia Applications - 4 László Böszörményi Distributed Multimedia Systems

Media Composition: Animation • Animation editors (4D) – Manipulate mathematical representations – Additional dimension: time – Tweening • The intermediate frames are automatically generated from the key frame – Morphing (polymorphic tweening) • Transforms a shape into another shape (in The Lion King) – Temporal anti-aliasing (smoothing staircasing in time) • Animation tools – Integrate a number of media editors – E.g. Gold Disc: Movie + Cel + background editor Multimedia Applications - 5 László Böszörményi Distributed Multimedia Systems

Media Composition: Sound • Sound editors – Locating and storing sounds • Record, read from file, retrieve from pasteboard, create – Recording and playback • 8000 samples/sec, 12 bit precision, compression to 8 bits – Editing • Copy/paste, cut, delete, insert, replace • Fragmented sound data must be compacted, otherwise playback may suffer under inefficiency – E.g. MIDI-editors • Allow e.g. to synthesize orchestral music – Music synthesis, special effects (e.g. hall echos) • Hardware support by DSPs (digital signal processor) Multimedia Applications - 6 László Böszörményi Distributed Multimedia Systems

Media Composition: Video • Video editors – Individual frames can be edited as in image editors – Temporal aspects as in animation editing – E.g. combine several cuts into a sequence etc. – E.g VidEdit, D/Vision Pro • Video book – FH Joanneum Graz – The one-dimensional time line is made visible in the two-dimensional space – Book paradigm – A whole film can be presented on a few pages Multimedia Applications - 7 László Böszörményi Distributed Multimedia Systems

Media Integration • Multimedia editors – Integrate all kind of data – Unified view, coordinated control, multiple buffers, light-weight windows (panes) – Extremely large documents, often partitioned – E.g. Diamond Multimedia Editor (Diamond) • Hypermedia / Hypertext Editors (HTML, SGML) – Multimedia combined with non-linear links – E.g. Hypercard (Macintosh), DynaText (Sun), NoteCard (Xerox PARC), Hyper-G (TU Graz) • Authoring tools – E.g. PowerPoint, MovieWorks (QuickTime) Multimedia Applications - 8 László Böszörményi Distributed Multimedia Systems

Media Communication: Interactive • Conversational service – Synchronous communication, e.g. video conference • Messaging service – Asynchronous communication, e.g. blackboard • Retrieval service – Database queries • Tele-action, tele-operation service – Alarm and surveillance – Transaction processing, business automation – Control and command (tele-metry), utility resource management Multimedia Applications - 9 László Böszörményi Distributed Multimedia Systems

Media Communication: Distribution • Pay-per-view – Set-top decoder box • Video-on-demand (VOD) • Near video-on-demand – Compromises broadcasting and VOD • Interactive TV, Cyber Vision – The user may change the content or at least the flow Multimedia Applications - 10 László Böszörményi Distributed Multimedia Systems

Media Consumption • Browsing, navigation, displaying, annotation • Books, proceedings, newspapers – Customized access possible • Kiosks – Airport, train station, bank assistant, cinema information, real-estate catalogue, university, museum showcase etc. – Fast response is necessary • Tele-shopping Multimedia Applications - 11 László Böszörményi Distributed Multimedia Systems

Media Entertainment • Virtual Reality • Interactive TV • Video-on-demand • Interactive Audio – User may enter the music scene • Games • Tele-games Multimedia Applications - 12 László Böszörményi Distributed Multimedia Systems

Trends • New application domains – instead of just “reengineering” of old ones • Multi-user applications • Personalized user environment (active books) • Distributed environments • Open solutions running on many platforms • Interactive applications – instead of passive consumption • Bi-directional communication services – instead of unidirectional communication • ? ? ? Multimedia Applications - 13 László Böszörményi Distributed Multimedia Systems