Distributed Multimedia Systems 8. Multimedia Applications - - PowerPoint PPT Presentation

László Böszörményi Distributed Multimedia Systems Multimedia Applications - 1

Distributed Multimedia Systems

• 8. Multimedia Applications

László Böszörményi Distributed Multimedia Systems Multimedia Applications - 2

Application Categorization

• Market-oriented view

– Kiosk, educational, cooperative work applications

• Communication-oriented view

– Interactive or distribution-oriented applications

• “Media food chain”

– Preparation – Composition – Integration – Communication – Consumption – Entertainment

László Böszörményi Distributed Multimedia Systems Multimedia Applications - 3

Media Preparation

• Multimedia I/O hardware + software
• Audio support

– Multiple-channel digital sound tracks, interaction via helmet

• Video support

– Video board + digitizers (up to 60 fps HDTV) – Graphical displays

• Normal, head-mounted, surrounded displays, holography
• Scanner devices

– Image scanners, photo scanners (>2000 pixels/inch)

• Recognition devices
• Tracking devices

László Böszörményi Distributed Multimedia Systems Multimedia Applications - 4

Media Composition: Text,Graphics, Image

• Text editors

– Fonts, text styles, text effects, graphical capabilities – E.g. MS Word, CorelDRAW, MacDraw …

• Graphics editors (2D, 3D)

– Manipulate on mathematical representations

• Image editors (e.g. xv) – manipulate on pixels

– Pixel replication – Sampling and filtering (high frequencies) – Aliasing (instead filtering: high → low frequencies) – Anti-aliasing (to smooth staircasing) – Increase of resolution, change intensity, color …

• Image + graphics combined

– E.g. Photoshop (Adobe), PhotoStyler (Aldus)

László Böszörményi Distributed Multimedia Systems Multimedia Applications - 5

Media Composition: Animation

• Animation editors (4D)

– Manipulate mathematical representations – Additional dimension: time – Tweening

• The intermediate frames are automatically generated from

the key frame

– Morphing (polymorphic tweening)

• Transforms a shape into another shape (in The Lion King)

– Temporal anti-aliasing (smoothing staircasing in time)

• Animation tools

– Integrate a number of media editors – E.g. Gold Disc: Movie + Cel + background editor

László Böszörményi Distributed Multimedia Systems Multimedia Applications - 6

Media Composition: Sound

• Sound editors

– Locating and storing sounds

• Record, read from file, retrieve from pasteboard, create

– Recording and playback

• 8000 samples/sec, 12 bit precision, compression to 8 bits

– Editing

• Copy/paste, cut, delete, insert, replace
• Fragmented sound data must be compacted, otherwise

playback may suffer under inefficiency

– E.g. MIDI-editors

• Allow e.g. to synthesize orchestral music

– Music synthesis, special effects (e.g. hall echos)

• Hardware support by DSPs (digital signal processor)

László Böszörményi Distributed Multimedia Systems Multimedia Applications - 7

Media Composition: Video

• Video editors

– Individual frames can be edited as in image editors – Temporal aspects as in animation editing – E.g. combine several cuts into a sequence etc. – E.g VidEdit, D/Vision Pro

• Video book

– FH Joanneum Graz – The one-dimensional time line is made visible in the two-dimensional space – Book paradigm – A whole film can be presented on a few pages

László Böszörményi Distributed Multimedia Systems Multimedia Applications - 8

Media Integration

• Multimedia editors

– Integrate all kind of data – Unified view, coordinated control, multiple buffers, light-weight windows (panes) – Extremely large documents, often partitioned – E.g. Diamond Multimedia Editor (Diamond)

• Hypermedia / Hypertext Editors (HTML, SGML)

– Multimedia combined with non-linear links – E.g. Hypercard (Macintosh), DynaText (Sun), NoteCard (Xerox PARC), Hyper-G (TU Graz)

• Authoring tools

– E.g. PowerPoint, MovieWorks (QuickTime)

László Böszörményi Distributed Multimedia Systems Multimedia Applications - 9

Media Communication: Interactive

• Conversational service

– Synchronous communication, e.g. video conference

• Messaging service

– Asynchronous communication, e.g. blackboard

• Retrieval service

– Database queries

• Tele-action, tele-operation service

– Alarm and surveillance – Transaction processing, business automation – Control and command (tele-metry), utility resource management

László Böszörményi Distributed Multimedia Systems Multimedia Applications - 10

Media Communication: Distribution

• Pay-per-view

– Set-top decoder box

• Video-on-demand (VOD)
• Near video-on-demand

– Compromises broadcasting and VOD

• Interactive TV, Cyber Vision

– The user may change the content or at least the flow

László Böszörményi Distributed Multimedia Systems Multimedia Applications - 11

Media Consumption

• Browsing, navigation, displaying, annotation
• Books, proceedings, newspapers

– Customized access possible

• Kiosks

– Airport, train station, bank assistant, cinema information, real-estate catalogue, university, museum showcase etc. – Fast response is necessary

• Tele-shopping

László Böszörményi Distributed Multimedia Systems Multimedia Applications - 12

Media Entertainment

• Virtual Reality
• Interactive TV
• Video-on-demand
• Interactive Audio

– User may enter the music scene

• Games
• Tele-games

László Böszörményi Distributed Multimedia Systems Multimedia Applications - 13

Trends

• New application domains

– instead of just “reengineering” of old ones

• Multi-user applications
• Personalized user environment (active books)
• Distributed environments
• Open solutions running on many platforms
• Interactive applications

– instead of passive consumption

• Bi-directional communication services

– instead of unidirectional communication

• ? ? ?