Audiovisual Compression: from Basics to Systems, Fernando Pereira
MPEG-4 Standards
Fernando Pereira Klagenfurt, Austria, October 2008
MPEG MPEG-
- 4 Standards
MPEG- -4 Standards 4 Standards MPEG-4 Standards MPEG Fernando - - PowerPoint PPT Presentation
MPEG- -4 Standards 4 Standards MPEG-4 Standards MPEG Fernando Pereira Fernando Pereira Fernando Pereira Klagenfurt, Austria, October 2008 Klagenfurt, Austria, October 2008 Audiovisual Compression: from Basics to Systems, Fernando Pereira
Audiovisual Compression: from Basics to Systems, Fernando Pereira
Audiovisual Compression: from Basics to Systems, Fernando Pereira
lines
Audiovisual Compression: from Basics to Systems, Fernando Pereira
networks
Audiovisual Compression: from Basics to Systems, Fernando Pereira
a wide range of access conditions
new ways
communications, retrieval Demands come from users, producers and providers !
Audiovisual Compression: from Basics to Systems, Fernando Pereira
Audiovisual Compression: from Basics to Systems, Fernando Pereira
synthetic, text & graphics, animated faces, arbitrary and rectangular video shapes, generic 3D, speech and music, ...
bitrates to (virtually) lossless quality …
Audiovisual Compression: from Basics to Systems, Fernando Pereira
Sports results: Benfica - Sporting Sports results: Benfica - Sporting Stock information ... Stock information ...
Audiovisual Compression: from Basics to Systems, Fernando Pereira
demultiplexer sync & multiplexer enc. enc. dec. dec. compositor
Audiovisual Compression: from Basics to Systems, Fernando Pereira
demultiplexer sync & multiplexer enc. enc.
Comp. enc.
Comp. Comp. Info Info
dec. dec.
Comp. dec.
compositor
Audiovisual Compression: from Basics to Systems, Fernando Pereira
demultiplexer sync & multiplexer
AV objects AV objects coded coded
AV objects AV objects uncoded uncoded
enc. enc.
Comp. enc.
Comp. Comp. Info Info
dec. dec.
Comp. dec.
compositor
dec.
AV objects AV objects coded coded
Audiovisual Compression: from Basics to Systems, Fernando Pereira
demultiplexer sync & multiplexer
AV objects AV objects coded coded
AV objects AV objects uncoded uncoded
enc. enc.
Comp. enc.
Comp. Comp. Info Info
dec. dec.
Comp. dec.
compositor
dec.
AV objects AV objects coded coded
interaction interaction
Audiovisual Compression: from Basics to Systems, Fernando Pereira
a semantic value to the data structure
content, both aural and visual
using and manipulation capabilities
and personalisation
between Video Coding, Computer Vision and Computer Graphics
Audiovisual Compression: from Basics to Systems, Fernando Pereira
Visual Object Segment.
Visual Object 0 Encoder Visual Object 1 Encoder Visual Object N Encoder Visual Object 2 Encoder Visual Object 0 Decoder Visual Object 1 Decoder Visual Object N Decoder Visual Object 2 Decoder
Compo- sitor
Multiplexer Demultiplexer ... ...
Composition inform. Composition inform.
Audiovisual Compression: from Basics to Systems, Fernando Pereira
Coded shape bitstream Coded texture bitstream
Shape decoding Motion decoding
Coded motion bitstream
Variable length decoding Inverse scan Inverse quantization Inverse DCT
Motion compensation
Previous reconstructed VOP
Demultiplexer
video_object_layer_shape
Texture Decoding Texture Decoding
VOP reconstruction
Inverse AC/DC prediction
Decoded VOP
Audiovisual Compression: from Basics to Systems, Fernando Pereira
Audiovisual Compression: from Basics to Systems, Fernando Pereira
Audiovisual Compression: from Basics to Systems, Fernando Pereira
Audiovisual Compression: from Basics to Systems, Fernando Pereira
Audiovisual Compression: from Basics to Systems, Fernando Pereira
Audiovisual Compression: from Basics to Systems, Fernando Pereira
environments, to very high quality conditions;
range, notably from transparent music to very low bitrate speech;
some more specific 3D objects such as human faces and bodies;
well as 3D audio spaces;
involved, notably in view of critical channel conditions;
Audiovisual Compression: from Basics to Systems, Fernando Pereira
visual objects, allowing to independently access, manipulate and re- use these objects;
audiovisual scene;
authorised users can consume it.
Audiovisual Compression: from Basics to Systems, Fernando Pereira
The MP4 file format defines the storage of MPEG-4 audio, scenes and multimedia content using the ISO Base Media File Format. The MP4 file format is life-cycle file format—one in which the files can be used when capturing media, editing it, and combining it; when serving the media as a file download or as a stream; and when exchanging partial or complete presentations.
Audiovisual Compression: from Basics to Systems, Fernando Pereira
which have a size and a type. The type field is usually four printable characters.
‘multi-purpose’ files which contain the boxes required by more than one
2000 file format family, which for the most part is a still-image file format.
information for timed presentations of media data such as audio, video, etc. This structure is intentionally general, so that by structuring files in different ways the same base specification can be used for files for
scene and associated object descriptions like in the MP4 file format.
Audiovisual Compression: from Basics to Systems, Fernando Pereira
Audiovisual Compression: from Basics to Systems, Fernando Pereira
customization of content
customization of screen layout based on:
content-based AV events, language, complex user defined criteria, …
Audiovisual Compression: from Basics to Systems, Fernando Pereira
Audiovisual Compression: from Basics to Systems, Fernando Pereira
Audiovisual Compression: from Basics to Systems, Fernando Pereira
Audiovisual Compression: from Basics to Systems, Fernando Pereira
There are two Parts in the MPEG-4 standard dealing with video coding:
Part 2: Visual (1998) – Specifies several coding tools targeting the efficient and error resilient of video, including arbitrarily shaped video; it also includes coding of 3D faces and bodies.
Part 10: Advanced Video Coding (AVC) (2003) – Specifies more efficient (about 50%) and more resilient frame based video coding tools; this Part has been jointly developed by ISO/IEC MPEG and ITU-T through the Joint Video Team (JVT) and it is often known as H.264/AVC. Each of these 2 Parts specifies several profiles with different video coding functionalities and compression efficiency versus complexity trade-
Audiovisual Compression: from Basics to Systems, Fernando Pereira
Simple and Advanced Simple are the most used MPEG
Visual profiles ! Simple and Advanced Simple are the most used MPEG
Visual profiles !
H.263 standard with the addition of some error resilience tools. There are many products in the market using this profile, notably video cameras.
uses also global and ¼ pel motion compensation and allows to code interlaced video.
Audiovisual Compression: from Basics to Systems, Fernando Pereira
notably an object-based coding architecture.
audio codecs, notably for natural and synthetic content.
the scene.
production, it is still not much used in the content available to the users, either stored or transmitted.
Part 2, Visual leading to the emerging H.264/AVC (Advanced Video Coding) standard.
Audiovisual Compression: from Basics to Systems, Fernando Pereira
Hall, 2002
Wiley & Sons, 2003