Object-Based Audio In Programme Making Chris Pike BBC R&D - - PowerPoint PPT Presentation

object based audio in programme making
SMART_READER_LITE
LIVE PREVIEW

Object-Based Audio In Programme Making Chris Pike BBC R&D - - PowerPoint PPT Presentation

flexible,and responsive to user, environmental and platform specific factors. Object-Based Audio In Programme Making Chris Pike BBC R&D flexible,and responsive to user, environmental and platform specific factors. What is Object-Based


slide-1
SLIDE 1

Object-Based Audio In Programme Making

Chris Pike

BBC R&D

flexible,and responsive to user, environmental and platform specific factors.
slide-2
SLIDE 2

What is Object-Based Broadcasting?

flexible,and responsive to user, environmental and platform specific factors.
slide-3
SLIDE 3

Object-Based Broadcasting

flexible,and responsive to user, environmental and platform specific factors.
slide-4
SLIDE 4 flexible,and responsive to user, environmental and platform specific factors.

Why Object-Based Broadcasting?

slide-5
SLIDE 5 flexible,and responsive to user, environmental and platform specific factors.

O b j e c t

  • B

a s e d B r

  • a

d c a s t i n g

Accessible Personalised Immersive Interactive

flexible,and responsive to user, environmental and platform specific factors.

Immersive Personalised Interactive

New Content Experiences

Accessible

slide-6
SLIDE 6 flexible,and responsive to user, environmental and platform specific factors.

RESPONSIVE AUDIO CONTENT

slide-7
SLIDE 7 flexible,and responsive to user, environmental and platform specific factors.

Object-based audio is recommended for the advance sound system for programme production by the ITU.

slide-8
SLIDE 8 flexible,and responsive to user, environmental and platform specific factors.

Applications of Object-Based Broadcasting

slide-9
SLIDE 9

Object-Based Broadcasting

User experiences - Immersive

flexible,and responsive to user, environmental and platform specific factors.
slide-10
SLIDE 10 flexible,and responsive to user, environmental and platform specific factors.

Object-Based Broadcasting

User experiences - Immersive

slide-11
SLIDE 11 flexible,and responsive to user, environmental and platform specific factors.

Object-Based Production System Object-Based Rendering

audio +
 meta-data

Stereo 5.1 3D multichannel Binaural

Object-Based Broadcasting

User experiences - Immersive

?

slide-12
SLIDE 12

Object-Based Broadcasting

User experiences - Accessible

flexible,and responsive to user, environmental and platform specific factors.
slide-13
SLIDE 13 flexible,and responsive to user, environmental and platform specific factors.
  • to-end
  • the player’s user interface.
  • Trial Set-up

User experiences - Accessible

BBC White Paper WHP272: Object-Based Audio Applied to Football Broadcasts:
 The 5 live Football Experiment 2013

slide-14
SLIDE 14 flexible,and responsive to user, environmental and platform specific factors. 55% 22% 9% 5% 8% Much better Slightly better About the same Slightly worse Much worse

How would you rate the experience compared to traditional radio broadcast?

BBC White Paper WHP272: Object-Based Audio Applied to Football Broadcasts:
 The 5 live Football Experiment 2013

Audience Feedback

User experiences - Accessible

slide-15
SLIDE 15

Object-Based Broadcasting

User experiences - Personalised

flexible,and responsive to user, environmental and platform specific factors.

Radio Player

slide-16
SLIDE 16

Object-Based Broadcasting

Responsive Radio

flexible,and responsive to user, environmental and platform specific factors.
  • Adjust programme length
  • Dialog enhancement
  • Foreground/background

balance

  • Pause with 


background music

Radio Player Radio Player

slide-17
SLIDE 17 flexible,and responsive to user, environmental and platform specific factors.
slide-18
SLIDE 18 flexible,and responsive to user, environmental and platform specific factors.
slide-19
SLIDE 19 flexible,and responsive to user, environmental and platform specific factors.

Audience responses

Variable-length programme

slide-20
SLIDE 20 flexible,and responsive to user, environmental and platform specific factors.

Audience responses

Variable-length programme

slide-21
SLIDE 21 flexible,and responsive to user, environmental and platform specific factors.

Object-Based Broadcasting

Responsive Radio

  • A graph represents the

narrative and the structure of the programme.

  • This is linked to the

media elements and the narrative constrains curated by the programme maker.

slide-22
SLIDE 22 flexible,and responsive to user, environmental and platform specific factors.

Media Atoms Player Assets Graph Database Server

Narrative Algorithms Multichannel Rendering User Interface

Browser

Object-Based Broadcasting

Responsive Radio

  • The media objects of the

programme are delivered to the browser which assembles it based

  • n the preferences of the listener.
  • The programme becomes

responsive to the listener and their preferences.

slide-23
SLIDE 23

Object-Based Broadcasting

User experiences - Interactive

flexible,and responsive to user, environmental and platform specific factors.
slide-24
SLIDE 24

Object-Based Broadcasting

User experiences - Interactive

flexible,and responsive to user, environmental and platform specific factors.
slide-25
SLIDE 25

Object-Based Broadcasting

User experiences - Interactive

flexible,and responsive to user, environmental and platform specific factors.
slide-26
SLIDE 26

Object-Based Broadcasting

User experiences - Interactive

flexible,and responsive to user, environmental and platform specific factors.
slide-27
SLIDE 27

Object-Based Broadcasting

User experiences - Interactive

flexible,and responsive to user, environmental and platform specific factors.
slide-28
SLIDE 28 flexible,and responsive to user, environmental and platform specific factors.
slide-29
SLIDE 29 flexible,and responsive to user, environmental and platform specific factors.
slide-30
SLIDE 30 flexible,and responsive to user, environmental and platform specific factors.
slide-31
SLIDE 31 flexible,and responsive to user, environmental and platform specific factors.

Preview Preview

slide-32
SLIDE 32 flexible,and responsive to user, environmental and platform specific factors.

Preview

slide-33
SLIDE 33 flexible,and responsive to user, environmental and platform specific factors.

Challenges of Object-Based Broadcasting

slide-34
SLIDE 34 flexible,and responsive to user, environmental and platform specific factors.

Conceptual challenge: the renderer A transformational change

slide-35
SLIDE 35 flexible,and responsive to user, environmental and platform specific factors.

Implementation challenge: scalability and sustainability

slide-36
SLIDE 36 flexible,and responsive to user, environmental and platform specific factors.

Object-based audio under discussion

slide-37
SLIDE 37 flexible,and responsive to user, environmental and platform specific factors.

The ITU has recommended a metadata model for object-based audio. The Audio Definition Model (ADM) can be used to store advanced sound formats using the broadcast wave file (BWF). Ongoing work in WP6B. BBC R&D has developed a reference software - available as open source. http://www.bbc.co.uk/rd/publications/ audio-definition-model-software

slide-38
SLIDE 38

Implementation challenges

Production

  • Production formats (stream and file)
  • Production environments (monitoring, quality control, baseline renderer)
  • Workflows and tools (production on scale)
  • Interfaces to existing systems


Delivery

  • Codecs and delivery mechanisms
  • Interfaces


Consumption

  • Platform (reproduction, user interaction, environment)
  • Devices
flexible,and responsive to user, environmental and platform specific factors.
slide-39
SLIDE 39 flexible,and responsive to user, environmental and platform specific factors.

Object-Based Broadcasting

  • Enables new user experiences, ranging from traditional broadcasting to

interactive experiences

  • Object-based broadcasting has the potential to be transformational
  • Technology and standards are emerging
  • Tools are required to create and evaluate the content
  • Editorial control is more important then ever
slide-40
SLIDE 40 flexible,and responsive to user, environmental and platform specific factors.

Thank you!

chris.pike@bbc.co.uk