Toolkit for Smart Documentary Production 28. FKTG Fachtagung 2018 - - PowerPoint PPT Presentation

▶
toolkit for smart documentary production
SMART_READER_LITE
LIVE PREVIEW

Toolkit for Smart Documentary Production 28. FKTG Fachtagung 2018 - - PowerPoint PPT Presentation

Nov 19, 2023 328 likes •1.06k views

PeRsOnalized DocUmentary Creation based on Automatically Annotated Content Toolkit for Smart Documentary Production 28. FKTG Fachtagung 2018 Project funded by the Horizon2020 in topic ICT 21-2016: 1 Grant Agreement #731893

slide-1
SLIDE 1

“PeRsOnalized DocUmentary Creation based on Automatically

Annotated Content”

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893

Toolkit for Smart Documentary Production

1

  • 28. FKTG Fachtagung 2018
slide-2
SLIDE 2 Producer – GA: 731893

Was genau bedeutet das?

2

… dazu gleich mehr… ;)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-3
SLIDE 3 Producer – GA: 731893

FLYING EYE

3

FLYING EYE ist eine Managementberatung mit Spezialisierung auf Aufgabenstellungen der Medien- und IT-Branche und einem internationalen Kundenstamm. Wir bieten Best Practice-Lösungen aus einem Kompetenzmix der klassischen Unternehmensberatung und dem Leistungsspektrum eines Ingenieurbüros.

Technology Content Broadcast & Online Media Business & Workflows

Referenzen (Auswahl)

slide-4
SLIDE 4 Producer – GA: 731893

Was genau bedeutet das?

4

… zurück zum Projekt…

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-5
SLIDE 5 Producer – GA: 731893

Das Konsortium

5 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-6
SLIDE 6 Producer – GA: 731893

Projektlaufzeit

6

01/2017 – 06/2018

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-7
SLIDE 7 Producer – GA: 731893

Was machen wir im Projekt?

7

Ziele

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-8
SLIDE 8 Producer – GA: 731893

Ziele

8 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893

Bereitstellung eines Toolsets (producer-toolkit.eu) zur Weiterentwicklung des Produktionsworkflows für Dokumentationen unter besonderer Berücksichtigung folgender Faktoren:

1. Bereitstellung innovativer und integrierter Tools, die die Preproduction, Production and Postproduction von Dokumentarfilmen unterstützen 2. Kosten- und Zeiteinsparung (Enabler für Produktionen durch SME‘s) 3. Unterstützung zusätzlicher Contenttypen / Devicetypen (360° video, video enrichments, 2nd screen tool) 4. Einbeziehung der Enduser (Interaktive Elemente, Personalisierung, Schnittstellen zu Social Media) 5. Zielgruppenfokussierung bei Themenauswahl und Content Enrichments

slide-9
SLIDE 9 Producer – GA: 731893

PRODUCER Toolkit

9

Architektur

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-10
SLIDE 10 Producer – GA: 731893

PRODUCER Toolkit: Architektur

10
slide-11
SLIDE 11 Producer – GA: 731893

PRODUCER Toolkit

11

Toolkit

http://producer-toolkit.eu

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-12
SLIDE 12 Producer – GA: 731893

PRODUCER Toolkit: Startseite

12
slide-13
SLIDE 13 Producer – GA: 731893

PRODUCER Toolkit

13

http://producer-toolkit.eu http://producer-toolkit.eu

slide-14
SLIDE 14 Producer – GA: 731893

PRODUCER Toolkit

14

http://producer-toolkit.eu http://producer-toolkit.eu

slide-15
SLIDE 15 Producer – GA: 731893

PRODUCER Toolkit

15

Einzelne Tools

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-16
SLIDE 16 Producer – GA: 731893

PRODUCER Toolkit

16 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-17
SLIDE 17 Producer – GA: 731893

Preproduction

Integrated Trends Discovery Tool (ITDT)

  • Discover trends within target groups, geographic areas, temporal aspects
  • Discover topics and sub-topics within different groups
  • Formulate, validate or (re) orentiate your documentary topic based on the ITDT
  • utcome
  • Sources: Google, Twitter, Youtube (Facebook could be integrated as well)
17 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-18
SLIDE 18 Producer – GA: 731893

Preproduction

Integrated Trends Discovery Tool (ITDT)

18
slide-19
SLIDE 19 Producer – GA: 731893

Preproduction

19

Integrated Trends Discovery Tool (ITDT)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-20
SLIDE 20 Producer – GA: 731893

Preproduction

Integrated Trends Discovery Tool (ITDT)

20 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-21
SLIDE 21 Producer – GA: 731893

Preproduction

21

Integrated Trends Discovery Tool (ITDT)

slide-22
SLIDE 22 Producer – GA: 731893

Preproduction

22

Integrated Trends Discovery Tool (ITDT)

slide-23
SLIDE 23 Producer – GA: 731893

Preproduction

23

Integrated Trends Discovery Tool (ITDT)

slide-24
SLIDE 24 Producer – GA: 731893

PRODUCER Toolkit

24 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-25
SLIDE 25 Producer – GA: 731893

Preproduction

Open Content Discovery Tool (OCD)

  • The Open Content Discovery Tool is a web-based application aims helping users

to search across several sources of open content through a unique interface.

  • OCD provides an efficient search & retrieval mechanism to enable professional

users to access targeted multimedia content & information

  • OCD is currently integrated with: Youtube, Internet Archive, Pexels, Pixabay,

Wikipedia, Vimeo

25 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-26
SLIDE 26 Producer – GA: 731893

Preproduction

26

Open Content Discovery Tool (OCD)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-27
SLIDE 27 Producer – GA: 731893

Preproduction

27

Open Content Discovery Tool (OCD)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-28
SLIDE 28 Producer – GA: 731893

Preproduction

28

Open Content Discovery Tool (OCD)

slide-29
SLIDE 29 Producer – GA: 731893

PRODUCER Toolkit

29 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-30
SLIDE 30 Producer – GA: 731893

Preproduction

Audience Building Tool (ABT)

  • Stand-alone web-based social platform which is connected to FB & Twitter
  • Creation & management of campaigns and monitoring campaign KPI’s
  • Support of different roles
  • Audience feedback & audience involvement with gamification elements
  • Increase of marketing possibilities for producers in one tool (like a social asset

management tool)

30 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-31
SLIDE 31 Producer – GA: 731893

Preproduction

31

Audience Building Tool (ABT)

slide-32
SLIDE 32 Producer – GA: 731893

Preproduction

32

Audience Building Tool (ABT)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-33
SLIDE 33 Producer – GA: 731893

Preproduction

33

Audience Building Tool (ABT)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-34
SLIDE 34 Producer – GA: 731893

Preproduction

34

Audience Building Tool (ABT)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-35
SLIDE 35 Producer – GA: 731893

Preproduction

35

Audience Building Tool (ABT)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-36
SLIDE 36 Producer – GA: 731893

Preproduction

36

Audience Building Tool (ABT)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-37
SLIDE 37 Producer – GA: 731893

Preproduction

37

Audience Building Tool (ABT)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-38
SLIDE 38 Producer – GA: 731893

Preproduction

38

Audience Building Tool (ABT)

slide-39
SLIDE 39 Producer – GA: 731893

PRODUCER Toolkit

39 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-40
SLIDE 40 Producer – GA: 731893

Production

Multimedia Content Storage, Search and Retrieval Tool (MCSSR)

  • Standard CMS/MAM functionalities (search, retrieve, tag, import, export,

delete, …)

  • Connected with Open Content Discovery Tool (content search in archives),

Integrated Trends Dicovery Tool and Automatic Annotation Tool (AAT)

  • MCSSR is in the “center” of the PRODUCER toolkit
  • Support of different user roles and rights
40 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-41
SLIDE 41 Producer – GA: 731893

Production

41

Multimedia Content Storage, Search and Retrieval Tool (MCSSR)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-42
SLIDE 42 Producer – GA: 731893

Production

42

Multimedia Content Storage, Search and Retrieval Tool (MCSSR)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-43
SLIDE 43 Producer – GA: 731893

Production

43

Multimedia Content Storage, Search and Retrieval Tool (MCSSR)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-44
SLIDE 44 Producer – GA: 731893

Production

44

Multimedia Content Storage, Search and Retrieval Tool (MCSSR)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-45
SLIDE 45 Producer – GA: 731893

PRODUCER Toolkit

45 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-46
SLIDE 46 Producer – GA: 731893

Production

Automatic Annotation Tool (AAT)

  • AAT detects: faces, objects, persons
  • Connected to MCSSR
  • Speech-to-text functionality implemented
  • Provides automatic annotation of the content
  • Machine Learning using tensorflow
46 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-47
SLIDE 47 Producer – GA: 731893

Production

47

Automatic Annotation Tool (AAT)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-48
SLIDE 48 Producer – GA: 731893

Production

48

Automatic Annotation Tool (AAT)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-49
SLIDE 49 Producer – GA: 731893

Production

49

Automatic Annotation Tool (AAT)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-50
SLIDE 50 Producer – GA: 731893

PRODUCER Toolkit

50 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-51
SLIDE 51 Producer – GA: 731893

Postproduction

Interactive-Enriched Video Creation Tool (IEVCT)

  • IEVCT is used to create interactive & clickable 360° videos
  • Enrichments could be derived automatically (based on an integration with AAT)
  • r manually
  • IEVCT provides an API to build (branded & customized) players for multiple

platforms and devices

  • IEVCT is also interfaces with the second screen interaction tool (to access

clickable video

51 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-52
SLIDE 52 Producer – GA: 731893

Postproduction

52

Interactive- Enriched Video Creation Tool (IEVCT)

slide-53
SLIDE 53 Producer – GA: 731893

Postproduction

53

Interactive- Enriched Video Creation Tool (IEVCT)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-54
SLIDE 54 Producer – GA: 731893

Postproduction

54

Interactive- Enriched Video Creation Tool (IEVCT)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-55
SLIDE 55 Producer – GA: 731893

PRODUCER Toolkit

55 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-56
SLIDE 56 Producer – GA: 731893

Postproduction

360° Video Playout Tool (360VPT)

  • 360VPT enables the playback of 360° videos on a wide range of client devices

especially HbbTV-enabled terminals for seamless integration with broadcast and broadband TV services

  • 360VPT enables high quality streaming of 360° video content without the need

to increase the bandwidth comparing traditional videos.

  • 360VPT considers low performance devices like TVs and Set-Top-Boxes that

does not have the capability to process 360° videos locally.

  • 360VPT also offers players for a wide range of playback devices like Android TV,

Amazon FireTV and Chromecast.

56 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-57
SLIDE 57 Producer – GA: 731893

Postproduction

57 Pre-Renderer FOV Video Files

360° Video Playout Tool (360VPT) àPre-Rendering

slide-58
SLIDE 58 Producer – GA: 731893

Postproduction

58

360° Video Playout Tool (360VPT) àLive-Rendering

Cloud Renderer Second Screen Player

ß Send user inputs Stream individual view à Stream 360° video à

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-59
SLIDE 59 Producer – GA: 731893

PRODUCER Toolkit

59 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-60
SLIDE 60 Producer – GA: 731893

Postproduction

Second Screen Interaction Tool (SSIT)

  • SSIT facilitates the discovery, pairing, launch, communication and

synchronization between SmartTV and second screen devices

  • It can be used form example for enabling the delivery of Interactive TV Ads,

which trigger the access to extended contents and e-commerce feature directly from the TV Ad.

  • It can be also used to synchronize multimedia content between TV and Second

Screen

60 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-61
SLIDE 61 Producer – GA: 731893

Postproduction

61

Second Screen Interaction Tool (SSIT)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-62
SLIDE 62 Producer – GA: 731893

Postproduction

62

Second Screen Interaction Tool (SSIT)

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-63
SLIDE 63 Producer – GA: 731893

PRODUCER Toolkit

63 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-64
SLIDE 64 Producer – GA: 731893

Postproduction

Social Recommendation and Personalization Tool (SRPT)

  • SRPT is the engine that powers the personalization mechanism of the producer

platform

  • It is responsible for creating a user profile for each of the audience members,

and serve content relevant to their preferences, as well as that of other similar users

  • The user’s profile is constantly updated based on his interactions with the

content

  • Based on the generated profiles, the SRPT allows the producers to choose a

target audience and provides recommended items to use in their documentaries

64 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-65
SLIDE 65 Producer – GA: 731893

Postproduction

65

Social Recommendation and Personalization Tool (SRPT)

slide-66
SLIDE 66 Producer – GA: 731893

Postproduction

66

Social Recommendation and Personalization Tool (SRPT) à Content Creator WF

slide-67
SLIDE 67 Producer – GA: 731893

Postproduction

67

Social Recommendation and Personalization Tool (SRPT) à Content Creator WF

slide-68
SLIDE 68 Producer – GA: 731893

Und wird das Toolkit auch wirklich benutzt?

68

Ja!

Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-69
SLIDE 69 Producer – GA: 731893

Und wird das Toolkit auch wirklich benutzt?

69 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
slide-70
SLIDE 70 Producer – GA: 731893

Und wird das Toolkit auch wirklich benutzt?

70 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893

YAMAI

slide-71
SLIDE 71 Producer – GA: 731893

Zusammenfassung

71 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893
  • Die Entwicklung der individuellen Tools ist abgeschlossen
  • Letzte Integrationsarbeiten (Schnittstellen) werden gerade erledigt
  • Interne und externe Benchmarking Tests werden bis Ende Juni 2018

durchgeführt

  • Projektabschluss zur Jahresmitte 2018
slide-72
SLIDE 72 Producer – GA: 731893

Ausblick

72 Project funded by the Horizon’2020 in topic “ICT 21-2016:” Grant Agreement #731893

Kontakt: kemal.goerguelue@flyingeye.de http://producer-toolkit.eu/