Advene: active reading through hypervideo Olivier Aubert -Yannick - - PowerPoint PPT Presentation

▶
advene active reading through hypervideo
SMART_READER_LITE
LIVE PREVIEW

Advene: active reading through hypervideo Olivier Aubert -Yannick - - PowerPoint PPT Presentation

Apr 06, 2024 34 likes •296 views

ACM Hypertext 2005 Sep. 8, 2005 Advene: active reading through hypervideo Olivier Aubert -Yannick Pri LIRIS - Universit Claude Bernard Lyon 1 LIRIS Lyon Research Center for Images and Intelligent Information Systems UMR 5205

slide-1
SLIDE 1

1 Advene: active reading through hypervideo – ACM HT 05

Advene: active reading through hypervideo

Olivier Aubert -Yannick Prié

LIRIS - Université Claude Bernard Lyon 1 ACM Hypertext 2005 – Sep. 8, 2005

LIRIS – Lyon Research Center for Images and Intelligent Information Systems UMR 5205 – CNRS/INSA-Lyon/Université Lyon 1/Université Lyon 2/Centrale Lyon http://liris.cnrs.fr/

slide-2
SLIDE 2

2 Advene: active reading through hypervideo – ACM HT 05

Outline

  • Audiovisual Information Systems for scholars
  • The hypervideo model
  • The Advene project

– The Advene model – The Advene prototype – Views in Advene – Active Reading

  • Ongoing work – Conclusion
slide-3
SLIDE 3

3 Advene: active reading through hypervideo – ACM HT 05

  • Various uses of AV documents

– personal notes / work documents, pedagogical

tools, testimony of the past, work of art, communication acts, ...

  • Basic interaction

– text transcriptions and notes – simple video navigation

  • Tools should

– accommodate the variety of needs in metadata

structure and visualisation modalities

– allow to share and adapt both structured metadata

and visualisations

Audiovisual Information Systems for Scholars

slide-4
SLIDE 4

4 Advene: active reading through hypervideo – ACM HT 05

A hypervideo model to...

  • Analyse existing innovative uses of

audiovisual document

  • Provide guidelines to build new hypermedia

systems

slide-5
SLIDE 5

5 Advene: active reading through hypervideo – ACM HT 05

The hypervideo model

t Audiovisual Document AVD

slide-6
SLIDE 6

6 Advene: active reading through hypervideo – ACM HT 05

The hypervideo model

t Audiovisual Document AVD Annotation Structure AS

Relation structure S

Annotation a1 f1 f2 f3 Annotation a2 Annotation a3 Fragments Annotations Structure

slide-7
SLIDE 7

7 Advene: active reading through hypervideo – ACM HT 05

The hypervideo model

t Audiovisual Document AVD Annotation Structure AS

Relation structure S

Annotation a1 f1 f2 f3 Annotation a2 Annotation a3 Fragments Annotations Structure

Views View definitions + tools

slide-8
SLIDE 8

8 Advene: active reading through hypervideo – ACM HT 05

The hypervideo model

t Audiovisual Document AVD Annotation Structure AS

Relation structure S

Annotation a1 f1 f2 f3 Annotation a2 Annotation a3 Fragments Annotations Structure

Hypervideo Non- hypervideo

Views View definitions + tools Hypervideo: view that 1/ uses information from both the AV document and the annotation structure and 2/ gives access to the AV document temporality

slide-9
SLIDE 9

9 Advene: active reading through hypervideo – ACM HT 05

A DVD seen as a hypervideo

t Movie Annotation Structure

Subtitle 1 f1 f2 f3 Subtitle 2 Subtitle 3

  • Alt. soundtrack

f4 f5 f6 Chapter 1 Chapter 2 Fragments Annotations

Hypervideo Non- hypervideo

Views DVD player

Non-hypervideo views: plain movie, printed chapter list Hypervideo views: subtitled movie, direct access to chapters

slide-10
SLIDE 10

10 Advene: active reading through hypervideo – ACM HT 05

The Advene project

 « advene: to be added to something or become a

part of it, though not essential » (Webster 1913)

  • Annotate Digital Videos/DVds, Exchange on the NEt
  • Data model + prototype

– Open-source, cross-platform – Reuse off-the-shelf components

(VLC, ZPT, web browser)

– Rapid development (python) – Testbed for experiments

  • Research platform

– new audiovisual interaction modalities – user-lead innovation

slide-11
SLIDE 11

11 Advene: active reading through hypervideo – ACM HT 05

Principle

T1 T2 Type Contenu 0 10 Plan KF 10 25 Plan 5 31 Obj Voiture 10 44 Lieu Route .... ... ..... ............ .... ... ..... ............ .... ... ..... ............

Package

Package creation (definition of annotations and views)

AV Document

  • Annotate videos
slide-12
SLIDE 12

12 Advene: active reading through hypervideo – ACM HT 05

Principle

T1 T2 Type Contenu 0 10 Plan KF 10 25 Plan 5 31 Obj Voiture 10 44 Lieu Route .... ... ..... ............ .... ... ..... ............ .... ... ..... ............

Package

Package sharing :

  • copy through webserver, e-mail, etc.
  • reference through imports

Package creation (definition of annotations and views)

AV Document

  • Annotate videos
  • Share metadata and

analyses

slide-13
SLIDE 13

13 Advene: active reading through hypervideo – ACM HT 05

Principle

T1 T2 Type Contenu 0 10 Plan KF 10 25 Plan 5 31 Obj Voiture 10 44 Lieu Route .... ... ..... ............ .... ... ..... ............ .... ... ..... ............

Package

Package sharing :

  • copy through webserver, e-mail, etc.
  • reference through imports

Package creation (definition of annotations and views)

AV Document

  • Annotate videos
  • Share metadata and

analyses

  • Visualise the metadata in

user-specifiable ways

Package utilisation (visualisation, enrichment)

poursuivi

Ce film, réalisé en 1972, ne plut pas aux distributeurs lors de sa présentation au marché du film à Cannes. Alors que sévissait "L'exorciste" sur les écrans, le producteur demanda au réalisateur (grand nom du fantastique italien) de tourner de nouvelles scènes pour les insérer dans le film et ainsi de l'adapter à ce "courant exorciste". Le résultat gagne en atouts commerciaux (scènes-chocs, vomi...) ce qu'il perd en poésie! Ce diable amateur de sucettes ne méritait pas ça! Ce film, réalisé en 1972, ne plut pas aux distributeurs lors de sa présentation au marché du film à Cannes. Alors que sévissait "L'exorciste" sur les écrans,

Enriched video views Hypertext views Ad-hoc views Package AV Document

slide-14
SLIDE 14

14 Advene: active reading through hypervideo – ACM HT 05

The Advene data model

Element addressing with TALES (ZPT) :

package/annotationTypes/PartOfSpeech/annotations/first annotation/content/data annotation/fragment/duration

Schemas Annotations Relations Queries View definitions Resources

Package

Schema: Summary Annotation-type: PartOfSpeech Relation-type: NextPart Annotation-type: People

Introduction Summary Chairman

Example :

Content-type: text/plain Content-type: text/x-vcard Content-type: None

slide-15
SLIDE 15

15 Advene: active reading through hypervideo – ACM HT 05

Static (hypertext) views

<h2>The different parts of the speech:</h2> <ul> <li tal:repeat="a here/annotationTypes/PartOfSpeech/annotations"><a tal:attributes="href a/player_url"><img alt="" tal:attributes="src a/snapshot_url" /><span tal:content="a/content/data">Name</span></a> (<a tal:attributes="href string:${a/absolute_url}/ view/S_part_details">Details</a>) </li> </ul>

Template-based X(HT)ML generation (ZPT) Links to the video and views (ad-hoc, static) Images extracted on the fly

slide-16
SLIDE 16

16 Advene: active reading through hypervideo – ACM HT 05

Dynamic (enriched video) views

  • Event-Condition-Action paradigm
  • View = set of rules
  • Example: if the event Beginning of annotation occurs

(event) and the annotation type is PartOfSpeech (condition), then display the part title as a caption and a navigation popup to go to the next and previous part (action). Events Conditions Actions

  • Annotation start/end
  • Player start/pause
  • ...
  • Allen conditions
  • Order, inclusion
  • ...
  • Basic player control
  • Advanced player control
  • GUI actions (popups, ...)
slide-17
SLIDE 17

17 Advene: active reading through hypervideo – ACM HT 05

Dynamic view rendering

slide-18
SLIDE 18

18 Advene: active reading through hypervideo – ACM HT 05

Active Reading with Advene

  • Note taking

– On-the-fly note taking (timestamped) – Annotation assistants (automatic/semi-automatic

generation)

  • Annotation visualisation

– Ad-hoc views, user-specified static/dynamic views – Document production

  • Annotation processing

– Schema evolution – Queries

  • Collaboration

– Package sharing (by copy or reference)

slide-19
SLIDE 19

19 Advene: active reading through hypervideo – ACM HT 05

Conclusion

  • Main Advene features :

– flexible metadata structure – user-specifiable visualisations – metadata and visualisation specifications

exchange

  • Analysing and building systems with the

hypervideo model

slide-20
SLIDE 20

20 Advene: active reading through hypervideo – ACM HT 05

Ongoing work

  • Prototype :

– Usability issues (helpers, WYSIWYG editor, ...) – Common, reusable views and schemas definition

(emergent discovery)

– Package repositories creation – Schema evolution

  • Collaborations (Incorporactions, CRDP)
  • Theoretical analyses (document temporalities,

hypervideo perception, nature of document)

slide-21
SLIDE 21

21 Advene: active reading through hypervideo – ACM HT 05

The end...

Thank you for your attention

The prototype is available from http://liris.cnrs.fr/advene/

slide-22
SLIDE 22

22 Advene: active reading through hypervideo – ACM HT 05

Views and hypervideos

  • Annotated AV document:

– movie + shot/sequence decomposition

  • Non-hypervideo views

– the movie alone – a plain table of contents

  • Hypervideo views

– Movie with

  • sequence title inserted on the video
  • links to the next/previous shot or sequence

– Hypertext table of contents linked with the movie

  • Hypervideo concept uses

– Analysis of existing hypervideos – Guidelines to build new systems

AS

AVD

slide-23
SLIDE 23

23 Advene: active reading through hypervideo – ACM HT 05

Views and hypervideos

  • Annotated AV document:

– movie + shot/sequence decomposition

  • Non-hypervideo views

– the movie alone – a plain table of contents

  • Hypervideo views

– Movie with

  • sequence title inserted on the video
  • links to the next/previous shot or sequence

– Hypertext table of contents linked with the movie

  • Hypervideo concept uses

– Analysis of existing hypervideos – Guidelines to build new systems

V AS

AVD

slide-24
SLIDE 24

24 Advene: active reading through hypervideo – ACM HT 05

Views and hypervideos

  • Annotated AV document:

– movie + shot/sequence decomposition

  • Non-hypervideo views

– the movie alone – a plain table of contents

  • Hypervideo views

– Movie with

  • sequence title inserted on the video
  • links to the next/previous shot or sequence

– Hypertext table of contents linked with the movie

  • Hypervideo concept uses

– Analysis of existing hypervideos – Guidelines to build new systems

V AS

AVD

slide-25
SLIDE 25

25 Advene: active reading through hypervideo – ACM HT 05

Views and hypervideos

  • Annotated AV document:

– movie + shot/sequence decomposition

  • Non-hypervideo views

– the movie alone – a plain table of contents

  • Hypervideo views

– Movie with

  • sequence title inserted on the video
  • links to the next/previous shot or sequence

– Hypertext table of contents linked with the movie

  • Hypervideo concept uses

– Analysis of existing hypervideos – Guidelines to build new systems

V AS

AVD

slide-26
SLIDE 26

26 Advene: active reading through hypervideo – ACM HT 05

Targeted categories of users

  • Advanced users: creation from scratch
  • Knowledgeable users: imitation
  • Learning users: use of assistants and

WYSIWYG editors

  • Read-only users: simple visualisation