Hypervideo and Annotations on the Web Madjid Sadallah Olivier - - PowerPoint PPT Presentation
Hypervideo and Annotations on the Web Madjid Sadallah Olivier Aubert Yannick Pri LIRIS - Claude Bernard University Lyon 1 / CERIST, Alger MMWeb 2011 Graz, Sept. 8th LIRIS Lyon Research Center for Images and Intelligent Information
LIRIS – Lyon Research Center for Images and Intelligent Information Systems UMR 5205 – CNRS/INSA-Lyon/Université Lyon 1/Université Lyon 2/Centrale Lyon http://liris.cnrs.fr/
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 2/17
– (AV) Annotation : any piece of data linked to
– Augmented/annotated video : video
– Search / retrieval – Linking – Navigation – Visualisation
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 3/17
– Find the most appropriate visualisation for the
– Do not too tightly bind the annotations and
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 4/17
– Hypermedia – Video-centered
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 5/17
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 6/17
Resources Queries
shot 1 shot 2 shot 3 shot 4 shot 5 shot 6 title: 'Meeting' title: 'Mission'
View definitions: templates, rules...
document 1.pdf
Structure schema
Shot Episode Document Panel Related shot
Package
panel1 panel2
Annotation structure Annotations
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 7/17
– Need to provide bootstrap
– With appropriate level of malleability /
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 8/17
– Conceptual and implementable model – Explicit annotation decoupling – Expressivity / simplicity
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 9/17
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 10/17
– Linked to a Media Player – Attributes : position / duration / status
– Visual / non-visual – Timeline-based / non-timeline-based
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 11/17
– Video reference – Start/end timecodes – T
– Content
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 12/17
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 13/17
Component AnnotationReader T ableOfContent Map Transcription Timeline ...
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 14/17
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 15/17
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 16/17
– Extend model/vocabulary – Improve visual/interaction design – Complete implementation – Authoring environment – Cognitive studies
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 17/17
Hypervideo and Annotations
Madjid Sadallah Olivier Aubert Yannick Prié LIRIS - Claude Bernard University Lyon 1 / CERIST, Alger
LIRIS – Lyon Research Center for Images and Intelligent Information Systems UMR 5205 – CNRS/INSA-Lyon/Université Lyon 1/Université Lyon 2/Centrale Lyon http://liris.cnrs.fr/
MMWeb 2011 – Graz, Sept. 8th
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 2/17
– (AV) Annotation : any piece of data linked to
an audiovisual fragment
– Augmented/annotated video : video
augmented with annotation data
– Search / retrieval – Linking – Navigation – Visualisation
metadata
cross the semantic gap though, it is the aim of many projects
directly be linked. Need additional layers (annotations)
fragments that interest you, how do you visualise them appropriately ?
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 3/17
wo different goals:
– Find the most appropriate visualisation for the
annotations for the current task
– Do not too tightly bind the annotations and
their visualisations (prevents reusability)
► empower users with the ability to define their own visualisations
visualisation in mind, we can prevent the reuse of annotations through other means
annotations, it prevents reusability -> lost time. Until know, I have spoken about visualisation in general Will introduce a concept that we think is appropriate
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 4/17
erm used by T ed Nelson (1960s)
hypermedia document built upon an audiovisual content augmented with data in a time synchronized way
wo dimensions :
– Hypermedia – Video-centered
Additional property: video-centered
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 5/17
video content
HV : restriction of generic hypermedia Given the combination of video+annotations ->
transcription) / temporal / non-temporal (static) /
exacerbated Before going into our proposal of a model for HV, I will give some information about where we come from.
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 6/17
Resources Queries
shot 1 shot 2 shot 3 shot 4 shot 5 shot 6 title: 'Meeting' title: 'Mission'
View definitions: templates, rules...
document 1.pdf
Structure schema
Shot Episode Document Panel Related shot
Package
panel1 panel2
Annotation structure Annotations
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 7/17
annotation usage
did not meet appropriate users
– Need to provide bootstrap
components/examples
– With appropriate level of malleability /
expressivity
These componenfts need to feature appropriate levels of malleability
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 8/17
– Conceptual and implementable model – Explicit annotation decoupling – Expressivity / simplicity
time (AHM + NCM). Our approach is compatible with AHM (but with more focused) HV is a restriction of hypermedia – profit from this constraint
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 9/17
HV:based on augmented (AnnotationStructure) video (TimedMedia) HV visualises augmented video through components Layout : very general concept, supposed to use underlying implementation layout mechanism
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 10/17
– Linked to a Media Player – Attributes : position / duration / status
– Visual / non-visual – Timeline-based / non-timeline-based
Visual artifact on screen Non-visual (AnnotationReader, audio player)
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 11/17
www.advene.org/cinelab
– Video reference – Start/end timecodes – T
ype (identifier)
– Content
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 12/17
be used as-is
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 13/17
Component AnnotationReader T ableOfContent Map Transcription Timeline ...
hypervideos
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 14/17
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 15/17
<div chm:component="jsonreader" id="data" chm:src="data.json" > <div chm:component="videoplayer" id="tr" chm:src="video.ogv" > <div chm:component="toc" chm:src="data" title="Story parts" chm:filter="type=='Parts'" chm:content="${content}" chm:timelineref="tr" >
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 16/17
Documentation and prototype available at http://advene.org/chm/
– Extend model/vocabulary – Improve visual/interaction design – Complete implementation – Authoring environment – Cognitive studies
www.advene.org www.advene.org MMWeb 2011 – Graz, Sept. 8th MMWeb 2011 – Graz, Sept. 8th 17/17
Thank you for your attention.