Integrating Semantic Web technology in an Annotation-based - - PowerPoint PPT Presentation

integrating semantic web technology in an annotation
SMART_READER_LITE
LIVE PREVIEW

Integrating Semantic Web technology in an Annotation-based - - PowerPoint PPT Presentation

SWAMM 2006 May 22, 2006 Integrating Semantic Web technology in an Annotation-based Hypervideo System Olivier Aubert Pierre-Antoine Champin Yannick Pri LIRIS - Claude Bernard University Lyon 1 LIRIS Lyon Research Center for Images


slide-1
SLIDE 1

1 Integrating SW technologies in Advene – SWAMM 2006

Integrating Semantic Web technology in an Annotation-based Hypervideo System

Olivier Aubert Pierre-Antoine Champin Yannick Prié

LIRIS - Claude Bernard University Lyon 1 SWAMM 2006 – May 22, 2006

LIRIS – Lyon Research Center for Images and Intelligent Information Systems UMR 5205 – CNRS/INSA-Lyon/Université Lyon 1/Université Lyon 2/Centrale Lyon http://liris.cnrs.fr/

slide-2
SLIDE 2

2 Integrating SW technologies in Advene – SWAMM 2006

Structure of the talk

  • What is Advene

– the Advene model – the Advene tool

  • Putting OWL in Advene

– OWL views – OWL queries

  • Using inference in Hypervideos
slide-3
SLIDE 3

3 Integrating SW technologies in Advene – SWAMM 2006

What is Advene

  • Annotation-based model and authoring tool

for Hypervideos

  • Given a video augmented with an annotation

structure, a Hypervideo is a view that

– uses information from both the video and the

annotation structure, and

– gives access to the temporality of the video

slide-4
SLIDE 4

4 Integrating SW technologies in Advene – SWAMM 2006

The Advene annotation model (1)

video t text jpeg

Annotations Relations

jpeg

slide-5
SLIDE 5

5 Integrating SW technologies in Advene – SWAMM 2006

The Advene annotation model (1)

video t Person: jpeg text XML

Annotations Relations Annotation types Relation types

XML Part of speech : text Knows: (Person,Person) text jpeg jpeg

slide-6
SLIDE 6

6 Integrating SW technologies in Advene – SWAMM 2006

The Advene annotation model (1)

video t Person: jpeg text jpeg

Annotations Relations Annotation types Relation types

jpeg Part of speech : text Knows: (Person,Person) text jpeg jpeg

Schema

slide-7
SLIDE 7

7 Integrating SW technologies in Advene – SWAMM 2006

The Advene annotation model (2)

video Schemas Annotations Relations t

Package

slide-8
SLIDE 8

8 Integrating SW technologies in Advene – SWAMM 2006

The Advene annotation model (2)

video Schemas Annotation Relations Queries t

Package

  • Queries select a subset of the elements of the

package

Schemas Annotations Relations Queries

slide-9
SLIDE 9

9 Integrating SW technologies in Advene – SWAMM 2006

The Advene annotation model (2)

video Schemas Annotations Relations Queries Views t

Package Hypervideo

(XHTML, SMIL, ...)

  • Views render the result of queries with

information from the video into hypervideos

slide-10
SLIDE 10

10 Integrating SW technologies in Advene – SWAMM 2006

The Advene tool

  • Open-source prototype:

http://liris.cnrs.fr/advene

  • Reuse of existing components

(VLC, Template Attribute Language, HTTP...)

  • Test-bed for experimentation on video and

hypervideo uses

slide-11
SLIDE 11

11 Integrating SW technologies in Advene – SWAMM 2006

The Advene tool – structure

core GUI + VLC HTTP server package

slide-12
SLIDE 12

12 Integrating SW technologies in Advene – SWAMM 2006

Structure of the talk

  • What is Advene

– the Advene model – the Advene tool

  • Putting OWL in Advene

– OWL views – OWL queries

  • Using inference in Hypervideos
slide-13
SLIDE 13

13 Integrating SW technologies in Advene – SWAMM 2006

OWL in Advene – Goal

  • Benefit from OWL inferences in Advene

– expose Advene structure in OWL

→ OWL views

– reason with the resulting OWL description

→ OWL queries

– use the result of the reasoning in Advene

slide-14
SLIDE 14

14 Integrating SW technologies in Advene – SWAMM 2006

OWL in Advene views (1)

  • Advene structures can be straightforwardly

translated into OWL by a generic view, according to an OWL ontology of the Advene annotation model

Annotation OWL Instances Schemas Annotations Generic Ontology Generic view

slide-15
SLIDE 15

15 Integrating SW technologies in Advene – SWAMM 2006

OWL in Advene views (2)

  • Ad-hoc translations may be preferred for

some schemas

– more adapted representation of instances – more structure and integrity constraints

Annotation OWL Instances Schemas Annotations Ad-hoc Ontology Ad-hoc view

slide-16
SLIDE 16

16 Integrating SW technologies in Advene – SWAMM 2006

OWL in Advene views (3)

  • Some schemas can be designed from an

existing ontology, and be accompanied with views to convert annotations back to OWL

– Advene as a front-end tool for semantic

annotations

Annotation OWL Instances Schemas Annotations Existing Ontology Ad-hoc view

slide-17
SLIDE 17

17 Integrating SW technologies in Advene – SWAMM 2006

OWL in Advene queries (1)

  • Several kinds of queries for OWL

– T-Box services (satisfiability, subsumption...) – A-Box services

(consistency, all instances of a class, properties

  • f an instance...)
  • We focus on A-Box services:

reasoning about the annotations and relations

slide-18
SLIDE 18

18 Integrating SW technologies in Advene – SWAMM 2006

OWL in Advene queries (2)

video Schemas Annotations Relations OWL Views OWL Queries t

Package Hypervideo

(XHTML, SMIL, ...) End-user Views

slide-19
SLIDE 19

19 Integrating SW technologies in Advene – SWAMM 2006

Structure of the talk

  • What is Advene

– the Advene model – the Advene tool

  • Putting OWL in Advene

– OWL views – OWL queries

  • Using inference in Hypervideos
slide-20
SLIDE 20

20 Integrating SW technologies in Advene – SWAMM 2006

OWL in Advene – running example

  • FOAF Schema based on the FOAF ontology
  • Annotation types

(contain foaf attributes)

– Person – Group – Project

  • Relation types

– knows – member – currentProject

slide-21
SLIDE 21

21 Integrating SW technologies in Advene – SWAMM 2006

Using consistency checking for integrity constraints

  • OWL enables the expression of complex

integrity constraints

– restrictions, set operators...

  • Annotations structures are valid if their OWL

translation is consistent

  • In the case of inconsistency, inference

engines even provide an explanation of its cause

– not really usable by end users

slide-22
SLIDE 22

22 Integrating SW technologies in Advene – SWAMM 2006

Using consistency checking for integrity constraints – example (1)

video t Group text

Annotations Relations Annotation types Relation types

XML Project member ZigZag Project Panel Group

Foaf schema

Person knows

slide-23
SLIDE 23

23 Integrating SW technologies in Advene – SWAMM 2006

Using consistency checking for integrity constraints – example (2)

  • Only Agents (Person, Group) can be member
  • f a group
  • Classes Project and Agent are disjoint

(not really in foaf)

  • Hence annotation “ZigZag Project” is

inconsistent

slide-24
SLIDE 24

24 Integrating SW technologies in Advene – SWAMM 2006

Using classification for integrity constraints (reporting)

  • As an alternative, the ontology can accept

invalid annotations/relations, but classify them in specific “invalid” class(es)

  • This allows for higher level explanation for

“inconsistency”, suitable for end-users

slide-25
SLIDE 25

25 Integrating SW technologies in Advene – SWAMM 2006

Using classification for integrity constraints – example

  • Only Agents (Person, Group) can be member
  • f a group
  • Class Invalid is a subclass of the intersection
  • f classes Project and Agent

(replaces all disjunction axioms)

  • hence annotation “ZigZag Project” is an

instance of Invalid

slide-26
SLIDE 26

26 Integrating SW technologies in Advene – SWAMM 2006

Using inference for advising additions

  • Inference can be used to provide some

advices to the annotator to improve the annotation structure

  • For example

– making explicit some infered relations – changing the type of an annotation – adding information in an annotation content – ...

slide-27
SLIDE 27

27 Integrating SW technologies in Advene – SWAMM 2006

Using inference for advising additions – example (1)

video t Group text

Annotations Relations Annotation types Relation types

XML Project member

Foaf schema

Person knows

  • W. Hall
  • T. Nelson
slide-28
SLIDE 28

28 Integrating SW technologies in Advene – SWAMM 2006

Using inference for advising additions – example (2)

  • In the content of annotations

– it is known that Ted Nelson knows someone

whose homepage is http://www.ecs.soton.ac.uk/~wh/

– it is known that Wendy Hall has homepage

http://www.ecs.soton.ac.uk/~wh/

  • From the ontology, homepage is an inverse

functional annotation

  • Hence Ted Nelson knows Wendy Hall
slide-29
SLIDE 29

29 Integrating SW technologies in Advene – SWAMM 2006

Using inference for advising additions – example (3)

video t Group text

Annotations Relations Annotation types Relation types

XML Project member

Foaf schema

Person

  • W. Hall
  • T. Nelson

knows

suggested

slide-30
SLIDE 30

30 Integrating SW technologies in Advene – SWAMM 2006

Using inference in end-user views

slide-31
SLIDE 31

31 Integrating SW technologies in Advene – SWAMM 2006

Conclusion (1)

  • Advene : model and tool for video annotation

– simple working model – available opensource prototype

http://liris.cnrs.fr/advene

– test-bed for novel uses of videos and hypervideos

  • Semantic Web technologies smoothly

integrate into Advene

– despite (thanks to?) the simplicity of the

underlying model w.r.t. the OWL model

– demonstrated on an real ontology

slide-32
SLIDE 32

32 Integrating SW technologies in Advene – SWAMM 2006

Conclusion (2)

  • Benefits for the multi-media community:

brings the computational power of OWL inference to hypervideo generation

  • Benefits for the Semantic Web community:

bridges the gap between semantic models and audiovisual document models, without requiring the existence of a complete and commonly agreed ontology of audiovisual descriptors

slide-33
SLIDE 33

33 Integrating SW technologies in Advene – SWAMM 2006

Thank you for your attention any questions?

slide-34
SLIDE 34

34 Integrating SW technologies in Advene – SWAMM 2006

  • Advene: to be added to something or become

a part of it, though not essential (Webster 1913)

slide-35
SLIDE 35

35 Integrating SW technologies in Advene – SWAMM 2006

The Advene tool – relevant features

  • Implementation of queries:

simple list of conditions chosen from a pre- defined list (similar to filters in an e-mail application)

  • Implementation of views:

TAL (Template Attribute Language) special attributes in a valid XML document are processed to alter its content

slide-36
SLIDE 36

36 Integrating SW technologies in Advene – SWAMM 2006

OWL in Advene queries – structure

core HTTP server package Pellet OWL views SPARQL queries

Result as a set

  • f URIs

Pellet adapter

Result as a set of Advene items