LOD Stories { Learning About Art by Building Multimedia Stories - - PowerPoint PPT Presentation

▶
lod stories
SMART_READER_LITE
LIVE PREVIEW

LOD Stories { Learning About Art by Building Multimedia Stories - - PowerPoint PPT Presentation

Dec 08, 2023 215 likes •746 views

LOD Stories { Learning About Art by Building Multimedia Stories Hao Zhang, Jianliang Chen, Yuting Liu, Dipanwita Maulik, Linda Xu Dr. Craig A. Knoblock, Dr. Pedro Szekely University of Southern California, United States MielVander Sande Ghent

slide-1
SLIDE 1

{

LOD Stories

Learning About Art by Building Multimedia Stories

Hao Zhang, Jianliang Chen, Yuting Liu, Dipanwita Maulik, Linda Xu

  • Dr. Craig A. Knoblock, Dr. Pedro Szekely

University of Southern California, United States MielVander Sande Ghent University, Belgium

slide-2
SLIDE 2
  • Mr. Bean (2007)
slide-3
SLIDE 3

Rowan Atkinson

  • Mr. Bean (2007)
slide-4
SLIDE 4
slide-5
SLIDE 5

Zazu The Lion King (1994)

slide-6
SLIDE 6

Main Actor Voice Main Character

slide-7
SLIDE 7

Andy Wharhol Carnegie institute of Technology Pittsburgh George Washington The Law

  • f Nations

Emerich de Vattel

slide-8
SLIDE 8

LOD Stories

slide-9
SLIDE 9

Related Work

Everything is Connected

http://everthingisconnected.be

slide-10
SLIDE 10

WikiLinks

Related Work

slide-11
SLIDE 11

Relationship Exploration Learning Using Multimedia User Engagement

LOD Stories

slide-12
SLIDE 12

A Slide Demo…

slide-13
SLIDE 13
slide-14
SLIDE 14

Andy Warhol

?

slide-15
SLIDE 15
slide-16
SLIDE 16
slide-17
SLIDE 17
slide-18
SLIDE 18
slide-19
SLIDE 19
slide-20
SLIDE 20
slide-21
SLIDE 21
slide-22
SLIDE 22
slide-23
SLIDE 23
slide-24
SLIDE 24
slide-25
SLIDE 25

Node Navigation Bar: Nodes as in the path

slide-26
SLIDE 26

Multimedia Collection: images and videos from the web

slide-27
SLIDE 27

Multimedia Collection: images and videos from the web

slide-28
SLIDE 28

Multimedia Preview: Preview images, videos and voices

slide-29
SLIDE 29

Narration Editor: Edit text description of the node

slide-30
SLIDE 30

Movie Navigation: Drag image and video here to make the movie

slide-31
SLIDE 31

Switch to node: Pittsburgh

slide-32
SLIDE 32
slide-33
SLIDE 33
slide-34
SLIDE 34
slide-35
SLIDE 35
slide-36
SLIDE 36
slide-37
SLIDE 37

Puzzle Pieces Topic Transition Text to Speech Software Google Images and Videos

slide-38
SLIDE 38
slide-39
SLIDE 39

How it works…

slide-40
SLIDE 40

Path Explorer

Search Request

Path Finder

Machine Learning Module Interesting Connection s Path Data

Story Editor

Generators

Date Profile Voice Image Video

Multimedia Data Story Elements

Story Player

Storyline Multimedia Story

Project Architecture

Smithsonian

Triple Store Datasets

DBpedia Images & Videos from Web

slide-41
SLIDE 41

Path Finder

Feature 1 Feature 2 Feature 3 Feature 4 … Interestingness Triple 1 0.95 0.45 0.13 0.87 … 4 … … … … … … …

Training Datasets Machine Learning Formula for Interesting Relationships Machine Learning

slide-42
SLIDE 42

Path Finder

Subject Degree Object Degree Subject Extension Rarity Object Extension Rarity

Andy Warhol Author Campbell’s Soup Can

Normalized Feature Value (Subj. Deg.) ?

Andy Warhol

*

?

Person

*

slide-43
SLIDE 43

Path Finder

Subject Degree Object Degree Subject Extension Rarity Object Extension Rarity

Andy Warhol Author Campbell’s Soup Can

Normalized Feature Value (Obj. Deg.) ?

Soup Can

*

?

*

Work

slide-44
SLIDE 44

Path Finder

Subject Degree Object Degree Subject Extension Rarity Object Extension Rarity

Andy Warhol Author Campbell’s Soup Can

Normalized Feature Value (Subj. Ext. Rarity) Author

Andy Warhol

*

Author

* *

slide-45
SLIDE 45

Path Finder

Subject Degree Object Degree Subject Extension Rarity Object Extension Rarity

Andy Warhol Author Campbell’s Soup Can

Normalized Feature Value (Obj. Ext. Rarity) Author

Soup Can

*

Author

* *

slide-46
SLIDE 46

Path Finder

Rank = 3.9595 * Subj. Extension Rarity + 0.8631 * Obj. Extension Rarity

  • 0.1643 * Subj. Degree

+ 0.0014 * Obj. Degree + 1.2353

Subject Degree Object Degree Subject Extension Rarity Object Extension Rarity

Andy Warhol Author Campbell’s Soup Can

slide-47
SLIDE 47

Path Finder

  • Subj. Ext.

Rarity

  • Obj. Ext.

Rarity Subj. Degree Obj. Degree Interestingness 1.46E-05 1.60E-04 5.62E-05 4.65E-05 4

Andy Warhol Author Campbell’s Soup Can

Hmmm… Pretty Interesting

slide-48
SLIDE 48

Path Finder

User Feedback

slide-49
SLIDE 49

Discussion

slide-50
SLIDE 50

Project Features

Path Recommendation Mechanism Flexible Editing Multimedia Elements Mash-up

slide-51
SLIDE 51

Future Work

Improve Machine Learning Model Enrich Path Explorer and Story Editor Functionalities Fully Integrate with Smithsonian Museum Datasets

slide-52
SLIDE 52

Thanks!

http://lodstories.isi.edu