LectureSight Automatic Camera Control in Lecture Recordings - - PowerPoint PPT Presentation

▶
lecturesight automatic camera control in lecture
SMART_READER_LITE
LIVE PREVIEW

LectureSight Automatic Camera Control in Lecture Recordings - - PowerPoint PPT Presentation

Aug 27, 2022 375 likes •718 views

LectureSight Automatic Camera Control in Lecture Recordings Benjamin Wulff Alexander Fecke bwulff@uos.de afecke@uos.de University of Osnabrck, Germany 03.04.2013 Introduction Technology Deployment Table of Contents 1 Introduction

slide-1
SLIDE 1

LectureSight Automatic Camera Control in Lecture Recordings

Benjamin Wulff Alexander Fecke

bwulff@uos.de afecke@uos.de University of Osnabrück, Germany

03.04.2013

slide-2
SLIDE 2

Introduction Technology Deployment

Table of Contents

1 Introduction

Project Overview Motivation

2 Technology

System Architecture Camera Setup Video Analysis Camera Control

3 Deployment

Scene Regions Scripting Advanced scenarios

  • B. Wulff, A. Fecke

LectureSight 2 / 20

slide-3
SLIDE 3

Introduction Technology Deployment Project Overview Motivation

Project Overview

Context of the Project

  • B. Wulff, A. Fecke

LectureSight 3 / 20

slide-4
SLIDE 4

Introduction Technology Deployment Project Overview Motivation

Project Overview

Context of the Project

Opencast Community Project

  • B. Wulff, A. Fecke

LectureSight 3 / 20

slide-5
SLIDE 5

Introduction Technology Deployment Project Overview Motivation

Project Overview

Context of the Project

Opencast Community Project − → close integration with Opencast Matterhorn

  • B. Wulff, A. Fecke

LectureSight 3 / 20

slide-6
SLIDE 6

Introduction Technology Deployment Project Overview Motivation

Project Overview

Context of the Project

Opencast Community Project − → close integration with Opencast Matterhorn

runs in same OSGI container (Apache Felix) camera control activated by recording schedule

  • B. Wulff, A. Fecke

LectureSight 3 / 20

slide-7
SLIDE 7

Introduction Technology Deployment Project Overview Motivation

Project Overview

Context of the Project

Opencast Community Project − → close integration with Opencast Matterhorn

runs in same OSGI container (Apache Felix) camera control activated by recording schedule

initiated by ETH Zürich ID Multimedia Services

  • B. Wulff, A. Fecke

LectureSight 3 / 20

slide-8
SLIDE 8

Introduction Technology Deployment Project Overview Motivation

Project Overview

Context of the Project

Opencast Community Project − → close integration with Opencast Matterhorn

runs in same OSGI container (Apache Felix) camera control activated by recording schedule

initiated by ETH Zürich ID Multimedia Services

partner in development of Opencast Matterhorn replacing closed-source tracking solution

  • B. Wulff, A. Fecke

LectureSight 3 / 20

slide-9
SLIDE 9

Introduction Technology Deployment Project Overview Motivation

Motivation

  • B. Wulff, A. Fecke

LectureSight 4 / 20

slide-10
SLIDE 10

Introduction Technology Deployment Project Overview Motivation

Motivation

to cut costs, most lectures are recorded automatically − → no camera operator

  • B. Wulff, A. Fecke

LectureSight 4 / 20

slide-11
SLIDE 11

Introduction Technology Deployment Project Overview Motivation

Motivation

to cut costs, most lectures are recorded automatically − → no camera operator problem especially in big lecture halls

  • B. Wulff, A. Fecke

LectureSight 4 / 20

slide-12
SLIDE 12

Introduction Technology Deployment Project Overview Motivation

Motivation

Static camera perspectives

  • B. Wulff, A. Fecke

LectureSight 5 / 20

slide-13
SLIDE 13

Introduction Technology Deployment Project Overview Motivation

Motivation

Static camera perspectives

1 (cleverly chosen) wide shot

  • B. Wulff, A. Fecke

LectureSight 5 / 20

slide-14
SLIDE 14

Introduction Technology Deployment Project Overview Motivation

Motivation

Static camera perspectives

1 (cleverly chosen) wide shot 2 close shot on the lectern

  • B. Wulff, A. Fecke

LectureSight 5 / 20

slide-15
SLIDE 15

Introduction Technology Deployment Project Overview Motivation

Motivation

In a perfect world...

Image source: Prof. Dr. Vornberger 2012, Algorithms, Session 1: Introduction

  • B. Wulff, A. Fecke

LectureSight 6 / 20

slide-16
SLIDE 16

Introduction Technology Deployment Camera Setup Video Analysis Camera Control

Camera Setup

  • B. Wulff, A. Fecke

LectureSight 7 / 20

slide-17
SLIDE 17

Introduction Technology Deployment Camera Setup Video Analysis Camera Control

Video Analysis

Continuously maintained foreground mask

  • B. Wulff, A. Fecke

LectureSight 8 / 20

slide-18
SLIDE 18

Introduction Technology Deployment Camera Setup Video Analysis Camera Control

Video Analysis

Movie Time!

  • B. Wulff, A. Fecke

LectureSight 9 / 20

slide-19
SLIDE 19

Introduction Technology Deployment Camera Setup Video Analysis Camera Control

Video Analysis

Finding a person’s head

  • B. Wulff, A. Fecke

LectureSight 10 / 20

slide-20
SLIDE 20

Introduction Technology Deployment Camera Setup Video Analysis Camera Control

Video Analysis

Finding a person’s head

Phead : min(|xcentroid − x|) ∧ max(y)

  • B. Wulff, A. Fecke

LectureSight 10 / 20

slide-21
SLIDE 21

Introduction Technology Deployment Camera Setup Video Analysis Camera Control

Video Analysis

Finding a person’s head

Phead : min(|xcentroid − x|) ∧ max(y) K-means Clustering on person silhouette uneven number of prototypes cluster positions are updated with every frame

  • B. Wulff, A. Fecke

LectureSight 10 / 20

slide-22
SLIDE 22

Introduction Technology Deployment Camera Setup Video Analysis Camera Control

Camera Control

  • B. Wulff, A. Fecke

LectureSight 11 / 20

slide-23
SLIDE 23

Introduction Technology Deployment Camera Setup Video Analysis Camera Control

Camera Control

PTZ camera is operated by a steering worker that decides about the camera movement:

  • B. Wulff, A. Fecke

LectureSight 11 / 20

slide-24
SLIDE 24

Introduction Technology Deployment Camera Setup Video Analysis Camera Control

Camera Control

PTZ camera is operated by a steering worker that decides about the camera movement: if correction moves are necessary

  • B. Wulff, A. Fecke

LectureSight 11 / 20

slide-25
SLIDE 25

Introduction Technology Deployment Camera Setup Video Analysis Camera Control

Camera Control

PTZ camera is operated by a steering worker that decides about the camera movement: if correction moves are necessary which speeds for pan and tilt should be used

  • B. Wulff, A. Fecke

LectureSight 11 / 20

slide-26
SLIDE 26

Introduction Technology Deployment Scene Regions Scripting Advanced scenarios

Customizing LectureSight

Adjusting the system to the scene

  • B. Wulff, A. Fecke

LectureSight 12 / 20

slide-27
SLIDE 27

Introduction Technology Deployment Scene Regions Scripting Advanced scenarios

Customizing LectureSight

Adjusting the system to the scene

  • B. Wulff, A. Fecke

LectureSight 13 / 20

slide-28
SLIDE 28

Introduction Technology Deployment Scene Regions Scripting Advanced scenarios

Customizing LectureSight

A simple camera operator script

1 var target = false; 2 3 function init () { 4 home_pos = new Position( 5 Configuration .get("director.home.x"), 6 Configuration .get("director.home.y")); 7 } 8 9 function step () { 10 if (! target) { 11 Camera.setTarget(home_pos ); 12 target = findClosest(Tracker.trackedObjects , home_pos ); 13 } else { 14 if (target.isTracked ()) 15 Camera.setTarget(target.get("head.center")); 16 else if (Tracker. currentTime

  • target.lastSeen

> 2500) 17 target = false; 18 } 19 } 20 21 function findClosest (objects , pos) { 22 ... 23 }

  • B. Wulff, A. Fecke

LectureSight 14 / 20

slide-29
SLIDE 29

Introduction Technology Deployment Scene Regions Scripting Advanced scenarios

LectureSight in Action

Movie Time!

  • B. Wulff, A. Fecke

LectureSight 15 / 20

slide-30
SLIDE 30

Introduction Technology Deployment Scene Regions Scripting Advanced scenarios

More advanced scenarios

  • B. Wulff, A. Fecke

LectureSight 16 / 20

slide-31
SLIDE 31

Introduction Technology Deployment Scene Regions Scripting Advanced scenarios

More advanced scenarios

  • B. Wulff, A. Fecke

LectureSight 17 / 20

slide-32
SLIDE 32

Introduction Technology Deployment Scene Regions Scripting Advanced scenarios

More advanced scenarios

  • B. Wulff, A. Fecke

LectureSight 18 / 20

slide-33
SLIDE 33

Introduction Technology Deployment Scene Regions Scripting Advanced scenarios

More advanced scenarios

  • B. Wulff, A. Fecke

LectureSight 19 / 20

slide-34
SLIDE 34

Introduction Technology Deployment Scene Regions Scripting Advanced scenarios

Thank you!

Benjamin Wulff University of Osnabrück bwulff@uos.de www.lecturesight.org

  • B. Wulff, A. Fecke

LectureSight 20 / 20