M4 meeting Sept 2004 Steve Renals University of Edinburgh Agenda - - - PowerPoint PPT Presentation

m4 meeting sept 2004
SMART_READER_LITE
LIVE PREVIEW

M4 meeting Sept 2004 Steve Renals University of Edinburgh Agenda - - - PowerPoint PPT Presentation

M4 meeting Sept 2004 Steve Renals University of Edinburgh Agenda - Thursday 0900-0930 - Introduction 0930 - 1030 WP2 (video) TUM - Head Tracking Brno - Body part tracking and facer verif. Brno - Unrolling 360 video


slide-1
SLIDE 1

M4 meeting Sept 2004

Steve Renals University of Edinburgh

slide-2
SLIDE 2

Agenda - Thursday

  • 0900-0930 - Introduction
  • 0930 - 1030 WP2 (video)
  • TUM - Head Tracking
  • Brno - Body part tracking and facer verif.
  • Brno - Unrolling 360° video
  • 1030-1100 Break
  • 1100-1230 WP2 (Audio/video)
  • USFD - AV tracking using oscillators
  • IDIAP - Multi-object tracking (V and AV)
  • TNO - Microphone arrays
  • Brno - Speech procecessing
  • Discussion (WP2 demos?)
  • 1230 - 1400 Lunch
slide-3
SLIDE 3

Agenda - Thursday

  • 1400-1530 WP3
  • TNO - Extractive summarization
  • UniGe - Indexing large video collections
  • Brno - Automatic video editor
  • TUM - Meeting event recogniton
  • UEDIN - Meeting structuring
  • 1530-1600 Break
  • 1600 - 1730 WP3, WP4
  • WP3 discussion (meeting actions)
  • IDIAP - Browser Evaluation Test
  • Discussion - final demonstrator
  • Bavarian evening
slide-4
SLIDE 4

Agenda - Friday

  • 0900 - 1030 Dissemination, exploitation, etc
  • 2004 annual report
  • Technological implementation plan (TIP)
  • Finalizing the deliverables
  • Final review
  • 1030-1100 Any other business
  • 1200 - 1600 Oktoberfest
  • 1600 - 2300 (More Oktoberfest...)
slide-5
SLIDE 5

Aims of the Meeting

  • Final technical meeting of the project -

technical presentations

  • Plan the final deliverables
  • Try to tie up loose ends - let’s make the final

state of M4 as coherent as possible

  • The TIP - Technological Implementation Plan
  • M4 demonstrations (for final review)
  • Experience the Oktoberfest
slide-6
SLIDE 6

Deliverables

  • Remaining deliverables all due end Feb 2005
  • D2.2 - Final report on multimodal

recognizers

  • D3.3 - Final report on multimodal

information access and integration

  • D4.3 - Report on final demonstrator
  • D5.4 - Technological Implementation Plan
slide-7
SLIDE 7

Final review

  • Year 2 review (Martigny, June 2004) was

“informal”; the outcome was very positive

  • Final review will almost certainly involve the

same reviewers (J Foote and M Russell) and will be concurrent with the first AMI review

  • In addition to the browser demo, some

“component demos” would be good

  • Want to present project outcomes as

coherently as possible.

slide-8
SLIDE 8

WP2 demos

  • TUM - head tracking
  • Brno - omnidirectional camera + tracking
  • USFD - oscillator networks
  • IDIAP - Multi-object tracking
  • Brno - Keyword spotting?
  • Action/gesture recognition (browser)
  • Mic arrays? (probab via other apps?)
  • Speech recognition (AMI - via browser)
slide-9
SLIDE 9

M4 Annual report

  • Due November 2004
  • Short, web based, with 5-6 “highlights”:

100-200 words per highlight, plus images

  • 2002: Meeting room, separation /

localization / tracking

  • 2003: Media file server, speech processing,

tracking, meeting structure/events, demonstrator, user group / promotion / awareness

  • What should we have in the 2004 report?
slide-10
SLIDE 10

2004 Report

  • Dissem / Exploitation
  • Demonstrator + BET
  • Portable meeting room + EPFL camera
  • Multistream models
  • Tracking
slide-11
SLIDE 11

The TIP

  • TIP = Technological Implementation Plan
  • Must be completed for the end of the

project - required for all EC projects

  • Includes:
  • Overview and description
  • Project impact
  • Project results (all partners)
  • Dissemination and use
  • Contributions to EU policies / social
  • bjectives (questionnaire for statistics)
slide-12
SLIDE 12

Project results

  • A number of results per project - agreed by

the project

  • Each result has an owner who is responsible

for it in the TIP (including exploitation plans)

  • Types of result: widely available (A); project

partners only (B); of no exploitable use (C)

  • http://etip.cordis.lu
slide-13
SLIDE 13

Results

  • Portable meeting room - Brno
  • Ferret browser - IDIAP
  • USB camera - EPFL
  • Multimodal indexing and retrieval - UniGe (TNO/

USFD)

  • Media file server - IDIAP
  • M4 data collection - IDIAP (Brno)
  • Meeting event recognition - UEDIN (TUM/IDIAP/UT)
  • Speech recognition/xtalk - USFD (Brno)
  • Localization/tracking - TUM (IDIAP/Brno/USFD/TNO
  • Multimodal Summarization - TNO (USFD/Brno)
  • Annotation tools - UT (Brno)