M4 meeting Sept 2004 Steve Renals University of Edinburgh Agenda - - - PowerPoint PPT Presentation

M4 meeting Sept 2004

Steve Renals University of Edinburgh

Agenda - Thursday

• 0900-0930 - Introduction
• 0930 - 1030 WP2 (video)
• TUM - Head Tracking
• Brno - Body part tracking and facer verif.
• Brno - Unrolling 360° video
• 1030-1100 Break
• 1100-1230 WP2 (Audio/video)
• USFD - AV tracking using oscillators
• IDIAP - Multi-object tracking (V and AV)
• TNO - Microphone arrays
• Brno - Speech procecessing
• Discussion (WP2 demos?)
• 1230 - 1400 Lunch

Agenda - Thursday

• 1400-1530 WP3
• TNO - Extractive summarization
• UniGe - Indexing large video collections
• Brno - Automatic video editor
• TUM - Meeting event recogniton
• UEDIN - Meeting structuring
• 1530-1600 Break
• 1600 - 1730 WP3, WP4
• WP3 discussion (meeting actions)
• IDIAP - Browser Evaluation Test
• Discussion - final demonstrator
• Bavarian evening

Agenda - Friday

• 0900 - 1030 Dissemination, exploitation, etc
• 2004 annual report
• Technological implementation plan (TIP)
• Finalizing the deliverables
• Final review
• 1030-1100 Any other business
• 1200 - 1600 Oktoberfest
• 1600 - 2300 (More Oktoberfest...)

Aims of the Meeting

• Final technical meeting of the project -

technical presentations

• Plan the final deliverables
• Try to tie up loose ends - let’s make the final

state of M4 as coherent as possible

• The TIP - Technological Implementation Plan
• M4 demonstrations (for final review)
• Experience the Oktoberfest

Deliverables

• Remaining deliverables all due end Feb 2005
• D2.2 - Final report on multimodal

recognizers

• D3.3 - Final report on multimodal

information access and integration

• D4.3 - Report on final demonstrator
• D5.4 - Technological Implementation Plan

Final review

• Year 2 review (Martigny, June 2004) was

“informal”; the outcome was very positive

• Final review will almost certainly involve the

same reviewers (J Foote and M Russell) and will be concurrent with the first AMI review

• In addition to the browser demo, some

“component demos” would be good

• Want to present project outcomes as

coherently as possible.

WP2 demos

• TUM - head tracking
• Brno - omnidirectional camera + tracking
• USFD - oscillator networks
• IDIAP - Multi-object tracking
• Brno - Keyword spotting?
• Action/gesture recognition (browser)
• Mic arrays? (probab via other apps?)
• Speech recognition (AMI - via browser)

M4 Annual report

• Due November 2004
• Short, web based, with 5-6 “highlights”:

100-200 words per highlight, plus images

• 2002: Meeting room, separation /

localization / tracking

• 2003: Media file server, speech processing,

tracking, meeting structure/events, demonstrator, user group / promotion / awareness

• What should we have in the 2004 report?

2004 Report

• Dissem / Exploitation
• Demonstrator + BET
• Portable meeting room + EPFL camera
• Multistream models
• Tracking

The TIP

• TIP = Technological Implementation Plan
• Must be completed for the end of the

project - required for all EC projects

• Includes:
• Overview and description
• Project impact
• Project results (all partners)
• Dissemination and use
• Contributions to EU policies / social
• bjectives (questionnaire for statistics)

Project results

• A number of results per project - agreed by

the project

• Each result has an owner who is responsible

for it in the TIP (including exploitation plans)

• Types of result: widely available (A); project

partners only (B); of no exploitable use (C)

• http://etip.cordis.lu

Results

• Portable meeting room - Brno
• Ferret browser - IDIAP
• USB camera - EPFL
• Multimodal indexing and retrieval - UniGe (TNO/

USFD)

• Media file server - IDIAP
• M4 data collection - IDIAP (Brno)
• Meeting event recognition - UEDIN (TUM/IDIAP/UT)
• Speech recognition/xtalk - USFD (Brno)
• Localization/tracking - TUM (IDIAP/Brno/USFD/TNO
• Multimodal Summarization - TNO (USFD/Brno)
• Annotation tools - UT (Brno)