TRECVID 2015 Paul Over^ George Awad# Alan Smeaton (Dublin City - - PowerPoint PPT Presentation

▶
trecvid 2015
SMART_READER_LITE
LIVE PREVIEW

TRECVID 2015 Paul Over^ George Awad# Alan Smeaton (Dublin City - - PowerPoint PPT Presentation

Jan 28, 2024 400 likes •557 views

TREC Video Retrieval Evaluation TRECVID 2015 Paul Over^ George Awad# Alan Smeaton (Dublin City University) Ian Soboroff * Wessel Kraaij (TNO, Radboud University Nijmegen) Georges Qunot (Laboratoire dInformatique de Grenoble)

slide-1
SLIDE 1

TREC Video Retrieval Evaluation

TRECVID 2015

Paul Over^ George Awad# Alan Smeaton (Dublin City University) Ian Soboroff * Wessel Kraaij (TNO, Radboud University Nijmegen) Angela Ellis* Georges Quénot (Laboratoire d’Informatique de Grenoble) Darrin Dimmick* Roeland Ordelman (University of Twente) Jonathan Fiscus** Stephanie Strassel+ David Joy** Xuansong Li+ et al Martial Michel**

* Retrieval Group / ** Multimodal Information Group Information Access Division Information Technology Laboratory NIST + Linguistic Data Consortium # Dakota Consulting, Inc Silver Spring, MD ^ Retired

slide-2
SLIDE 2

Workshop series (2001 – present)  http://trecvid.nist.gov

to promote research/progress in content-based video analysis/exploitation

Foundation for large-scale laboratory testing Forum for the

  • exchange of research ideas
  • discussion of approaches – what works, what doesn’t, and why.

Focus: content-based approaches

  • search / detection / summarization / segmentation / …

Aims for realistic system tasks and test collections

  • unfiltered data
  • focus on relatively high-level functionality (e.g. interactive search)
  • measurement against human abilities

Provides data, tasks, and uniform, appropriate scoring procedures

What is TRECVID?

2 TRECVID 2015

slide-3
SLIDE 3

English TV News

500 1000 1500 2000 2500 3000 3500 4000 4500 TV news BBC rushes Sound & vision Airport Surveillance

Internet Archive Creative Commons

HAVIC Flickr

BBC East- Enders

TRECVID’s Evolution

Ad hoc search■■■■■■■■■■■■■■■■■ ■■■■■■■■■■■■■■■■■■■■■■■■ Features/semantic indexin■■■■■ ■■■■■■■■■■■■■■■■■■■■■■■■ ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■ Stories ■■■■■■ Camera motion■■ BBC rushes -

  • ■■■■■■■■■■■■■■ Summaries■■■■■■

Copy detection -

  • ■■■■■■■■■■■■■■

■■■■■■■■■■■■■■■■ Surveillance events (SED)

  • ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■

Known-item search (KIS) -

  • ■■■■■■■■■■■■■■■■■■■■■■■

Instance search (INS)

  • ■■■■■■■ ■■■■■■■ ■■■■■■■ ■■■■■■■■■■■■■■■■■■■■■

Multimedia event detection (MED) -

  • ■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■■

Multimedia event recounting (MER)-

  • ■■■■■■■■■■■■■■■■■■■■■

Video hyoperlinking

  • ■■■■■■

Localization-

  • ■■■■■■■■■■■■■■■■■■■■■
  • ■■■■■■■■■■■■■■■■■■
  • ■■■■■■

Tasks: Data: (hours) Rough notebook paper author count:

3 TRECVID 2015

New development or test data as added

100 200 300 400 500

1 2 3 4 5 6 7 8 9 10 11 12 13

… 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015 … 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014 2015

BBC hyper- linking

slide-4
SLIDE 4

TRECVID 2015 Tasks and Data

4

Internet Archive – Creative Commons (IACC) 200 h test data,video, title, keywords, description 687 hours dev video, metadata BBC EastEnders 464 h divided into 471527 shots BBC Video Hyperlink

  • c. 3000 h

mixed BBC programming Airport surveillance 50 h test video 100 h dev video HAVIC - Internet multimedia 7580 h, test video 2116 h, dev video

Semantic indexing (60 known test concepts submitted; 30 evaluated) Instance search (30 ad hoc image & video test queries) Video Hyperlinking (135 test anchors) Surveillance event detection (interactive) (7 known test events) Multimedia event detection (20 pre-specified &/or 10 ad hoc complex test events) Localization (10 known test concepts)

TRECVID 2015

slide-5
SLIDE 5

TRECVID 2015 5

TV2015 Finishers (46 teams)

PicSOM

  • -- *** LOC *** --- SIN Aalto U., U. of Helsinki

BUPT_MCPRL INS *** *** MED SED *** Beijing U. of Posts and Telecommunications Mcis

  • -- --- --- MED SED ---

Beijing Institute of Technology ITI_CERTH INS *** --- MED SED SIN Centre for Research and Technology Hellas CUNI --- LNK --- --- --- --- Charles U. in Prague CCNY --- --- LOC --- --- --- City College of New York; CUNY The Graduate Center VIREO *** LNK --- *** --- *** City University of Hong Kong VIREO-TNO

  • -- --- --- MED --- ---

City University of Hong Kong CMU --- LNK *** MED SED SIN CMU, CMU-Affiliates DCU_ADAPT_LNK --- LNK --- --- --- --- Dublin City U. - ADAPT Research Center insightdcu INS --- LOC --- --- SIN Dublin City U.; U. Polytechnica Barcelona etter --- --- --- MED --- --- Etter Solutions LLC EURECOM --- LNK --- --- --- SIN EURECOM FIU_UM --- --- --- --- --- SIN Florida International U.; U. of Miami BigVid

  • -- --- --- MED --- ---

Fudan U. ibm

  • -- --- --- --- SED ---

IBM IRISA --- LNK --- --- --- --- IRISA Inria Rennes - Bretagne Atlantique KoreaUnivISPL

  • -- --- --- MED --- ---

Korea U.; Intelligent Signal Processing Laboratory (ISPL) IRIM *** --- --- --- --- SIN IRIM Consortium LIG --- --- *** *** --- SIN Laboratoire d'Informatique de Grenoble METU_EE --- LNK --- *** --- --- Middle East Technical U. NII_Hitachi_UIT INS *** *** MED *** SIN Natl. Inst. of Inf.(NII); Hitachi; U. of Inf. Tech. NEU_MITLL --- --- --- MED --- --- Northeastern U.; MIT Lincoln Laboratory

slide-6
SLIDE 6

TRECVID 2015 6

TV2015 Finishers

nttfudan

  • -- --- --- MED SED ---

NTT Media Intelligence Laboratories; Fudan U. NTT INS --- --- --- --- --- NTT Comm. Science Lab.; NTT Media Intelligence Lab. ORAND INS LNK --- *** --- --- ORAND S.A. Chile PKU_ICST INS *** *** *** *** *** Peking U. BCMI.SJTU --- --- --- MED SED --- Shanghai Jiao Tong U. SeuGraph

  • -- --- --- *** SED ---

Southeast U. Jiulonghu Campus - Computer Graphics Lab TUC INS --- --- --- --- --- Technische Universitaet Chemnitz Trimps INS --- LOC --- *** --- Third Research Inst. of the Ministry of Public Security TJU_TJUT *** *** *** *** SED *** Tianjin U.; Tianjin U. of Technology TokyoTech *** *** LOC MED --- SIN Tokyo Institute of Technology Tsinghua_IMMG INS --- *** *** *** *** Tsinghua U. TUZ --- LNK --- --- --- --- TUBITAK UZAY MediaMill *** *** LOC MED --- SIN U. of Amsterdam Qualcomm Sheffield_UETLahore INS *** --- --- --- ---

  • U. of Sheffield, UK; U. of Eng. & Tech., Pakistan

siegen_kobe_nict

  • -- --- --- MED --- SIN U. of Siegen;Kobe U.; Natl.Inst. of Inf. and Comm. Tech.

UCF_CRCV --- --- --- *** --- SIN U. of Central Florida UEC --- *** *** MED --- SIN U. of Electro-Communications UQMG INS --- --- *** *** *** U. of Queensland - DKE Group of ITEE WARD --- --- --- --- SED ---

  • U. of Queensland - School of Inf. Tech. & Elec. Eng.

Waseda

  • -- --- --- --- --- SIN Waseda U.

IIP_WHU --- LNK --- --- SED --- Wuhan U. - Intelligent Information Processing Lab U_TK INS --- *** --- --- ---

  • U. of Tokushima

NERCMS INS --- --- --- *** *** Wuhan U. – Natl. Eng. Research Center for Multimedia Software, School of Computer

slide-7
SLIDE 7

TRECVID 2015 7

TV2015 Finishers

Groups Finished Task code Task name 11 SED Surveillance event detection 15 SIN Semantic indexing 14 INS Instance search 16 MED Multimedia event detection 10 LNK Video hyperlinking 6 LOC Localization 25 15 8 1 2

Unique finishing teams

Asia Europe North America South America Australia

slide-8
SLIDE 8

TRECVID 2015

Support

The running of TRECVID 2015 has been funded directly by:

  • National Institute of Standards and Technology (NIST)
  • Intelligence Advanced Research Projects Activity (IARPA)

TRECVID is only possible because of the additional efforts of many individuals and groups around the world.

8

slide-9
SLIDE 9

TRECVID 2015

Additional resources and contributions

  • Georges Quénot
  • shared coordination of the semantic indexing task
  • provided the master shot reference for the IACC.2 video
  • arranged for ASR for IACC.2 video
  • Koichi Shinoda of the TokyoTechCanon team agreed to host a

copy of the IACC.2 data

  • The LIMSI Spoken Language Processing Group and VexSys

Research provided ASR for the IACC.2 videos

  • Noel O'Connor and Kevin McGuinness at Dublin City University

along with Robin Aly at the University of Twente worked with NIST and Andy O’Dwyer plus William Hayes at the BBC to make the BBC EastEnders video available for use in TRECVID

  • Roeland Ordelman and Robin Aly (Univ. of Twente, NL), Maria

Eskevich and Benoit Huet (Eurecom, Fr), Gareth Jones and David Racca (DCU, Ir) Coordinated the Video hyperlinking task

9

slide-10
SLIDE 10

TRECVID 2015

Agenda: Day 1

  • Arranged by task
  • Time for discussion of approaches & evaluation
  • Monday
  • Intros, thanks, etc.
  • Semantic indexing
  • Concept localization
  • Lunch
  • Instance search
  • Workshop dinner

10

slide-11
SLIDE 11

TRECVID 2015

Agenda: Day 2

  • Tuesday
  • Multimedia event detection
  • Lunch
  • Video hyperlinking
  • Poster/demo boaster
  • Posters and demos with refreshments

11

slide-12
SLIDE 12

TRECVID 2015

Agenda: Day 3

  • Wednesday
  • Surveillance event detection
  • TRECVID planning
  • Workshop close

12

slide-13
SLIDE 13

TRECVID 2015

Miscellany

  • If you have registered for the workshop dinner and will not be using

your ticket, please turn it in at the registration desk during the break this morning or at lunch so someone else who wants to attend can use it.

13