Multimodal Music Tagging Task Nicola Orio University of Padova - - PowerPoint PPT Presentation

▶

Dec 11, 2022 474 likes •588 views

Multimodal Music Tagging Task Nicola Orio University of Padova Cynthia C.S. Liem Delft University of Technology Geoffroy Peeters IRCAM Markus Schedl Johannes Kepler University 1 CLEF2012, Rome 18/09/2012

SLIDE 1

Nicola Orio – University of Padova Cynthia C.S. Liem – Delft University of Technology Geoffroy Peeters – IRCAM Markus Schedl – Johannes Kepler University

CLEF2012, Rome 18/09/2012 MusiClef: Multimodal Msic Tagging Task

Multimodal Music Tagging Task

SLIDE 2

Evaluation Initiatives – 1

MIREX (since 2004)
Community-based selection of tasks
Many tasks address audio feature extraction algorithms
Participants submit algorithms that are run by organizers
Music files are not shared with participants
Million Song Dataset (since 2011)
One task on music proposed by organizers
Participants can run their
Audio features are computed using proprietary algorithms
Only features are shared with participants

CLEF2012, Rome 18/09/2012 MusiClef: Multimodal Msic Tagging Task

SLIDE 3

Evaluation Initiatives – 2

Quaero-Eval (since 2012)
Tasks agreed with participants
Strategies to grant public access to evaluation results
Participants run training experiments on a shared repository
Runs on test set made by the organizers
MediaEval (since 2008)
Started as VideoCLEF
Scope extended to other media
Emphasis on multimodality
Regular tasks, plus Brave New Tasks (e.g. MusiClef)

CLEF2012, Rome 18/09/2012 MusiClef: Multimodal Msic Tagging Task

SLIDE 4

Goals of MusiClef

To focus evaluation on professional application scenarios
Textual description of music items
To grant replication of experiments and results
Feature extraction phase is crucial
To promote the exploitation of multimodal sources of

information

Content (audio) + Context (tags & webpages)
To disseminate music related initiatives
Outside the music information retrieval community

CLEF2012, Rome 18/09/2012 MusiClef: Multimodal Msic Tagging Task

SLIDE 5

The workflow

CLEF2012, Rome 18/09/2012 MusiClef: Multimodal Msic Tagging Task

MusicCLEF

not public

MusicCLEF

public web site

Participant

participant pc .

last.fm

webservice MP3 Library Low level features

if(conn SELEC WHERE print

features extractor

1.read

Participant algorithms Low level features tags

if(conn SELEC WHERE print

last.fm data

3 . d

n l

4. read

results Results evaluation Campaign Participant Results

if(conn SELEC WHERE print

last.fm data

4. read
5. produce
2. produce

1 . h t t p r e q u e s t

7. publish

6 . s u b m i t

SLIDE 6