Similarity and Segmenta.on for Electronic Dance Music Bruno - - PowerPoint PPT Presentation

similarity and segmenta on for electronic dance music
SMART_READER_LITE
LIVE PREVIEW

Similarity and Segmenta.on for Electronic Dance Music Bruno - - PowerPoint PPT Presentation

Universiteit van Amsterdam 17 January 2013 Similarity and Segmenta.on for Electronic Dance Music Bruno Rocha Aline Honingh Niels Bogaards Victor Bergen Henegouwen Goal Similar


slide-1
SLIDE 1

Similarity ¡and ¡Segmenta.on ¡for ¡Electronic ¡ Dance ¡Music

Universiteit ¡van ¡Amsterdam 17 ¡January ¡2013

Bruno ¡Rocha Aline ¡Honingh Niels ¡Bogaards Victor ¡Bergen ¡Henegouwen

slide-2
SLIDE 2

Goal

Electronic Dance Music (EDM) Mobile App Similar tempo Similar timbre Similar rhythm ...

slide-3
SLIDE 3

Music

Electronic Dance Music

Seg B2

Timbre Features

User Collection

Song B Song A

Seg A1 Seg A2 Seg A3 Seg B1 Seg B2

Seg A1

Timbre Features

Seg A3

Timbre Features Rhythm Features

Distance Distance

Song N

Rhythm Features Rhythm Features

Methodology

slide-4
SLIDE 4

SimMixer

iPad test app for timbre similarity

  • database contains 1295 EDM songs
  • segmented into 22745 segments
  • each segment is represented by 31 timbre

descriptors

  • SimMixer is a tool to explore and validate

the timbre similarity algorithms

slide-5
SLIDE 5

Research Issues

Segmentation

  • Detection of first downbeat
  • typical EDM structure starts with bass drum
  • critical step for the detection of the structure

Figure 1: Detection of first downbeat

slide-6
SLIDE 6

Research Issues

Segmentation

  • Segment boundaries fine-tuning
  • segmentation algorithm detects timbre changes
  • segment boundaries in EDM are known to

usually coincide with beats

Figure 2: Segment boundaries fine-tuning

  • B. Rocha, N. Bogaards, A. Honingh, “Unsupervised detection of structural changes in electronic dance music”, DMRN, UK, 2012
slide-7
SLIDE 7

Development

  • Work method
  • develop a working algorithm
  • test feasibility
  • test usability
  • develop product(s)

Matlab C++ iPad optimized Figure 3: Tool Chain

slide-8
SLIDE 8

Lessons Learned

  • optimized implementation can only start after the

algorithm is done (lost quite some time implementing sub-algorithms that in the end are not used)

  • important to establish ground truth / reference early
  • n, but a problem is that it may not be clear what

exactly needs to be researched / developed (for instance: problem of segmentation)

  • plan research sub-projects carefully, to allow

implementation to start asap and increase involvement by industrial partner

slide-9
SLIDE 9

Conclusion

  • University vs (small) Company
  • Science vs Commerce
  • Science - Company - Audience
slide-10
SLIDE 10

Horizon

  • Intelligent mobile music tools