Analysing Musical Pieces Using harmony-analyser.org Tools Ladislav - - PowerPoint PPT Presentation

▶
analysing musical pieces using harmony analyser org tools
SMART_READER_LITE
LIVE PREVIEW

Analysing Musical Pieces Using harmony-analyser.org Tools Ladislav - - PowerPoint PPT Presentation

Feb 21, 2023 475 likes •809 views

Analysing Musical Pieces Using harmony-analyser.org Tools Ladislav Mark Faculty of Mathematics and Physics, Charles University, Prague, Czech Republic DATESO 2017, Ranov, Czech Republic Music Information Retrieval Ladislav Mark

slide-1
SLIDE 1

Analysing Musical Pieces Using harmony-analyser.org Tools

Ladislav Maršík Faculty of Mathematics and Physics, Charles University, Prague, Czech Republic

DATESO 2017, Rančířov, Czech Republic

slide-2
SLIDE 2

Music Information Retrieval

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-3
SLIDE 3

Music Information Retrieval

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-4
SLIDE 4

Music Information Retrieval

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-5
SLIDE 5
  • ISMIR (Int. Society for Music Information Retrieval)
  • CMMR (Int. Symposium on Computer Music Interdisciplinary Research)
  • MCM (Mathematics and Computation in Music)
  • SMC (Sound and Music Computing)
  • DAFx (Int. Conference on Digital Audio Effects)
  • WASPAA (Workshop on Applications of Signal Proc. to Audio and Acoustics)
  • ICASSP (Int. Conf. on Acoustics, Speech and Signal Processing)
  • WOCMAT (Int. Workshop on Computer Music and Audio Technology)
  • ACMC (Australian Computer Music Conference)
  • ICMC (Int. Computer Music Conference)
  • ICNMC (Int. Conf. On New Music Concepts)

MIR / Musicology / Signal Processing Conferences

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-6
SLIDE 6
  • ISMIR (Int. Society for Music Information Retrieval)
  • CMMR (Int. Symposium on Computer Music Interdisciplinary Research)
  • MCM (Mathematics and Computation in Music)
  • SMC (Sound and Music Computing)
  • DAFx (Int. Conference on Digital Audio Effects)
  • WASPAA (Workshop on Applications of Signal Proc. to Audio and Acoustics)
  • ICASSP (Int. Conf. on Acoustics, Speech and Signal Processing)
  • WOCMAT (Int. Workshop on Computer Music and Audio Technology)
  • ACMC (Australian Computer Music Conference)
  • ICMC (Int. Computer Music Conference)
  • ICNMC (Int. Conf. On New Music Concepts)

MIR / Musicology / Signal Processing Conferences

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-7
SLIDE 7

MIR / Musicology / Signal Processing Journals

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

  • Transactions on Signal Processing (IEEE)
  • Journal of Math. and Music (Taylor Francis Online)
  • Computer Music Journal (MIT Press)
  • Signal Processing (Elsevier, EURASIP)
  • Transactions on Audio, Speech and Language Processing (IEEE/ACM)
  • Transactions on ISMIR (ISMIR)
  • The Journal of the Acoustical Society of America (ASA)
  • Journal on Audio, Speech, and Music Processing (EURASIP )
  • Journal on Advances in Signal Processing (EURASIP)
  • Journal of New Music Research (Taylor Francis Online)
  • Journal of the Audio Engineering Society (AES)
  • Journal of Interdisciplinary Music Studies (SIM)
  • Journal of Popular Music Studies (IASPM)
slide-8
SLIDE 8

MIR / Musicology / Signal Processing Journals

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

  • Transactions on Signal Processing (IEEE)
  • Journal of Math. and Music (Taylor Francis Online)
  • Computer Music Journal (MIT Press)
  • Signal Processing (Elsevier, EURASIP)
  • Transactions on Audio, Speech and Language Processing (IEEE/ACM)
  • Transactions on ISMIR (ISMIR)
  • The Journal of the Acoustical Society of America (ASA)
  • Journal on Audio, Speech, and Music Processing (EURASIP )
  • Journal on Advances in Signal Processing (EURASIP)
  • Journal of New Music Research (Taylor Francis Online)
  • Journal of the Audio Engineering Society (AES)
  • Journal of Interdisciplinary Music Studies (SIM)
  • Journal of Popular Music Studies (IASPM)
slide-9
SLIDE 9
  • CBMI (Content-Based Multimedia Indexing)
  • ACMMM (ACM Multimedia)
  • ICMR (Int. Conf. on Multimedia Retrieval)
  • ECIR (Europan Conf. on Information Retrieval)
  • AIRS (Asia I.R. Societies)
  • SPIRE (Int. Symp. on String Processing an I.R.)
  • SIGIR (Int. Conf. on Research and Dev. In I.R.)
  • SIGAPP SAC / IR Track
  • ICME (Int. Conf on Multimedia and Expo)
  • ISM (Int. Symp. on Multimedia)

Multimedia / IR Conferences

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-10
SLIDE 10
  • Computers in Entertainment (ACM)
  • Transactions on Multimedia (IEEE)
  • Multimedia Tools And Aplications (Springer)

Multimedia / IR Journals

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-11
SLIDE 11

Best MIR Universities

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-12
SLIDE 12

harmony-analyser.org

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-13
SLIDE 13

harmony-analyser.org

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-14
SLIDE 14

harmony-analyser.org

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-15
SLIDE 15

harmony-analyser.org

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-16
SLIDE 16

Harmony descriptor - Chord Distances

„Most important in music is its harmony.“ Ilja Zeljenka, Slovak Composer

Tonic Subdominant Dominant

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-17
SLIDE 17

Folk song: Slovenské mamičky Basic harmonic functions T – D – T – D

DEMO 1: Simple harmony movement

slide-18
SLIDE 18

DEMO 2: Complex harmony movement

Modifications of basic harmonic functions Dp - Tp - Sp - Dp

T7 - Dp - D7 Sp - Dmi Tp-Sdim - Dp

Sp - Dp - S7 Hiromi: 010101 (Binary System)

slide-19
SLIDE 19

Harmony descriptor: Chord Distances

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-20
SLIDE 20

Harmony descriptor: Chord Distances

 Our novel concept: Chord Complexity Distance

(a variation of Edit Distance)

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-21
SLIDE 21

Chord Distances

 Tonal Pitch Space (Fred Lerdahl)

TPS of C major chord in a C major key

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-22
SLIDE 22

Chord Distances in a Time Series

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-23
SLIDE 23

Experimental: Chroma Distances

Idea: If chord distances work, why chroma distances shouldn‘t Chord distance

Chroma distances

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-24
SLIDE 24

Experimental: Chroma Distances

Idea: If chord distances work, why chroma distances shouldn‘t Chord vector Chroma Vector

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-25
SLIDE 25

Experimental: Chroma Distances

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-26
SLIDE 26

Chord Distances in a Time Series

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-27
SLIDE 27

Results with our approach

  • Cover Song Identification

Picture: courtesy of co-author Martin Rusek, IT4Innovations National Supercomputing centre, Ostrava Evaluation of Chord and Chroma Distances and DTW method on Cover Song Identification, CISIM 2017

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-28
SLIDE 28

Results with our approach

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

Picture: courtesy of co-author Martin Rusek, IT4Innovations National Supercomputing centre, Ostrava Evaluation of Chord and Chroma Distances and DTW method on Cover Song Identification, CISIM 2017

slide-29
SLIDE 29

Results with our approach

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

Picture: courtesy of co-author Martin Rusek, IT4Innovations National Supercomputing centre, Ostrava Evaluation of Chord and Chroma Distances and DTW method on Cover Song Identification, CISIM 2017

  • ChordCD: 25ms matrix computation
  • Raw Chroma: ~50s
slide-30
SLIDE 30

Summary: harmony-analyser.org (JHarmonyAnalyser)

Ladislav Maršík – harmony-analyser.org – Java Library and Tools for Chordal Analysis WOCMAT 2016

  • Basic model of tones, chords, keys, …
  • Feature extraction (Chroma vectors
  • Implementation of chord distance models

(Tonal Pitch Space, Chord Complexity, …)

  • Experimental chroma distances
  • Extensible plugins
slide-31
SLIDE 31

Conclusion and Future work

 Proposal to use chord distances for MIR  New Chord Complexity Distance concept  harmony-analyser.org = Java library and ready-made tools, Open-Source project  Results to prove that this concept has a potential to improve recent MIR tasks  Genre detection  Cover Song Identification  … and one step towards the applications useful for musicologists  Future work:  More chord distances  Dynamic Time Warping + chord distances

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017

slide-32
SLIDE 32

Thank you for your attention

Ladislav Maršík – Analysing Musical Pieces Using harmony-analyser.org Tools DATESO 2017