MIR FOR CLASSICAL MUSIC Dasaem Jeong PhD Student PhD student in - - PowerPoint PPT Presentation

▶
mir for classical music
SMART_READER_LITE
LIVE PREVIEW

MIR FOR CLASSICAL MUSIC Dasaem Jeong PhD Student PhD student in - - PowerPoint PPT Presentation

Sep 28, 2023 359 likes •665 views

MIR FOR CLASSICAL MUSIC Dasaem Jeong PhD Student PhD student in MAC Lab Bachelor in Mechanical Engineering Master in Culture Technology ... in KAIST What do I research? Classical Music Delivering to listeners Genre-specific

slide-1
SLIDE 1

MIR FOR CLASSICAL MUSIC

Dasaem Jeong PhD Student

slide-2
SLIDE 2

정다샘

PhD student in MAC Lab Bachelor in Mechanical Engineering Master in Culture Technology ... in KAIST

slide-3
SLIDE 3

What do I research?

slide-4
SLIDE 4

Classical Music Delivering to listeners

slide-5
SLIDE 5

Genre-specific Research Each genre has its own characteristics It helps to make more assumption

slide-6
SLIDE 6
slide-7
SLIDE 7
slide-8
SLIDE 8
slide-9
SLIDE 9

Characteristics of classical music How can we put these two music in one category?

slide-10
SLIDE 10

The Score

slide-11
SLIDE 11

Even 4’ 33’’ has score

slide-12
SLIDE 12

There is no authentic performance

  • r original recording of the piece
slide-13
SLIDE 13

Score (sheet) Variety in performance

slide-14
SLIDE 14

Audio-score alignment

slide-15
SLIDE 15

Audio-to-Score Alignment

Score Score Audio Target Audio

slide-16
SLIDE 16

Audio-to-Score Alignment

Score Score Audio Target Audio

slide-17
SLIDE 17

Audio-to-Score Alignment Calculate similarity by comparing every frame-by-frame Dynamic Time Warping

slide-18
SLIDE 18

Automatic Accompaniment

slide-19
SLIDE 19

Performance Analysis

slide-20
SLIDE 20

What is the secret of 
 great pianists?

Whitestone Photo

slide-21
SLIDE 21

Vladimir Horowitz

slide-22
SLIDE 22

Tempo Intensity

slide-23
SLIDE 23

Limitation of previous research Intensity is calculated in beat-level Assumption: Simultaneously played notes have same intensity

slide-24
SLIDE 24

Estimating intensity of individual note

Basis Activation Spectrum Basis

≈

X V ≈ WH

Spectrum Basis: Spectrum of each piano key Basis Activation: Activation of each piano key over time

slide-25
SLIDE 25

Result Melody shows more intensity than accompaniment part.

slide-26
SLIDE 26

Application

slide-27
SLIDE 27

PerformScore

slide-28
SLIDE 28

MIDI XML

slide-29
SLIDE 29

Future Project