Unmixer An interface for extracting and remixing loops Jordan B. L. - - PowerPoint PPT Presentation

▶
unmixer
SMART_READER_LITE
LIVE PREVIEW

Unmixer An interface for extracting and remixing loops Jordan B. L. - - PowerPoint PPT Presentation

Dec 01, 2023 198 likes •479 views

Unmixer An interface for extracting and remixing loops Jordan B. L. Smith Yuta Kawasaki Masataka Goto Suppose you are a remix artist... Remix artists have ...but they want the the STEREO MIX... ISOLATED LOOPS. Song Ingredients

slide-1
SLIDE 1

Unmixer

An interface for extracting and remixing loops

Jordan B. L. Smith Yuta Kawasaki Masataka Goto

slide-2
SLIDE 2

Suppose you are a remix artist...

slide-3
SLIDE 3

Song Remix artists have the STEREO MIX... ...but they want the ISOLATED LOOPS.

G F E D C B A

Ingredients ← Composition ←

0:00 0:30 1:00

≈

Algorithm Interface → De-composition →

Goal of Unmixer: extract loops from mixed audio

slide-4
SLIDE 4

Unmixer Interface

slide-5
SLIDE 5
  • 1. User

uploads audio file

  • 2. Wait for

results (several minutes)

  • 3. Click tiles to

add or remove them from the mix

  • 4. Add more

songs, test out mashups

  • 5. Adjust

tempo

  • 6. Download

loops to remix in your favourite DAW

slide-6
SLIDE 6

Unmixer Algorithm

slide-7
SLIDE 7

Algorithm

  • 1. Compute spectrum

time → frequency →

slide-8
SLIDE 8

Algorithm

  • 1. Compute spectrum
  • 2. Estimate downbeats (madmom)

time → frequency →

slide-9
SLIDE 9

Algorithm

  • 1. Compute spectrum
  • 2. Estimate downbeats (madmom)
  • 3. Stack into cube

time → frequency → (in piece)

slide-10
SLIDE 10

Algorithm

  • 1. Compute spectrum
  • 2. Estimate downbeats (madmom)
  • 3. Stack into cube

time → frequency → (in piece)

slide-11
SLIDE 11

Algorithm

  • 1. Compute spectrum
  • 2. Estimate downbeats (madmom)
  • 3. Stack into cube

time → frequency → (in piece)

slide-12
SLIDE 12

Algorithm

  • 1. Compute spectrum
  • 2. Estimate downbeats (madmom)
  • 3. Stack into cube

time → frequency → (in piece)

slide-13
SLIDE 13

Algorithm

  • 1. Compute spectrum
  • 2. Estimate downbeats (madmom)
  • 3. Stack into cube

time → frequency → (in piece)

slide-14
SLIDE 14

Algorithm

  • 1. Compute spectrum
  • 2. Estimate downbeats (madmom)
  • 3. Stack into cube

time → frequency → (in piece)

slide-15
SLIDE 15

Algorithm

  • 1. Compute spectrum
  • 2. Estimate downbeats (madmom)
  • 3. Stack into cube

time → frequency → (in piece)

slide-16
SLIDE 16

Algorithm

  • 1. Compute spectrum
  • 2. Estimate downbeats (madmom)
  • 3. Stack into cube

time → frequency → (in piece)

slide-17
SLIDE 17

Algorithm

  • 1. Compute spectrum
  • 2. Estimate downbeats (madmom)
  • 3. Stack into cube

time → frequency → bar (in piece) → (in bar)

slide-18
SLIDE 18

Algorithm

  • 1. Compute spectrum
  • 2. Estimate downbeats (madmom)
  • 3. Stack into cube
  • 4. Compute Tucker


decomposition

time → frequency → bar (in piece) → (in bar)

slide-19
SLIDE 19

≈

time → frequency → bar (in piece) → (in bar)

slide-20
SLIDE 20

Tucker decomposition:

≈

~20M elements

Spectral cube

~0.2M elements

Core tensor and 3 templates

slide-21
SLIDE 21

≈

slide-22
SLIDE 22

≈

O n e s

  • u

n d . . . w i t h

  • n

e r h y t h m . . . a d d e d t

  • e

v e r y 
 i n s t a n c e

  • f

a 
 l

  • p

VISIT POSTER
 FOR BONUS SLIDES!

slide-23
SLIDE 23

≈

slide-24
SLIDE 24

Bar 52 Bar 58 Bar 65

slide-25
SLIDE 25

Bar 52 Bar 58 Bar 65

G F E D C B A

Ingredients
 for bar #60: Bar #60 Bar #60

Song: “Doin’ it Right” by Daft Punk

slide-26
SLIDE 26

https://unmixer.ongaaccel.jp

Thank you!

This work was supported in part by JST ACCEL Grant Number JPMJAC1602, Japan.

At our poster:

  • learn how loops are selected;
  • learn how “recipes” made

more independent;

  • use the interface!