SoundPaint Painting Music http://www.ipd.uka.de/~reuter/soundpaint/ - - PowerPoint PPT Presentation

▶
soundpaint painting music
SMART_READER_LITE
LIVE PREVIEW

SoundPaint Painting Music http://www.ipd.uka.de/~reuter/soundpaint/ - - PowerPoint PPT Presentation

Nov 08, 2022 163 likes •330 views

SoundPaint Painting Music http://www.ipd.uka.de/~reuter/soundpaint/ Jrgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05 Motivation Integration of sound engineering & composing More expressive electronic music Graphics as

slide-1
SLIDE 1

Jürgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05

SoundPaint — Painting Music

http://www.ipd.uka.de/~reuter/soundpaint/

slide-2
SLIDE 2

Jürgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05

Motivation

  • Integration of sound engineering & composing
  • More expressive electronic music
  • Graphics as input
  • Stick close to graphical notation
  • Simple, intuitive interface
slide-3
SLIDE 3

Jürgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05

Additive Synthesis

slide-4
SLIDE 4

Jürgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05

Sound Example

slide-5
SLIDE 5

Jürgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05

Color -> Sound

slide-6
SLIDE 6

Jürgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05

Color -> Sound Mapping Goals

  • User-definable
  • Cover all colors
  • Require only few data for definition
  • Keep it simple (not targeted at math experts)
  • Map color gradients => sound gradients
slide-7
SLIDE 7

Jürgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05

RGB Color Space

slide-8
SLIDE 8

Jürgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05

Color -> Sound Mapping Approach

  • Problem: infinite dimensional sound space
  • Idea: select 3-dimensional sound subspace
  • Assign 3 colors to 3 sounds
  • Interpolate all other colors
  • => all goals fulfilled
slide-9
SLIDE 9

Jürgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05

Color -> Sound Mapping

slide-10
SLIDE 10

Jürgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05

Mapping Issues

  • Just doing linear interpolation on wave forms
  • => color gradients simply map to crossfading
  • Does not sound very appealing, but just like

mixing 3 sound sources

  • Need rather something like sound morphing
slide-11
SLIDE 11

Jürgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05

Mapping Revisited

  • Solution: add non-linear content

– i.e. any sound parameter not controllable by

crossfading

– e.g. vibrato rate/depth, detune depth, echo speed, ... – only assumption: parameter can be linearly

controlled, e.g. by moving a slider

  • Now linearly
slide-12
SLIDE 12

Jürgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05

Generalized Mapping

  • Interpolate sounds by

– linear combining wave forms (wave form

crossfading)

– linearly interpolating sound parameters of non-linear

sound content

  • => get something similar to sound morphing
slide-13
SLIDE 13

Jürgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05

User Interface

slide-14
SLIDE 14

Jürgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05

User Interface (cont.)

slide-15
SLIDE 15

Jürgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05

Future Work

  • Subtractive colors, HSB color space
  • More non-linear parameters
  • Integrated graphics editor
  • Real-time capabilities, DJ stuff (looping, ...)
  • Raster vs. vector graphics?
slide-16
SLIDE 16

Jürgen Reuter LAC 2005 Karlsruhe, Germany 23/04/05

Questions?