U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
Paris Smaragdis
paris@illinois.edu paris.cs.illinois.edu
CS 498PS – Audio Computing Lab
Audio DSP basics Paris Smaragdis paris@illinois.edu - - PowerPoint PPT Presentation
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N CS 498PS Audio Computing Lab Audio DSP basics Paris Smaragdis paris@illinois.edu paris.cs.illinois.edu Overview U N I V E R S I T Y O F I L L I N O I S @ U R B A N
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
Paris Smaragdis
paris@illinois.edu paris.cs.illinois.edu
CS 498PS – Audio Computing Lab
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
2
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
3
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
4
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
5
1 2 3 4 5 6 7 8 9 10
0.5 1
0, 82, 126, 111, 44, -44, -111, -126, -82, 0
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
6
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
7
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
8
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
9
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
10
Dangerous levels > 90 dB Pain begins at 125 dB Pain ends at 180 dB (cause your ears just blew up)
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
11
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
12
10 20 30 40 50 60 70 80 90 100 −0.8 −0.6 −0.4 −0.2 0.2 0.4 0.6 0.8
Hiss Clipping Gone!
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
13
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
14
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
15
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
16 100 200 300 400 500 600 700 800 900 1000 −1 1 100 200 300 400 500 600 700 800 900 1000 −1 1 100 200 300 400 500 600 700 800 900 1000 −1 1
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
17
Frequency (Hz) Time (sec) 2 4 6 8 10 12 14 16 18 0.5 1 1.5 2 x 10
4
1kHz 3kHz 5kHz 7kHz 9kHz 11kHz 13kHz 15kHz 17kHz 19kHz 21kHz
How high can you hear? (or how good are the class speakers?)
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
18
Chirp @ 44,100 Hz Same chirp @ 22,050 Hz Same chirp @ 11,025 Hz
Frequency ⟶ Time ⟶ Time ⟶ Time ⟶
0 Hz 0 Hz 0 Hz 20 kHz 11 kHz 5.5 kHz
at 44.1kHz at 11kHz at 4kHz at 22kHz at 5kHz at 3kHz
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
19
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
20
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
21
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
22
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
23
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
24
Approximating a square wave
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
25
Waveform (time domain) “Spectrum” (frequency domain)
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
26
The one that we will use the most
x t
2π X ω
ω=−∞ ∞
↔ X ω
x t
t=−∞ ∞
x n ⎡ ⎣ ⎢ ⎤ ⎦ ⎥ = 1 2π Xd ω
ω=−π π
↔ Xd ω
x n ⎡ ⎣ ⎢ ⎤ ⎦ ⎥ e− jωt dt
t=−∞ ∞
x n ⎡ ⎣ ⎢ ⎤ ⎦ ⎥ = 1 N X k ⎡ ⎣ ⎢ ⎤ ⎦ ⎥ e
j2πkn N k=0 N−1
↔ X k ⎡ ⎣ ⎢ ⎤ ⎦ ⎥ = x n ⎡ ⎣ ⎢ ⎤ ⎦ ⎥ e
− j2πkn N n=0 N−1
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
27
− j2πkn N n=0 N−1
n=0 N−1
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
28
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
29
5 10 15 20 25 30
0.5 1
Single sine input
5 10 15 20
Complex spectrum
5 10 15 20
5 10 15 20
Polar spectrum
5 10 15 20 5 10 15 20 25 30
0.5 1
Single square input
5
Complex spectrum
5 10 15 20
5 10 15 20 25
Polar spectrum
5 10 15 20
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
30
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
31
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
32
20 40 60 80 100 120
0.5
Input
50 100 150 200 250 300 350
0.5
Periodic version
2 4 6 8
Fourier transform
10 20 30 40 50 60 70 20 40 60 80 100 120
0.2 0.4 0.6 0.8
Windowed input
50 100 150 200 250 300 350
0.2 0.4 0.6
Periodic version
1 2 3 4 5 6
Fourier transform
10 20 30 40 50 60 70
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
33
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
34
x n ⎡ ⎣ ⎢ ⎤ ⎦ ⎥
DFT
← → ⎯⎯ X k ⎡ ⎣ ⎢ ⎤ ⎦ ⎥, y n ⎡ ⎣ ⎢ ⎤ ⎦ ⎥
DFT
← → ⎯⎯ Y k ⎡ ⎣ ⎢ ⎤ ⎦ ⎥ ⇒ ax n ⎡ ⎣ ⎢ ⎤ ⎦ ⎥ +by n ⎡ ⎣ ⎢ ⎤ ⎦ ⎥
DFT
← → ⎯⎯ aX k ⎡ ⎣ ⎢ ⎤ ⎦ ⎥ +bY k ⎡ ⎣ ⎢ ⎤ ⎦ ⎥
x n ⎡ ⎣ ⎢ ⎤ ⎦ ⎥
DFT
← → ⎯⎯ X k ⎡ ⎣ ⎢ ⎤ ⎦ ⎥ ⇒ x ≪ n−no ≫ N ⎡ ⎣ ⎢ ⎤ ⎦ ⎥
DFT
← → ⎯⎯ X k ⎡ ⎣ ⎢ ⎤ ⎦ ⎥ e
− j2πk N n0
x n ⎡ ⎣ ⎢ ⎤ ⎦ ⎥
DFT
← → ⎯⎯ X k ⎡ ⎣ ⎢ ⎤ ⎦ ⎥ ⇒ x n ⎡ ⎣ ⎢ ⎤ ⎦ ⎥
2 n=0 N−1
= 1 N X k ⎡ ⎣ ⎢ ⎤ ⎦ ⎥
2 n=0 N−1
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
35
50 100 150 200 −1 1 20 40 60 80 100 50 100 50 100 150 200 −1 1 20 40 60 80 100 50 100 150 50 100 150 200 −1 1 20 40 60 80 100 10 20
Time series Magnitude spectrum
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
36
0.5 1 1.5 2 x 10
4
−80 −60 −40 −20 Frequency Power Spectrum Magnitude (dB) First 4 sec 0.5 1 1.5 2 x 10
4
−80 −60 −40 −20 Frequency Power Spectrum Magnitude (dB) Last 4 sec 0.5 1 1.5 2 x 10
4
−80 −60 −40 −20 Frequency Power Spectrum Magnitude (dB) Overall
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
37
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
38
Time series Time/Frequency
50 100 150 200 −1 −0.5 0.5 1 0.5 1 1.5 2 2.5 3 3.5 10 20 30 50 100 150 200 −1 −0.5 0.5 1 0.5 1 1.5 2 2.5 3 3.5 10 20 30 50 100 150 200 −1 −0.5 0.5 1 0.5 1 1.5 2 2.5 3 3.5 10 20 30
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
39
1000 2000 3000 4000 5000 6000 7000 8000 9000 10000
0.5 1 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 20 40 60 80 100 120
…
2 4 6 8 10 12 14 16 18 20 40 60 80 100 120
Input Magnitude spectra Spectrogram
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
40
Make frames DFT the frames Show them better
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
41
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
42
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
43
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
44
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
45
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
46
Frequency (Hz) Time (sec) 0.5 1 1.5 2 100 500 1000 2000 3500 5500 Frequency (Hz) Time (sec) 1 2 3 100 500 1000 2000 3500 8000 Frequency (Hz) Time (sec) 2 4 6 100 500 1000 2000 3500 12000 20000 Frequency (Hz) Time (sec) 2 4 6 100 500 1000 2000 3500 12000 20000
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
47
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
48
https:/ /www.youtube.com/watch?v=faBFiEfPxUU
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
49
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
50
… …
Spectra Inverse DFT on respective time Waveform
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
51
m=−∞ ∞
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
52
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
53
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
54
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
55
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
56
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
57
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
58
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
59
U N I V E R S I T Y O F I L L I N O I S @ U R B A N A - C H A M P A I G N
60