Pics, ligne de base, bruit : s eparation ternaire de sources assist - - PowerPoint PPT Presentation

pics ligne de base bruit s eparation ternaire de sources
SMART_READER_LITE
LIVE PREVIEW

Pics, ligne de base, bruit : s eparation ternaire de sources assist - - PowerPoint PPT Presentation

I NTRODUCTION BEADS MODEL AND ALGORITHM E VALUATION AND RESULTS O NGOING , EXTENSIONS , CONCLUSION Pics, ligne de base, bruit : s eparation ternaire de sources assist ee (BEADS : positivit e, parcimonie), spectres chimiques &


slide-1
SLIDE 1

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Pics, ligne de base, bruit : s´ eparation ternaire de sources assist´ ee (BEADS : positivit´ e, parcimonie), spectres chimiques & miscellan´ ees

  • L. DUVAL, A. PIRAYRE

IFP Energies nouvelles

  • X. NING, I. W. SELESNICK

Polytechnic School of Engineering, New York University

23 mars 2018

1 / 33

slide-2
SLIDE 2

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Old peaks cast long shadows

Chromatography: the traditional 2D way.

2 / 33

slide-3
SLIDE 3

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Old peaks cast long shadows

Chromatography: individual 1D peaks for single compounds

2 / 33

slide-4
SLIDE 4

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Old peaks cast long shadows

Chromatography: ternary sources separated

2 / 33

slide-5
SLIDE 5

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Old peaks cast long shadows

Chromatography: observed signal

2 / 33

slide-6
SLIDE 6

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Old peaks cast long shadows

Chromatography: wrapping it up

2 / 33

slide-7
SLIDE 7

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

The quick version

◮ Issue: how to accurately & repeatably quantize peaks?

◮ avoiding separate baseline and noise removal

◮ Question: where is the string behind the bead?

◮ without too accurate models for: peak, noise, baseline

◮ Answer: use main measurement properties + optimization

◮ sparsity+symmetry, stationarity, smoothness

◮ BEADS: Baseline Estimation And Denoising w/ Sparsity

◮ other properties + optimization for further processing

(BARCHAN)

3 / 33

slide-8
SLIDE 8

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Outline

INTRODUCTION FOREWORD OUTLINE* BACKGROUND BEADS MODEL AND ALGORITHM NOTATIONS COMPOUND SPARSE DERIVATIVE MODELING MAJORIZE-MINIMIZE TYPE OPTIMIZATION EVALUATION AND RESULTS GC: SIMULATED BASELINE AND GAUSSIAN NOISE GC: SIMULATED POISSON NOISE GC: REAL DATA GC×GC: REAL DATA ONGOING, EXTENSIONS, CONCLUSION

4 / 33

slide-9
SLIDE 9

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Background on background

Image processing: varying illumination

◮ Background affects quantitative evaluation/comparison ◮ In other domains: (instrumental) bias, (seasonal) trend ◮ In analytical chemistry: drift, continuum, wander, baseline ◮ Very rare cases of parametric modeling (piecewise linear,

polynomial, spline)

5 / 33

slide-10
SLIDE 10

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Background on background

Econometrics: trends and seasonality

◮ Background affects quantitative evaluation/comparison ◮ In other domains: (instrumental) bias, (seasonal) trend ◮ In analytical chemistry: drift, continuum, wander, baseline ◮ Very rare cases of parametric modeling (piecewise linear,

polynomial, spline)

5 / 33

slide-11
SLIDE 11

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Background on background

Biomedical: ECG isoelectric line or baseline wander

◮ Background affects quantitative evaluation/comparison ◮ In other domains: (instrumental) bias, (seasonal) trend ◮ In analytical chemistry: drift, continuum, wander, baseline ◮ Very rare cases of parametric modeling (piecewise linear,

polynomial, spline)

5 / 33

slide-12
SLIDE 12

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Background on background

Gas chromatography: baseline

◮ Background affects quantitative evaluation/comparison ◮ In other domains: (instrumental) bias, (seasonal) trend ◮ In analytical chemistry: drift, continuum, wander, baseline ◮ Very rare cases of parametric modeling (piecewise linear,

polynomial, spline)

5 / 33

slide-13
SLIDE 13

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Background on background

Analytical chemistry, biological data

◮ Signal separation into three main morphological

components

6 / 33

slide-14
SLIDE 14

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Notations and assumptions

Morphological decomposition: y = x + f + w, signals in RN

◮ y: observation (spectrum, analytical data) ◮ x: clean series of peaks (no baseline, no noise) ◮ f: baseline ◮ w: noise

Assumption: without peaks, the baseline can be (approx.) recovered from noise-corrupted data by low-pass filtering

◮ ˆ

f = L(y − ˆ x): L: low-pass filter; H = I − L: high-pass filter

◮ formulated as y − ˆ

x − ˆ f2

2 = H(y − ˆ

x)2

2 ◮ Going further with Di: differentiation operators

7 / 33

slide-15
SLIDE 15

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Compound sparse derivative modeling

An estimate ˆ x can be obtained via: ˆ x = arg min

x

  • F(x) = 1

2H(y − x)2

2 + M

  • i=0

λiRi (Dix)

  • .

8 / 33

slide-16
SLIDE 16

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Compound sparse derivative modeling

Examples of (smooth) sparsity promoting functions for Ri

◮ φA i = |x| ◮ φB i =

  • |x|2 + ǫ

◮ φC i = |x| − ǫ log (|x| + ǫ)

8 / 33

slide-17
SLIDE 17

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Compound sparse derivative modeling

Take the positivity of chromatogram peaks into account: ˆ x = arg min

x

  • F(x) = 1

2H(y − x)2

2

+ λ0

N−1

  • n=0

θǫ(xn; r) +

M

  • i=1

λi

Ni−1

  • n=0

φ ([Dix]n)

  • .

Start from: θ(x; r) =

  • x,

x 0 −rx, x < 0

9 / 33

slide-18
SLIDE 18

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Compound sparse derivative modeling

Take the positivity of chromatogram peaks into account: ˆ x = arg min

x

  • F(x) = 1

2H(y − x)2

2

+ λ0

N−1

  • n=0

θǫ(xn; r) +

M

  • i=1

λi

Ni−1

  • n=0

φ ([Dix]n)

  • .

and majorize it

−5 5 2 4 6 8 10 The majorizer g(x, v) for the penalty function θ(x; r), r = 3 x (s, θr(s)) (v, θr(v)) g(x,v) θr(x)

9 / 33

slide-19
SLIDE 19

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Compound sparse derivative modeling

Take the positivity of chromatogram peaks into account: ˆ x = arg min

x

  • F(x) = 1

2H(y − x)2

2

+ λ0

N−1

  • n=0

θǫ(xn; r) +

M

  • i=1

λi

Ni−1

  • n=0

φ ([Dix]n)

  • .

then smooth it:

−5 5 2 4 6 8 10 The smoothed asymmetric penalty function θε(x; r), r = 3 (−ε, f(−ε)) (ε, f(ε)) x

9 / 33

slide-20
SLIDE 20

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Compound sparse derivative modeling

Take the positivity of chromatogram peaks into account: ˆ x = arg min

x

  • F(x) = 1

2H(y − x)2

2

+ λ0

N−1

  • n=0

θǫ(xn; r) +

M

  • i=1

λi

Ni−1

  • n=0

φ ([Dix]n)

  • .

then majorize it: g0(x, v) =   

1+r 4|v| x2 + 1−r 2 x + |v| 1+r 4 ,

|v| > ǫ

1+r 4ǫ x2 + 1−r 2 x + ǫ 1+r 4 ,

|v| ǫ.

9 / 33

slide-21
SLIDE 21

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Overall principle for Majoration-Minimization

x G(x, xk) xk xk+1 G(x, xk+1) xk+2 F(x)

MM principles.

10 / 33

slide-22
SLIDE 22

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

BEADS Algorithm (short)

Input: y, A, B, λi, i = 0, . . . , M 1. b = BTBA−1y 2. x = y (Initialization) Repeat 3. [Λi]n,n = φ′([Dix]n) [Dix]n , i = 0, . . . , M, 4. M =

M

  • i=0

λiDT

i ΛiDi

5. Q = BTB + ATMA 6. x = AQ−1b Until converged 8. f = y − x − BA−1(y − x) Output: x, f

11 / 33

slide-23
SLIDE 23

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Evaluation 1

1 2000 −10 10 20 30 40 50 Time (sample) 1 2000 −10 10 20 30 40 50 Time (sample) 1 2000 −10 10 20 30 40 50 Time (sample) 1 2000 −10 10 20 30 40 50 Time (sample)

Simulated chromatograms w/ polynomial+sine baseline

12 / 33

slide-24
SLIDE 24

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Evaluation 1 with Gaussian noise

13 / 33

slide-25
SLIDE 25

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Evaluation 2

1 2000 20 40 60 80 Time (sample) 1 2000 20 40 60 80 Time (sample) 1 2000 10 20 30 40 50 Time (sample) 1 2000 10 20 30 40 Time (sample)

Simulated chromatograms w/ limited power spectrum noise

14 / 33

slide-26
SLIDE 26

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Evaluation 2 with Gaussian noise

15 / 33

slide-27
SLIDE 27

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Evaluation 3 with Poisson noise

Simulated chromatograms w/ Poisson noise

16 / 33

slide-28
SLIDE 28

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Results: mono-dimensional chromatography (data 1)

Original, superimposed, clean, noise

17 / 33

slide-29
SLIDE 29

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Results: two-dimensional chromatography (data 2)

Original data

18 / 33

slide-30
SLIDE 30

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Results: two-dimensional chromatography (data 2)

2D background (estimated)

18 / 33

slide-31
SLIDE 31

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Results: two-dimensional chromatography (data 2)

Noise (estimated)

18 / 33

slide-32
SLIDE 32

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Results: two-dimensional chromatography (data 2)

BEADS corrected data

18 / 33

slide-33
SLIDE 33

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Results: two-dimensional chromatography (data 2)

Original data (again!)

18 / 33

slide-34
SLIDE 34

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Results: two-dimensional chromatography (data 3)

Original data

19 / 33

slide-35
SLIDE 35

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Results: two-dimensional chromatography (data 3)

2D background (estimated)

19 / 33

slide-36
SLIDE 36

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Results: two-dimensional chromatography (data 3)

Noise (estimated)

19 / 33

slide-37
SLIDE 37

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Results: two-dimensional chromatography (data 3)

BEADS corrected data

19 / 33

slide-38
SLIDE 38

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Results: two-dimensional chromatography (data 3)

Original data (again!)

19 / 33

slide-39
SLIDE 39

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Results: computing scalability

Linear cost per sample (almost)

20 / 33

slide-40
SLIDE 40

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Ongoing work

◮ Tests on analytical chemistry data: NIR, NMR, XPS ◮ Novel filtering: improved Savitzky-Golay filters ◮ Novel deconvolution: sparse & positive with norm ratios

SOOT: Non-convex ℓ0 count index approximation

◮ Novel metrics: errors related to peak quantities ◮ Baseline and noise use: uncertainty, trace products ◮ 2D chromatography comparisons: BARCHAN warping ◮ Improved usability: parameter estimation

21 / 33

slide-41
SLIDE 41

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

BARCHAN: 2D chromatography warping

No transformation Rigid Non-rigid BARCHAN

Semi-rigid morphing of two different 2D chromatograms.

22 / 33

slide-42
SLIDE 42

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

BARCHAN: 2D chromatography warping

Ingredients of a GMM plus EM optimization:

◮ Point sets X = {X1, . . . , XN} and Y = {Y1, . . . , YM} ◮ p(Xn) = w N + M m=1 1−w 2Mπσ2 exp

  • − Xn−T(Ym)2

2σ2

  • ◮ minσ,W,s,t E = E1(σ, W, s, t) + λ

2 Tr(W⊤GW)

Calculated deformation of a 2D chromatogram with BARCHAN.

23 / 33

slide-43
SLIDE 43

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

BARCHAN: 2D chromatography warping

Ingredients of a GMM plus EM optimization:

◮ Point sets X = {X1, . . . , XN} and Y = {Y1, . . . , YM} ◮ p(Xn) = w N + M m=1 1−w 2Mπσ2 exp

  • − Xn−T(Ym)2

2σ2

  • ◮ minσ,W,s,t E = E1(σ, W, s, t) + λ

2 Tr(W⊤GW)

Calculated deformation of a 2D chromatogram with BARCHAN.

23 / 33

slide-44
SLIDE 44

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

BARCHAN: 2D chromatography warping

Ingredients of a GMM plus EM optimization:

◮ Point sets X = {X1, . . . , XN} and Y = {Y1, . . . , YM} ◮ p(Xn) = w N + M m=1 1−w 2Mπσ2 exp

  • − Xn−T(Ym)2

2σ2

  • ◮ minσ,W,s,t E = E1(σ, W, s, t) + λ

2 Tr(W⊤GW)

Calculated deformation of a 2D chromatogram with BARCHAN.

23 / 33

slide-45
SLIDE 45

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Improved usability: parameter estimation

◮ Cut-off frequency estimation

24 / 33

slide-46
SLIDE 46

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Improved usability: parameter estimation

◮ Noise, asymmetry (r) and regularization (λ)

25 / 33

slide-47
SLIDE 47

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Extended applications

◮ Lidar application

26 / 33

slide-48
SLIDE 48

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Extended applications

◮ Engine knocking application

27 / 33

slide-49
SLIDE 49

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Other known uses

◮ A fairly generic model (sparsity, positivity/negativity),

reused by other authors

◮ gas chromatography: mono-dimensional and

comprehensive/two-dimensional

◮ Raman spectra: biological and biomedical ◮ MUSE (Multi Unit Spectroscopic Explorer): astronomical

hyperspectral galaxy spectrum

◮ X-ray absorption spectroscopy (XAS), X-ray diffraction

(XRD), and combined XAS/XRD

◮ high-resolution mass spectrometry ◮ postprandial Plasma Glucose (PPG), multichannel

electroencephalogram (EEG) and single-channel electrocardiogram (ECG)

◮ arabic characters 28 / 33

slide-50
SLIDE 50

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Other known uses

◮ A fairly generic model (sparsity, positivity/negativity),

reused by other authors

◮ gas chromatography: mono-dimensional and

comprehensive/two-dimensional

◮ Raman spectra: biological and biomedical ◮ MUSE (Multi Unit Spectroscopic Explorer): astronomical

hyperspectral galaxy spectrum

◮ X-ray absorption spectroscopy (XAS), X-ray diffraction

(XRD), and combined XAS/XRD

◮ high-resolution mass spectrometry ◮ postprandial Plasma Glucose (PPG), multichannel

electroencephalogram (EEG) and single-channel electrocardiogram (ECG)

◮ arabic characters 28 / 33

slide-51
SLIDE 51

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

Conclusions

◮ Joint baseline/background and noise estimation

◮ Interaction between “separative science” and “source

separation”

◮ Little ”hard” modeling ◮ Easy to tune, scalable ◮ Codes in Matlab, R and C++1

◮ A wide range of applications to unveil

1http://www.laurent-duval.eu/ siva-beads-baseline-background-removal-filtering-sparsity.html 29 / 33

slide-52
SLIDE 52

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

A little more: additional references

  • C. Vendeuvre, F. Bertoncini, L. Duval, J.-L. Duplan, D. Thi´

ebaut, and M.-C. Hennion. Comparison of conventional gas chromatography and comprehensive two-dimensional gas chromatography for the detailed analysis of petrochemical samples, .

  • J. Chrom. A, 2004, http://dx.doi.org/10.1016/j.chroma.2004.05.071
  • C. Vendeuvre, R. Ruiz-Guerrero, F. Bertoncini, L. Duval, D. Thi´

ebaut, and M.-C. Hennion. Characterisation of middle-distillates by comprehensive two-dimensional gas chromatography (GC × GC): A powerful alternative for performing various standard analysis of middle-distillates.

  • J. Chrom. A, 2005, http://dx.doi.org/10.1016/j.chroma.2005.05.106
  • C. Vendeuvre, R. Ruiz-Guerrero, F. Bertoncini, L. Duval, and D. Thi´

ebaut. Comprehensive two-dimensional gas chromatography for detailed characterisation of petroleum products. Oil Gas Sci. Tech., 2007, http://dx.doi.org/10.2516/ogst:2007004

  • X. Ning, I. W. Selesnick, and L. Duval.

Chromatogram baseline estimation and denoising using sparsity (BEADS).

  • Chemometr. Intell. Lab. Syst., 2014, http://dx.doi.org/10.1016/j.chemolab.2014.09.014
  • A. Repetti, M. Q. Pham, L. Duval, E. Chouzenoux, and J.-C. Pesquet.

Euclid in a taxicab: Sparse blind deconvolution with smoothed ℓ1/ℓ2 regularization. IEEE Signal Process. Lett., 2015, http://dx.doi.org/10.1109/LSP.2014.2362861

  • C. Couprie, L. Duval, M. Moreaud, S. H´

enon, M. Tebib, V. Souchon. BARCHAN: Blob Alignment for Robust CHromatographic ANalysis. Journal of Chromatography A., 2017, http://dx.doi.org/10.1016/j.chroma.2017.01.003

  • L. Duval, A. Pirayre and I. W. Selesnick.

Peaks, baseline and noise separation. Chapter in preparation for Source Separation in Physical-Chemical Sensing, 2018. 30 / 33

slide-53
SLIDE 53

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

BEADS Algorithm

We now have a majorizer for F G(x, v) = 1 2H(y − x)2

2 + λ0xT[Γ(v)]x

+ λ0bTx +

M

  • i=1

λi 2 (Dix)T [Λ(Div)] (Dix)

  • + c(v).

Minimizing G(x, v) with respect to x yields x =

  • HTH + 2λ0 Γ(v) +

M

  • i=1

λiDT

i [Λ(Div)] Di

−1 HTHy − λ0b

  • .

with notations c(v) =

  • n
  • φ(vn) − vn

2 φ′(vn)

  • .

31 / 33

slide-54
SLIDE 54

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

BEADS Algorithm

We now have a majorizer for F G(x, v) = 1 2H(y − x)2

2 + λ0xT[Γ(v)]x

+ λ0bTx +

M

  • i=1

λi 2 (Dix)T [Λ(Div)] (Dix)

  • + c(v).

Minimizing G(x, v) with respect to x yields x =

  • HTH + 2λ0 Γ(v) +

M

  • i=1

λiDT

i [Λ(Div)] Di

−1 HTHy − λ0b

  • .

with notations [Γ(v)]n,n =   

1+r 4|vn|,

|vn| ǫ

1+r 4ǫ ,

|vn| ǫ

31 / 33

slide-55
SLIDE 55

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

BEADS Algorithm

We now have a majorizer for F G(x, v) = 1 2H(y − x)2

2 + λ0xT[Γ(v)]x

+ λ0bTx +

M

  • i=1

λi 2 (Dix)T [Λ(Div)] (Dix)

  • + c(v).

Minimizing G(x, v) with respect to x yields x =

  • HTH + 2λ0 Γ(v) +

M

  • i=1

λiDT

i [Λ(Div)] Di

−1 HTHy − λ0b

  • .

with notations [Λ(v)]n,n = φ′(vn) vn

31 / 33

slide-56
SLIDE 56

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

BEADS Algorithm

We now have a majorizer for F G(x, v) = 1 2H(y − x)2

2 + λ0xT[Γ(v)]x

+ λ0bTx +

M

  • i=1

λi 2 (Dix)T [Λ(Div)] (Dix)

  • + c(v).

Minimizing G(x, v) with respect to x yields x =

  • HTH + 2λ0 Γ(v) +

M

  • i=1

λiDT

i [Λ(Div)] Di

−1 HTHy − λ0b

  • .

with notations [b]n = 1 − r 2

31 / 33

slide-57
SLIDE 57

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

BEADS Algorithm

Writing filter H = A−1B ≈ BA−1 (banded matrices) we have x = AQ−1 BTBA−1y − λ0ATb

  • where Q is the banded matrix,

Q = BTB + ATMA, and M is the banded matrix, M = 2λ0Γ(v) +

M

  • i=1

λiDT

i [Λ(Div)] Di.

32 / 33

slide-58
SLIDE 58

INTRODUCTION BEADS MODEL AND ALGORITHM EVALUATION AND RESULTS ONGOING, EXTENSIONS, CONCLUSION

BEADS Algorithm

Using previous equations, the MM iteration takes the form: M(k) = 2λ0Γ(x(k)) +

M

  • i=1

λiDT

i

  • Λ(Dix(k))
  • Di.

Q(k) = BTB + ATM(k)A x(k+1) = A[Q(k)]−1 BTBA−1y − λ0ATb

  • 33 / 33