ELKO Lalo In nllzi.io argmin Ln O OE du Elz a logpo.cz cst - - PDF document

SLIDE 1

MEAN FIELD METHODS IN HIGH DIMENSIONAL STATISTICS AND

NON CONVEX

OPTIMIZATION

n Motivation 2

Exact asymptotic

via Gaussian

comparison

3

First orderalgs

atom and AMP

4

Optimal GFOMs for regression

5

Optimizationof MF spin glasses

Background

6 AMP algorithms for optimization

7

Optimal AMP and connectionto

Parisi formula

Po geo

ER

prohstron X

Zi

Zn

ti id

Po

z

Z

Za

E

X

Rd

Et

8 z

Rio Oo

ETdist Ece

O

fat

e

Xxx

IR

• define L 10,0

Eto.lt

Oo

argmin L Goo

Lalo

In

nllzi.io

ELKO

argmin Ln O

OE du

Elz

a

logpo.cz

SLIDE 2

10,00

ftp.logpdzl KLCpqllp

cst

V

Lto a

e

Luh

Lacy

d fixed

n

a

Highdim

n d

7

nad

dimC 0

an so sparse vectors

SIR

So K d

S

Ch

Noisy hidim

da

d 7

1

Zi Tio IN18,2d INCOo Ia

• d

r

te

2

Sparse regression

2 i Lyi Xi

Xi

N lo Ia

Yi

Go Xi

Ei Ei nNlo

62

to

sparse

d lol fully Xollit

110th

E logpolz

promotes sparse 3

Robustregression

M estimation

Lalo

III Phi

Kiis Gaussian comparison

simple elegant

AMP

algorithmic

2 i

Zu Ot Ei

8 In

i

fCzi of

8 medianHi

Z1zi 01

plz

SLIDE 3

I

il

e

I

i f

i

theorem

Gordon

Xs e see e

Y.si

ses te

cent Gauss

Assemen

EXE

EYE

2

LFKX.tn Heat 3 ELLIE YET

that

3

EICXs.tixs.tl

s EICYs.a YHTV s.is

then mjnmzxcxst 3stfmsinm.ECsE3st

V C3st

A EB

PCA

u

PCB

u

FUHR

Rink GeneralizesFernique

I 71

1

a

Grollary

U E Rd VER

compact

Q cont

CG Tio N lo r

Cgi N od

hj

Nlo l

LG

run mix kv.Gui QCu.rsb

B gk

main mix

Meg u t.lu lsh.vi

Qlu vl

Then

P

Eu E 21743

5 u

fu

c IR

Further

if

minmax

is convex

concave

PC L ZulE2PCB

u

I

u

PCB an

Proof

Xu

living Hutch

Yau

LV Gu

t

2 HUH1hr11 z

NCO 1

E Yum

Yum

LFCXa.nluiT uF4vz7

11411114111141111411

CU Uz 1141111411 CVvz

11911HUH

SLIDE 4

U

z 11,111 211

C Vz I I11411

1141111411 equal

1141111411 IVrel

Z O

D

min mix

CY

Gu

t

I

mix min Esv Gu

min mix

CvCGlu

t

Ed G

B

How to apply it

• Oo

u

Ln lol tally Xoll

1

11014

y

Xootow

te

min Lalo

mninc.pe InHow

In 112 2119 4

maize mud It

argminLn

a

Oo UH

LE

S

mines Into

Lites

Lit

• nes

HE ooh 5

a

S

• lo o.HR

zE

n d so

I

8

Fro III So

Po

Txt f

sol of

Tko't

g ELI 0 221 053

I

e

yr

Ep

ez

D

E III

is

zlxs.nl

IH

a

signIs

SLIDE 5

The

fu _of

So.io

F

tanto z

• tEEIPCWdpi.fi

zt

fcce1e

niH P

118 Ooh

20

Class

I

n

dim loyd

• 110 0.112

8k

• 2

148,001

8 8

II

Ifi

• HE ooh

Inco

EfLz

min

llzi.tl

Marx C 2 l