11 numerical data e.g alphabetic order names w grades allowed - - PDF document

11
SMART_READER_LITE
LIVE PREVIEW

11 numerical data e.g alphabetic order names w grades allowed - - PDF document

Space efficient quantile selection Where U has order C an C U stream Input 9 000 11 numerical data e.g alphabetic order names w grades allowed multiple passes median return the Goal minimum w 6 space passes a quantile queries


slide-1
SLIDE 1

Space efficient

quantile selection

Input

stream

9 an C U

Where U has order C

000

11

e.g

numerical data

names

w

alphabetic order

grades

allowed multiple

passes

Goal

return

the median

w

minimum

a

passes

6 space

more

generally

quantile queries

select rank k element

kth largest

slide-2
SLIDE 2

I

pass

Input

exikhd.dk fT n

slide-3
SLIDE 3

i i kh

slide-4
SLIDE 4

Passe

Spacey

1

Och

sort

and select

Ollogn

OCI

quickselect

random pivot

p

rib

Munro Paterson 1981

2

Vis

quantile

summaries

slide-5
SLIDE 5

Approximations

given

rank

KEEN and

param

E

return

element

w

rank

k

En

f

K

Sampling

for median

18

elements sample

f return medias

  • f sample

for

rank k dn

sample

l

return

rank

de

  • ut
  • f

the

sample

Deterministic

slide-6
SLIDE 6
slide-7
SLIDE 7
slide-8
SLIDE 8
slide-9
SLIDE 9
slide-10
SLIDE 10
slide-11
SLIDE 11

Key

invariant

any

two

consecutive

intervals have width

E

2En

E APX

quantile summary

slide-12
SLIDE 12
slide-13
SLIDE 13
slide-14
SLIDE 14

Q

ai

get 94

9mi

w

intervals

3

To show Q

is

E APX

need

to

show

2Eb width

property

Take

two consecutive

intervals

in Q's

y E

g

Two

cases

elements

from

diff

sets

elements from

same

sets

slide-15
SLIDE 15
slide-16
SLIDE 16
slide-17
SLIDE 17
slide-18
SLIDE 18
slide-19
SLIDE 19
slide-20
SLIDE 20

Recap

we

can

combine

E APX quantile summaries

to get

E APX quantile summary of

wholething

sparsify

E APX quantile summary

to

tat

APX

quantile summary

w Kpoints

Remains

to address

how

to

make

  • ne

at

all

slide-21
SLIDE 21
slide-22
SLIDE 22

Space

D

D

D D

D

D

D

D

D D D

D D D D

  • nly keep

root summaries

slide-23
SLIDE 23

theorem

1

pass

OClog4n

E

space deterministic

E

APX

quantile

  • ver

stream

idea mergability

t dyadic intervals trick

slightly better

slide-24
SLIDE 24
slide-25
SLIDE 25

Theoremett

1

pass

0ClogicEh 1E

space deterministic

E

APX

quantile

  • ver

stream

Even better

Khanna

Greenwald 2001T

loafers

space

more sophisticated quantile

summary

merging

interval

trick

slide-26
SLIDE 26
slide-27
SLIDE 27