Welcome back... Welcome back... ..to me. Welcome back... ..to me. - - PowerPoint PPT Presentation

welcome back welcome back
SMART_READER_LITE
LIVE PREVIEW

Welcome back... Welcome back... ..to me. Welcome back... ..to me. - - PowerPoint PPT Presentation

Welcome back... Welcome back... ..to me. Welcome back... ..to me. Test out Welcome back... ..to me. Test out ! Welcome back... ..to me. Test out !! Welcome back... ..to me. Test out !!! Welcome back... ..to me. Test out !!! Dont


slide-1
SLIDE 1

Welcome back...

slide-2
SLIDE 2

Welcome back...

..to me.

slide-3
SLIDE 3

Welcome back...

..to me. Test out

slide-4
SLIDE 4

Welcome back...

..to me. Test out !

slide-5
SLIDE 5

Welcome back...

..to me. Test out !!

slide-6
SLIDE 6

Welcome back...

..to me. Test out !!!

slide-7
SLIDE 7

Welcome back...

..to me. Test out !!! Don’t worry.

slide-8
SLIDE 8

Welcome back...

..to me. Test out !!! Don’t worry. Be happy.

slide-9
SLIDE 9

Welcome back...

..to me. Test out !!! Don’t worry. Be happy. Look at instructions.

slide-10
SLIDE 10

Welcome back...

..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration.

slide-11
SLIDE 11

Welcome back...

..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration. Private message on piazza.

slide-12
SLIDE 12

Welcome back...

..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration. Private message on piazza. Note: Content can be declassified.

slide-13
SLIDE 13

Welcome back...

..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration. Private message on piazza. Note: Content can be declassified. Turn in by Monday.

slide-14
SLIDE 14

Welcome back...

..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration. Private message on piazza. Note: Content can be declassified. Turn in by Monday. Grade by Wednesday

slide-15
SLIDE 15

Welcome back...

..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration. Private message on piazza. Note: Content can be declassified. Turn in by Monday. Grade by Wednesday .. night

slide-16
SLIDE 16

Welcome back...

..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration. Private message on piazza. Note: Content can be declassified. Turn in by Monday. Grade by Wednesday .. night ...late

slide-17
SLIDE 17

Welcome back...

..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration. Private message on piazza. Note: Content can be declassified. Turn in by Monday. Grade by Wednesday .. night ...late ..hopefully.

slide-18
SLIDE 18

Welcome back...

..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration. Private message on piazza. Note: Content can be declassified. Turn in by Monday. Grade by Wednesday .. night ...late ..hopefully. Try to get it in then or soon after!

slide-19
SLIDE 19

Pareto:

slide-20
SLIDE 20

Pareto: 20% of pods have 80% of peas.

slide-21
SLIDE 21

Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land.

slide-22
SLIDE 22

Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land.

slide-23
SLIDE 23

Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land. City populations:

slide-24
SLIDE 24

Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land. City populations: ith largest city has population p1

i .

slide-25
SLIDE 25

Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land. City populations: ith largest city has population p1

i .

logi logfreq

slide-26
SLIDE 26

Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land. City populations: ith largest city has population p1

i .

logi logfreq Zipf’s law.

slide-27
SLIDE 27

Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land. City populations: ith largest city has population p1

i .

logi logfreq Zipf’s law. Zipf’s graph.

slide-28
SLIDE 28

Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land. City populations: ith largest city has population p1

i .

logi logfreq Zipf’s law. Zipf’s graph.

slide-29
SLIDE 29

Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land. City populations: ith largest city has population p1

i .

logi logfreq Zipf’s law. Zipf’s graph. Not a distribution.

slide-30
SLIDE 30

As a distribution.

Pareto.

slide-31
SLIDE 31

As a distribution.

Pareto. Incomei ∝ income1

.

slide-32
SLIDE 32

As a distribution.

Pareto. Incomei ∝ income1

.

slide-33
SLIDE 33

As a distribution.

Pareto. Incomei ∝ income1

. Bill Gates...then someone much less.

slide-34
SLIDE 34

As a distribution.

Pareto. Incomei ∝ income1

. Bill Gates...then someone much less. Prelude: why?

slide-35
SLIDE 35

As a distribution.

Pareto. Incomei ∝ income1

. Bill Gates...then someone much less. Prelude: why? Rich get richer?

slide-36
SLIDE 36

As a distribution.

Pareto. Incomei ∝ income1

. Bill Gates...then someone much less. Prelude: why? Rich get richer? Distribution:

slide-37
SLIDE 37

As a distribution.

Pareto. Incomei ∝ income1

. Bill Gates...then someone much less. Prelude: why? Rich get richer? Distribution: Pareto.

slide-38
SLIDE 38

As a distribution.

Pareto. Incomei ∝ income1

. Bill Gates...then someone much less. Prelude: why? Rich get richer? Distribution: Pareto. Pr[X ≥ x] ∝ x−α+1.

slide-39
SLIDE 39

As a distribution.

Pareto. Incomei ∝ income1

. Bill Gates...then someone much less. Prelude: why? Rich get richer? Distribution: Pareto. Pr[X ≥ x] ∝ x−α+1. Survival function.

slide-40
SLIDE 40

As a distribution.

Pareto. Incomei ∝ income1

. Bill Gates...then someone much less. Prelude: why? Rich get richer? Distribution: Pareto. Pr[X ≥ x] ∝ x−α+1. Survival function. Note: “p.d.f.”

slide-41
SLIDE 41

As a distribution.

Pareto. Incomei ∝ income1

. Bill Gates...then someone much less. Prelude: why? Rich get richer? Distribution: Pareto. Pr[X ≥ x] ∝ x−α+1. Survival function. Note: “p.d.f.” Pr[X = x] ∝ x−alpha. See Adamic for comment on estimating for real data. http://www.hpl.hp.com/research/idl/papers/ranking/ranking.html

slide-42
SLIDE 42

As a distribution.

Pareto. Incomei ∝ income1

. Bill Gates...then someone much less. Prelude: why? Rich get richer? Distribution: Pareto. Pr[X ≥ x] ∝ x−α+1. Survival function. Note: “p.d.f.” Pr[X = x] ∝ x−alpha. See Adamic for comment on estimating for real data. http://www.hpl.hp.com/research/idl/papers/ranking/ranking.html MAKE SOME DRAWINGS.

slide-43
SLIDE 43

Pareto to Zipf

Zipf:

slide-44
SLIDE 44

Pareto to Zipf

Zipf: ith guy has C 1

slide-45
SLIDE 45

Pareto to Zipf

Zipf: ith guy has C 1

slide-46
SLIDE 46

Pareto to Zipf

Zipf: ith guy has C 1

N people.

slide-47
SLIDE 47

Pareto to Zipf

Zipf: ith guy has C 1

N people. How many people have value more than xi?

slide-48
SLIDE 48

Pareto to Zipf

Zipf: ith guy has C 1

N people. How many people have value more than xi? On expection?

slide-49
SLIDE 49

Pareto to Zipf

Zipf: ith guy has C 1

N people. How many people have value more than xi? On expection? NDx−α+1.

slide-50
SLIDE 50

Pareto to Zipf

Zipf: ith guy has C 1

N people. How many people have value more than xi? On expection? NDx−α+1. ith guy has more than xi

slide-51
SLIDE 51

Pareto to Zipf

Zipf: ith guy has C 1

N people. How many people have value more than xi? On expection? NDx−α+1. ith guy has more than xi ≡ i guys have more than xi

slide-52
SLIDE 52

Pareto to Zipf

Zipf: ith guy has C 1

N people. How many people have value more than xi? On expection? NDx−α+1. ith guy has more than xi ≡ i guys have more than xi

slide-53
SLIDE 53

Pareto to Zipf

Zipf: ith guy has C 1

N people. How many people have value more than xi? On expection? NDx−α+1. ith guy has more than xi ≡ i guys have more than xi i ≈ NDx−α+1

i

slide-54
SLIDE 54

Pareto to Zipf

Zipf: ith guy has C 1

N people. How many people have value more than xi? On expection? NDx−α+1. ith guy has more than xi ≡ i guys have more than xi i ≈ NDx−α+1

i

slide-55
SLIDE 55

Pareto to Zipf

Zipf: ith guy has C 1

N people. How many people have value more than xi? On expection? NDx−α+1. ith guy has more than xi ≡ i guys have more than xi i ≈ NDx−α+1

i

xi =

1 i1/(1−α)

slide-56
SLIDE 56

Pareto to Zipf

Zipf: ith guy has C 1

N people. How many people have value more than xi? On expection? NDx−α+1. ith guy has more than xi ≡ i guys have more than xi i ≈ NDx−α+1

i

xi =

1 i1/(1−α)

Relationship: β =

1 1−α

slide-57
SLIDE 57

Self similarity.

Power laws.

slide-58
SLIDE 58

Self similarity.

Power laws. No matter where you are there you are...

slide-59
SLIDE 59

Self similarity.

Power laws. No matter where you are there you are... xt+1 = xt ×γ.

slide-60
SLIDE 60

Self similarity.

Power laws. No matter where you are there you are... xt+1 = xt ×γ. Actually γt ≈ (1+β/t).

slide-61
SLIDE 61

Self similarity.

Power laws. No matter where you are there you are... xt+1 = xt ×γ. Actually γt ≈ (1+β/t). Roughly constant for interval of wdith β.

slide-62
SLIDE 62

Power law and philosophy.

Wow!

slide-63
SLIDE 63

Power law and philosophy.

Wow! Power laws.

slide-64
SLIDE 64

Power law and philosophy.

Wow! Power laws. Cool.

slide-65
SLIDE 65

Power law and philosophy.

Wow! Power laws. Cool. Zipf: for frequency of words.

slide-66
SLIDE 66

Power law and philosophy.

Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!!

slide-67
SLIDE 67

Power law and philosophy.

Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!! Must have something to do with the brain!

slide-68
SLIDE 68

Power law and philosophy.

Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!! Must have something to do with the brain! Wentian Li.

slide-69
SLIDE 69

Power law and philosophy.

Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!! Must have something to do with the brain! Wentian Li. Document: “A quick brown fox jumps over the ....”

slide-70
SLIDE 70

Power law and philosophy.

Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!! Must have something to do with the brain! Wentian Li. Document: “A quick brown fox jumps over the ....” Permute the letters at random..

slide-71
SLIDE 71

Power law and philosophy.

Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!! Must have something to do with the brain! Wentian Li. Document: “A quick brown fox jumps over the ....” Permute the letters at random..and get a power law

slide-72
SLIDE 72

Power law and philosophy.

Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!! Must have something to do with the brain! Wentian Li. Document: “A quick brown fox jumps over the ....” Permute the letters at random..and get a power law!

slide-73
SLIDE 73

Power law and philosophy.

Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!! Must have something to do with the brain! Wentian Li. Document: “A quick brown fox jumps over the ....” Permute the letters at random..and get a power law!!

slide-74
SLIDE 74

Power law and philosophy.

Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!! Must have something to do with the brain! Wentian Li. Document: “A quick brown fox jumps over the ....” Permute the letters at random..and get a power law!!!

slide-75
SLIDE 75

Polya Urns

slide-76
SLIDE 76

Polya Urns

slide-77
SLIDE 77

Polya Urns

slide-78
SLIDE 78

Polya Urns

slide-79
SLIDE 79

Polya Urns

slide-80
SLIDE 80

Polya Urns

Choose bin uniformly at random.

slide-81
SLIDE 81

Polya Urns

Choose bin uniformly at random. Load on red bin?

slide-82
SLIDE 82

Polya Urns

Choose bin uniformly at random. Load on red bin? Expectation?

slide-83
SLIDE 83

Polya Urns

Choose bin uniformly at random. Load on red bin? Expectation? n/2

slide-84
SLIDE 84

Polya Urns

Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability.

slide-85
SLIDE 85

Polya Urns

Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2

slide-86
SLIDE 86

Polya Urns

Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability

r+1 r+b+2

slide-87
SLIDE 87

Polya Urns

Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability

r+1 r+b+2

Expectation?

slide-88
SLIDE 88

Polya Urns

Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability

r+1 r+b+2

Expectation? n/2

slide-89
SLIDE 89

Polya Urns

Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability

r+1 r+b+2

Expectation? n/2 Distribution?

slide-90
SLIDE 90

Polya Urns

Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability

r+1 r+b+2

Expectation? n/2 Distribution? Guesses?

slide-91
SLIDE 91

Polya Urns

Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability

r+1 r+b+2

Expectation? n/2 Distribution? Guesses? Uniform

slide-92
SLIDE 92

Polya Urns

Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability

r+1 r+b+2

Expectation? n/2 Distribution? Guesses? Uniform!

slide-93
SLIDE 93

Polya Urns

Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability

r+1 r+b+2

Expectation? n/2 Distribution? Guesses? Uniform! !

slide-94
SLIDE 94

Polya Urns

Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability

r+1 r+b+2

Expectation? n/2 Distribution? Guesses? Uniform! !!

slide-95
SLIDE 95

Polya Urns

Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability

r+1 r+b+2

Expectation? n/2 Distribution? Guesses? Uniform! !!!

slide-96
SLIDE 96

Permutations

Choose bin with probability

r+1 r+b+2.

slide-97
SLIDE 97

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

slide-98
SLIDE 98

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?

slide-99
SLIDE 99

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process.

slide-100
SLIDE 100

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more.

slide-101
SLIDE 101

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 $

slide-102
SLIDE 102

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 $ 1

slide-103
SLIDE 103

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 $ 1 2

slide-104
SLIDE 104

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 $ 2 $

slide-105
SLIDE 105

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2

slide-106
SLIDE 106

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2

slide-107
SLIDE 107

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4

slide-108
SLIDE 108

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 2

slide-109
SLIDE 109

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5

slide-110
SLIDE 110

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1?

slide-111
SLIDE 111

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4.

slide-112
SLIDE 112

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls?

slide-113
SLIDE 113

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3.

slide-114
SLIDE 114

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1?

slide-115
SLIDE 115

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation.

slide-116
SLIDE 116

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i

slide-117
SLIDE 117

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1]

slide-118
SLIDE 118

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.

1 n+1

slide-119
SLIDE 119

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.

1 n+1

How many red balls?

slide-120
SLIDE 120

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.

1 n+1

How many red balls? j = i −1

slide-121
SLIDE 121

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.

1 n+1

How many red balls? j = i −1 ∈ [0,n]

slide-122
SLIDE 122

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.

1 n+1

How many red balls? j = i −1 ∈ [0,n] with prob.

1 n+1.

slide-123
SLIDE 123

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.

1 n+1

How many red balls? j = i −1 ∈ [0,n] with prob.

1 n+1.

Balls in bins?

slide-124
SLIDE 124

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.

1 n+1

How many red balls? j = i −1 ∈ [0,n] with prob.

1 n+1.

Balls in bins? Yes!

slide-125
SLIDE 125

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.

1 n+1

How many red balls? j = i −1 ∈ [0,n] with prob.

1 n+1.

Balls in bins? Yes! Allocation (r,b):

slide-126
SLIDE 126

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.

1 n+1

How many red balls? j = i −1 ∈ [0,n] with prob.

1 n+1.

Balls in bins? Yes! Allocation (r,b): choose one of r +b balls or 2 bottoms.

slide-127
SLIDE 127

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.

1 n+1

How many red balls? j = i −1 ∈ [0,n] with prob.

1 n+1.

Balls in bins? Yes! Allocation (r,b): choose one of r +b balls or 2 bottoms. place in corresponding bin.

slide-128
SLIDE 128

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.

1 n+1

How many red balls? j = i −1 ∈ [0,n] with prob.

1 n+1.

Balls in bins? Yes! Allocation (r,b): choose one of r +b balls or 2 bottoms. place in corresponding bin. Pr[red] =

r+1 r+b+2

2 3 4 5

slide-129
SLIDE 129

Permutations

Choose bin with probability

r+1 r+b+2.

Claim: After n balls the Pr[i red] =

1 n+1.

Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.

1 n+1

How many red balls? j = i −1 ∈ [0,n] with prob.

1 n+1.

Balls in bins? Yes! Allocation (r,b): choose one of r +b balls or 2 bottoms. place in corresponding bin. Pr[red] =

r+1 r+b+2

2 3 4 5 Red balls have same distribution in two processes.

slide-130
SLIDE 130

More bins.

m bins.

slide-131
SLIDE 131

More bins.

m bins.

slide-132
SLIDE 132

More bins.

m bins. Uniformly at random.

slide-133
SLIDE 133

More bins.

m bins. Uniformly at random. Max load: n

m +

  • n

m logn

slide-134
SLIDE 134

More bins.

m bins. Uniformly at random. Max load: n

m +

  • n

m logn

Min load: n

m −

  • n

m logn

slide-135
SLIDE 135

More bins.

m bins. Uniformly at random. Max load: n

m +

  • n

m logn

Min load: n

m −

  • n

m logn

Preferential Selection:

slide-136
SLIDE 136

More bins.

m bins. Uniformly at random. Max load: n

m +

  • n

m logn

Min load: n

m −

  • n

m logn

Preferential Selection: Max load: n

m logn

slide-137
SLIDE 137

More bins.

m bins. Uniformly at random. Max load: n

m +

  • n

m logn

Min load: n

m −

  • n

m logn

Preferential Selection: Max load: n

m logn

Min load: n/m2

slide-138
SLIDE 138

More bins.

m bins. Uniformly at random. Max load: n

m +

  • n

m logn

Min load: n

m −

  • n

m logn

Preferential Selection: Max load: n

m logn

Min load: n/m2 Analysis: random permutation with m separators.

slide-139
SLIDE 139

More bins.

m bins. Uniformly at random. Max load: n

m +

  • n

m logn

Min load: n

m −

  • n

m logn

Preferential Selection: Max load: n

m logn

Min load: n/m2 Analysis: random permutation with m separators. Analyse min and max size of interval.

slide-140
SLIDE 140

More bins.

m bins. Uniformly at random. Max load: n

m +

  • n

m logn

Min load: n

m −

  • n

m logn

Preferential Selection: Max load: n

m logn

Min load: n/m2 Analysis: random permutation with m separators. Analyse min and max size of interval.

slide-141
SLIDE 141

More bins.

m bins. Uniformly at random. Max load: n

m +

  • n

m logn

Min load: n

m −

  • n

m logn

Preferential Selection: Max load: n

m logn

Min load: n/m2 Analysis: random permutation with m separators. Analyse min and max size of interval. Roughly: (1/m) probability of stopping at any point.

slide-142
SLIDE 142

More bins.

m bins. Uniformly at random. Max load: n

m +

  • n

m logn

Min load: n

m −

  • n

m logn

Preferential Selection: Max load: n

m logn

Min load: n/m2 Analysis: random permutation with m separators. Analyse min and max size of interval. Roughly: (1/m) probability of stopping at any point.

slide-143
SLIDE 143

Router Graph:

slide-144
SLIDE 144

Router Graph: Average degree: 4 Max Degree?

slide-145
SLIDE 145

Router Graph: Average degree: 4 Max Degree? Uniformly random

slide-146
SLIDE 146

Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common:

slide-147
SLIDE 147

Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20.

slide-148
SLIDE 148

Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph:

slide-149
SLIDE 149

Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12.

slide-150
SLIDE 150

Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12. Degree ≥ 100 with prob. ≤ 10−6. Actual:

slide-151
SLIDE 151

Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12. Degree ≥ 100 with prob. ≤ 10−6. Actual: 1% greater than 100. Some very large.

slide-152
SLIDE 152

Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12. Degree ≥ 100 with prob. ≤ 10−6. Actual: 1% greater than 100. Some very large. Processes?

slide-153
SLIDE 153

Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12. Degree ≥ 100 with prob. ≤ 10−6. Actual: 1% greater than 100. Some very large. Processes? Preferential Attachment.

slide-154
SLIDE 154

Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12. Degree ≥ 100 with prob. ≤ 10−6. Actual: 1% greater than 100. Some very large. Processes? Preferential Attachment. For routers?

slide-155
SLIDE 155

Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12. Degree ≥ 100 with prob. ≤ 10−6. Actual: 1% greater than 100. Some very large. Processes? Preferential Attachment. For routers? Connect at random.

slide-156
SLIDE 156

Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12. Degree ≥ 100 with prob. ≤ 10−6. Actual: 1% greater than 100. Some very large. Processes? Preferential Attachment. For routers? Connect at random. Not! For the internet graph?

slide-157
SLIDE 157

Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12. Degree ≥ 100 with prob. ≤ 10−6. Actual: 1% greater than 100. Some very large. Processes? Preferential Attachment. For routers? Connect at random. Not! For the internet graph? Degrees too large for even that.

slide-158
SLIDE 158

Internet: copy links.

Surf.

slide-159
SLIDE 159

Internet: copy links.

  • Surf. Cool page.
slide-160
SLIDE 160

Internet: copy links.

  • Surf. Cool page. Link for mine.
slide-161
SLIDE 161

Internet: copy links.

  • Surf. Cool page. Link for mine.

Model:

slide-162
SLIDE 162

Internet: copy links.

  • Surf. Cool page. Link for mine.

Model: Pick a random neighbor.

slide-163
SLIDE 163

Internet: copy links.

  • Surf. Cool page. Link for mine.

Model: Pick a random neighbor. Copy all links.

slide-164
SLIDE 164

Internet: copy links.

  • Surf. Cool page. Link for mine.

Model: Pick a random neighbor. Copy all links. Random Graph with average degree 4.

slide-165
SLIDE 165

Internet: copy links.

  • Surf. Cool page. Link for mine.

Model: Pick a random neighbor. Copy all links. Random Graph with average degree 4. Plus Copy process

slide-166
SLIDE 166

Internet: copy links.

  • Surf. Cool page. Link for mine.

Model: Pick a random neighbor. Copy all links. Random Graph with average degree 4. Plus Copy process → √n

slide-167
SLIDE 167

Routers.

Connection Game.

slide-168
SLIDE 168

Routers.

Connection Game. Process Distance:

slide-169
SLIDE 169

Routers.

Connection Game. Process Distance: Arrive randomly at point on unit square.

slide-170
SLIDE 170

Routers.

Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node.

slide-171
SLIDE 171

Routers.

Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1.

slide-172
SLIDE 172

Routers.

Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree?

slide-173
SLIDE 173

Routers.

Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn).

slide-174
SLIDE 174

Routers.

Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops:

slide-175
SLIDE 175

Routers.

Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square.

slide-176
SLIDE 176

Routers.

Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square. Connect to first node.

slide-177
SLIDE 177

Routers.

Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square. Connect to first node. Max degree?

slide-178
SLIDE 178

Routers.

Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square. Connect to first node. Max degree? n −1.

slide-179
SLIDE 179

Routers.

Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square. Connect to first node. Max degree? n −1. Process Distance/Hops:

slide-180
SLIDE 180

Routers.

Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square. Connect to first node. Max degree? n −1. Process Distance/Hops: Arrive randomly at point on unit square.

slide-181
SLIDE 181

Routers.

Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square. Connect to first node. Max degree? n −1. Process Distance/Hops: Arrive randomly at point on unit square. Connect to node with minj<i αdij +hj.

slide-182
SLIDE 182

Routers.

Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square. Connect to first node. Max degree? n −1. Process Distance/Hops: Arrive randomly at point on unit square. Connect to node with minj<i αdij +hj. Power law if c ≤ α ≤ √n,

slide-183
SLIDE 183

Routers.

Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square. Connect to first node. Max degree? n −1. Process Distance/Hops: Arrive randomly at point on unit square. Connect to node with minj<i αdij +hj. Power law if c ≤ α ≤ √n, → power law!

slide-184
SLIDE 184

See you ...

Thursday.