SLIDE 1
Welcome back... Welcome back... ..to me. Welcome back... ..to me. - - PowerPoint PPT Presentation
Welcome back... Welcome back... ..to me. Welcome back... ..to me. - - PowerPoint PPT Presentation
Welcome back... Welcome back... ..to me. Welcome back... ..to me. Test out Welcome back... ..to me. Test out ! Welcome back... ..to me. Test out !! Welcome back... ..to me. Test out !!! Welcome back... ..to me. Test out !!! Dont
SLIDE 2
SLIDE 3
Welcome back...
..to me. Test out
SLIDE 4
Welcome back...
..to me. Test out !
SLIDE 5
Welcome back...
..to me. Test out !!
SLIDE 6
Welcome back...
..to me. Test out !!!
SLIDE 7
Welcome back...
..to me. Test out !!! Don’t worry.
SLIDE 8
Welcome back...
..to me. Test out !!! Don’t worry. Be happy.
SLIDE 9
Welcome back...
..to me. Test out !!! Don’t worry. Be happy. Look at instructions.
SLIDE 10
Welcome back...
..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration.
SLIDE 11
Welcome back...
..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration. Private message on piazza.
SLIDE 12
Welcome back...
..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration. Private message on piazza. Note: Content can be declassified.
SLIDE 13
Welcome back...
..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration. Private message on piazza. Note: Content can be declassified. Turn in by Monday.
SLIDE 14
Welcome back...
..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration. Private message on piazza. Note: Content can be declassified. Turn in by Monday. Grade by Wednesday
SLIDE 15
Welcome back...
..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration. Private message on piazza. Note: Content can be declassified. Turn in by Monday. Grade by Wednesday .. night
SLIDE 16
Welcome back...
..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration. Private message on piazza. Note: Content can be declassified. Turn in by Monday. Grade by Wednesday .. night ...late
SLIDE 17
Welcome back...
..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration. Private message on piazza. Note: Content can be declassified. Turn in by Monday. Grade by Wednesday .. night ...late ..hopefully.
SLIDE 18
Welcome back...
..to me. Test out !!! Don’t worry. Be happy. Look at instructions. No collaboration. Private message on piazza. Note: Content can be declassified. Turn in by Monday. Grade by Wednesday .. night ...late ..hopefully. Try to get it in then or soon after!
SLIDE 19
Pareto:
SLIDE 20
Pareto: 20% of pods have 80% of peas.
SLIDE 21
Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land.
SLIDE 22
Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land.
SLIDE 23
Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land. City populations:
SLIDE 24
Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land. City populations: ith largest city has population p1
i .
SLIDE 25
Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land. City populations: ith largest city has population p1
i .
logi logfreq
SLIDE 26
Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land. City populations: ith largest city has population p1
i .
logi logfreq Zipf’s law.
SLIDE 27
Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land. City populations: ith largest city has population p1
i .
logi logfreq Zipf’s law. Zipf’s graph.
SLIDE 28
Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land. City populations: ith largest city has population p1
i .
logi logfreq Zipf’s law. Zipf’s graph.
SLIDE 29
Pareto: 20% of pods have 80% of peas. 20% of peple have 80% of land. City populations: ith largest city has population p1
i .
logi logfreq Zipf’s law. Zipf’s graph. Not a distribution.
SLIDE 30
As a distribution.
Pareto.
SLIDE 31
As a distribution.
Pareto. Incomei ∝ income1
iβ
.
SLIDE 32
As a distribution.
Pareto. Incomei ∝ income1
iβ
.
SLIDE 33
As a distribution.
Pareto. Incomei ∝ income1
iβ
. Bill Gates...then someone much less.
SLIDE 34
As a distribution.
Pareto. Incomei ∝ income1
iβ
. Bill Gates...then someone much less. Prelude: why?
SLIDE 35
As a distribution.
Pareto. Incomei ∝ income1
iβ
. Bill Gates...then someone much less. Prelude: why? Rich get richer?
SLIDE 36
As a distribution.
Pareto. Incomei ∝ income1
iβ
. Bill Gates...then someone much less. Prelude: why? Rich get richer? Distribution:
SLIDE 37
As a distribution.
Pareto. Incomei ∝ income1
iβ
. Bill Gates...then someone much less. Prelude: why? Rich get richer? Distribution: Pareto.
SLIDE 38
As a distribution.
Pareto. Incomei ∝ income1
iβ
. Bill Gates...then someone much less. Prelude: why? Rich get richer? Distribution: Pareto. Pr[X ≥ x] ∝ x−α+1.
SLIDE 39
As a distribution.
Pareto. Incomei ∝ income1
iβ
. Bill Gates...then someone much less. Prelude: why? Rich get richer? Distribution: Pareto. Pr[X ≥ x] ∝ x−α+1. Survival function.
SLIDE 40
As a distribution.
Pareto. Incomei ∝ income1
iβ
. Bill Gates...then someone much less. Prelude: why? Rich get richer? Distribution: Pareto. Pr[X ≥ x] ∝ x−α+1. Survival function. Note: “p.d.f.”
SLIDE 41
As a distribution.
Pareto. Incomei ∝ income1
iβ
. Bill Gates...then someone much less. Prelude: why? Rich get richer? Distribution: Pareto. Pr[X ≥ x] ∝ x−α+1. Survival function. Note: “p.d.f.” Pr[X = x] ∝ x−alpha. See Adamic for comment on estimating for real data. http://www.hpl.hp.com/research/idl/papers/ranking/ranking.html
SLIDE 42
As a distribution.
Pareto. Incomei ∝ income1
iβ
. Bill Gates...then someone much less. Prelude: why? Rich get richer? Distribution: Pareto. Pr[X ≥ x] ∝ x−α+1. Survival function. Note: “p.d.f.” Pr[X = x] ∝ x−alpha. See Adamic for comment on estimating for real data. http://www.hpl.hp.com/research/idl/papers/ranking/ranking.html MAKE SOME DRAWINGS.
SLIDE 43
Pareto to Zipf
Zipf:
SLIDE 44
Pareto to Zipf
Zipf: ith guy has C 1
iβ
SLIDE 45
Pareto to Zipf
Zipf: ith guy has C 1
iβ
SLIDE 46
Pareto to Zipf
Zipf: ith guy has C 1
iβ
N people.
SLIDE 47
Pareto to Zipf
Zipf: ith guy has C 1
iβ
N people. How many people have value more than xi?
SLIDE 48
Pareto to Zipf
Zipf: ith guy has C 1
iβ
N people. How many people have value more than xi? On expection?
SLIDE 49
Pareto to Zipf
Zipf: ith guy has C 1
iβ
N people. How many people have value more than xi? On expection? NDx−α+1.
SLIDE 50
Pareto to Zipf
Zipf: ith guy has C 1
iβ
N people. How many people have value more than xi? On expection? NDx−α+1. ith guy has more than xi
SLIDE 51
Pareto to Zipf
Zipf: ith guy has C 1
iβ
N people. How many people have value more than xi? On expection? NDx−α+1. ith guy has more than xi ≡ i guys have more than xi
SLIDE 52
Pareto to Zipf
Zipf: ith guy has C 1
iβ
N people. How many people have value more than xi? On expection? NDx−α+1. ith guy has more than xi ≡ i guys have more than xi
SLIDE 53
Pareto to Zipf
Zipf: ith guy has C 1
iβ
N people. How many people have value more than xi? On expection? NDx−α+1. ith guy has more than xi ≡ i guys have more than xi i ≈ NDx−α+1
i
SLIDE 54
Pareto to Zipf
Zipf: ith guy has C 1
iβ
N people. How many people have value more than xi? On expection? NDx−α+1. ith guy has more than xi ≡ i guys have more than xi i ≈ NDx−α+1
i
SLIDE 55
Pareto to Zipf
Zipf: ith guy has C 1
iβ
N people. How many people have value more than xi? On expection? NDx−α+1. ith guy has more than xi ≡ i guys have more than xi i ≈ NDx−α+1
i
xi =
1 i1/(1−α)
SLIDE 56
Pareto to Zipf
Zipf: ith guy has C 1
iβ
N people. How many people have value more than xi? On expection? NDx−α+1. ith guy has more than xi ≡ i guys have more than xi i ≈ NDx−α+1
i
xi =
1 i1/(1−α)
Relationship: β =
1 1−α
SLIDE 57
Self similarity.
Power laws.
SLIDE 58
Self similarity.
Power laws. No matter where you are there you are...
SLIDE 59
Self similarity.
Power laws. No matter where you are there you are... xt+1 = xt ×γ.
SLIDE 60
Self similarity.
Power laws. No matter where you are there you are... xt+1 = xt ×γ. Actually γt ≈ (1+β/t).
SLIDE 61
Self similarity.
Power laws. No matter where you are there you are... xt+1 = xt ×γ. Actually γt ≈ (1+β/t). Roughly constant for interval of wdith β.
SLIDE 62
Power law and philosophy.
Wow!
SLIDE 63
Power law and philosophy.
Wow! Power laws.
SLIDE 64
Power law and philosophy.
Wow! Power laws. Cool.
SLIDE 65
Power law and philosophy.
Wow! Power laws. Cool. Zipf: for frequency of words.
SLIDE 66
Power law and philosophy.
Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!!
SLIDE 67
Power law and philosophy.
Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!! Must have something to do with the brain!
SLIDE 68
Power law and philosophy.
Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!! Must have something to do with the brain! Wentian Li.
SLIDE 69
Power law and philosophy.
Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!! Must have something to do with the brain! Wentian Li. Document: “A quick brown fox jumps over the ....”
SLIDE 70
Power law and philosophy.
Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!! Must have something to do with the brain! Wentian Li. Document: “A quick brown fox jumps over the ....” Permute the letters at random..
SLIDE 71
Power law and philosophy.
Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!! Must have something to do with the brain! Wentian Li. Document: “A quick brown fox jumps over the ....” Permute the letters at random..and get a power law
SLIDE 72
Power law and philosophy.
Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!! Must have something to do with the brain! Wentian Li. Document: “A quick brown fox jumps over the ....” Permute the letters at random..and get a power law!
SLIDE 73
Power law and philosophy.
Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!! Must have something to do with the brain! Wentian Li. Document: “A quick brown fox jumps over the ....” Permute the letters at random..and get a power law!!
SLIDE 74
Power law and philosophy.
Wow! Power laws. Cool. Zipf: for frequency of words. For all languages!!! Must have something to do with the brain! Wentian Li. Document: “A quick brown fox jumps over the ....” Permute the letters at random..and get a power law!!!
SLIDE 75
Polya Urns
SLIDE 76
Polya Urns
SLIDE 77
Polya Urns
SLIDE 78
Polya Urns
SLIDE 79
Polya Urns
SLIDE 80
Polya Urns
Choose bin uniformly at random.
SLIDE 81
Polya Urns
Choose bin uniformly at random. Load on red bin?
SLIDE 82
Polya Urns
Choose bin uniformly at random. Load on red bin? Expectation?
SLIDE 83
Polya Urns
Choose bin uniformly at random. Load on red bin? Expectation? n/2
SLIDE 84
Polya Urns
Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability.
SLIDE 85
Polya Urns
Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2
SLIDE 86
Polya Urns
Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability
r+1 r+b+2
SLIDE 87
Polya Urns
Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability
r+1 r+b+2
Expectation?
SLIDE 88
Polya Urns
Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability
r+1 r+b+2
Expectation? n/2
SLIDE 89
Polya Urns
Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability
r+1 r+b+2
Expectation? n/2 Distribution?
SLIDE 90
Polya Urns
Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability
r+1 r+b+2
Expectation? n/2 Distribution? Guesses?
SLIDE 91
Polya Urns
Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability
r+1 r+b+2
Expectation? n/2 Distribution? Guesses? Uniform
SLIDE 92
Polya Urns
Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability
r+1 r+b+2
Expectation? n/2 Distribution? Guesses? Uniform!
SLIDE 93
Polya Urns
Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability
r+1 r+b+2
Expectation? n/2 Distribution? Guesses? Uniform! !
SLIDE 94
Polya Urns
Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability
r+1 r+b+2
Expectation? n/2 Distribution? Guesses? Uniform! !!
SLIDE 95
Polya Urns
Choose bin uniformly at random. Load on red bin? Expectation? n/2 Within n/2±√n with good probability. Approximately Gaussian with variance √n/2 Choose red bin with probability
r+1 r+b+2
Expectation? n/2 Distribution? Guesses? Uniform! !!!
SLIDE 96
Permutations
Choose bin with probability
r+1 r+b+2.
SLIDE 97
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
SLIDE 98
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?
SLIDE 99
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process.
SLIDE 100
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more.
SLIDE 101
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 $
SLIDE 102
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 $ 1
SLIDE 103
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 $ 1 2
SLIDE 104
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 $ 2 $
SLIDE 105
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2
SLIDE 106
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2
SLIDE 107
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4
SLIDE 108
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 2
SLIDE 109
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5
SLIDE 110
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1?
SLIDE 111
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4.
SLIDE 112
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls?
SLIDE 113
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3.
SLIDE 114
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1?
SLIDE 115
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation.
SLIDE 116
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i
SLIDE 117
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1]
SLIDE 118
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.
1 n+1
SLIDE 119
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.
1 n+1
How many red balls?
SLIDE 120
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.
1 n+1
How many red balls? j = i −1
SLIDE 121
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.
1 n+1
How many red balls? j = i −1 ∈ [0,n]
SLIDE 122
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.
1 n+1
How many red balls? j = i −1 ∈ [0,n] with prob.
1 n+1.
SLIDE 123
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.
1 n+1
How many red balls? j = i −1 ∈ [0,n] with prob.
1 n+1.
Balls in bins?
SLIDE 124
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.
1 n+1
How many red balls? j = i −1 ∈ [0,n] with prob.
1 n+1.
Balls in bins? Yes!
SLIDE 125
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.
1 n+1
How many red balls? j = i −1 ∈ [0,n] with prob.
1 n+1.
Balls in bins? Yes! Allocation (r,b):
SLIDE 126
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.
1 n+1
How many red balls? j = i −1 ∈ [0,n] with prob.
1 n+1.
Balls in bins? Yes! Allocation (r,b): choose one of r +b balls or 2 bottoms.
SLIDE 127
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.
1 n+1
How many red balls? j = i −1 ∈ [0,n] with prob.
1 n+1.
Balls in bins? Yes! Allocation (r,b): choose one of r +b balls or 2 bottoms. place in corresponding bin.
SLIDE 128
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.
1 n+1
How many red balls? j = i −1 ∈ [0,n] with prob.
1 n+1.
Balls in bins? Yes! Allocation (r,b): choose one of r +b balls or 2 bottoms. place in corresponding bin. Pr[red] =
r+1 r+b+2
2 3 4 5
SLIDE 129
Permutations
Choose bin with probability
r+1 r+b+2.
Claim: After n balls the Pr[i red] =
1 n+1.
Analyse?Another process. Start with two balls, insert n more. 1 3 x 2 4 5 Where is ball 1? Position 4. How many red balls? 3. Insert n balls, where oh where is ball 1? Random permuation. Position i ∈ [1,n +1] with prob.
1 n+1
How many red balls? j = i −1 ∈ [0,n] with prob.
1 n+1.
Balls in bins? Yes! Allocation (r,b): choose one of r +b balls or 2 bottoms. place in corresponding bin. Pr[red] =
r+1 r+b+2
2 3 4 5 Red balls have same distribution in two processes.
SLIDE 130
More bins.
m bins.
SLIDE 131
More bins.
m bins.
SLIDE 132
More bins.
m bins. Uniformly at random.
SLIDE 133
More bins.
m bins. Uniformly at random. Max load: n
m +
- n
m logn
SLIDE 134
More bins.
m bins. Uniformly at random. Max load: n
m +
- n
m logn
Min load: n
m −
- n
m logn
SLIDE 135
More bins.
m bins. Uniformly at random. Max load: n
m +
- n
m logn
Min load: n
m −
- n
m logn
Preferential Selection:
SLIDE 136
More bins.
m bins. Uniformly at random. Max load: n
m +
- n
m logn
Min load: n
m −
- n
m logn
Preferential Selection: Max load: n
m logn
SLIDE 137
More bins.
m bins. Uniformly at random. Max load: n
m +
- n
m logn
Min load: n
m −
- n
m logn
Preferential Selection: Max load: n
m logn
Min load: n/m2
SLIDE 138
More bins.
m bins. Uniformly at random. Max load: n
m +
- n
m logn
Min load: n
m −
- n
m logn
Preferential Selection: Max load: n
m logn
Min load: n/m2 Analysis: random permutation with m separators.
SLIDE 139
More bins.
m bins. Uniformly at random. Max load: n
m +
- n
m logn
Min load: n
m −
- n
m logn
Preferential Selection: Max load: n
m logn
Min load: n/m2 Analysis: random permutation with m separators. Analyse min and max size of interval.
SLIDE 140
More bins.
m bins. Uniformly at random. Max load: n
m +
- n
m logn
Min load: n
m −
- n
m logn
Preferential Selection: Max load: n
m logn
Min load: n/m2 Analysis: random permutation with m separators. Analyse min and max size of interval.
SLIDE 141
More bins.
m bins. Uniformly at random. Max load: n
m +
- n
m logn
Min load: n
m −
- n
m logn
Preferential Selection: Max load: n
m logn
Min load: n/m2 Analysis: random permutation with m separators. Analyse min and max size of interval. Roughly: (1/m) probability of stopping at any point.
SLIDE 142
More bins.
m bins. Uniformly at random. Max load: n
m +
- n
m logn
Min load: n
m −
- n
m logn
Preferential Selection: Max load: n
m logn
Min load: n/m2 Analysis: random permutation with m separators. Analyse min and max size of interval. Roughly: (1/m) probability of stopping at any point.
SLIDE 143
Router Graph:
SLIDE 144
Router Graph: Average degree: 4 Max Degree?
SLIDE 145
Router Graph: Average degree: 4 Max Degree? Uniformly random
SLIDE 146
Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common:
SLIDE 147
Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20.
SLIDE 148
Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph:
SLIDE 149
Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12.
SLIDE 150
Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12. Degree ≥ 100 with prob. ≤ 10−6. Actual:
SLIDE 151
Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12. Degree ≥ 100 with prob. ≤ 10−6. Actual: 1% greater than 100. Some very large.
SLIDE 152
Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12. Degree ≥ 100 with prob. ≤ 10−6. Actual: 1% greater than 100. Some very large. Processes?
SLIDE 153
Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12. Degree ≥ 100 with prob. ≤ 10−6. Actual: 1% greater than 100. Some very large. Processes? Preferential Attachment.
SLIDE 154
Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12. Degree ≥ 100 with prob. ≤ 10−6. Actual: 1% greater than 100. Some very large. Processes? Preferential Attachment. For routers?
SLIDE 155
Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12. Degree ≥ 100 with prob. ≤ 10−6. Actual: 1% greater than 100. Some very large. Processes? Preferential Attachment. For routers? Connect at random.
SLIDE 156
Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12. Degree ≥ 100 with prob. ≤ 10−6. Actual: 1% greater than 100. Some very large. Processes? Preferential Attachment. For routers? Connect at random. Not! For the internet graph?
SLIDE 157
Router Graph: Average degree: 4 Max Degree? Uniformly random = ⇒ Pr[degree ≥ 20] ≈ 10−4. Actual high degree nodes more common: 5% of nodes have degree greater than 20. Internet graph: Average degree: 12. Degree ≥ 100 with prob. ≤ 10−6. Actual: 1% greater than 100. Some very large. Processes? Preferential Attachment. For routers? Connect at random. Not! For the internet graph? Degrees too large for even that.
SLIDE 158
Internet: copy links.
Surf.
SLIDE 159
Internet: copy links.
- Surf. Cool page.
SLIDE 160
Internet: copy links.
- Surf. Cool page. Link for mine.
SLIDE 161
Internet: copy links.
- Surf. Cool page. Link for mine.
Model:
SLIDE 162
Internet: copy links.
- Surf. Cool page. Link for mine.
Model: Pick a random neighbor.
SLIDE 163
Internet: copy links.
- Surf. Cool page. Link for mine.
Model: Pick a random neighbor. Copy all links.
SLIDE 164
Internet: copy links.
- Surf. Cool page. Link for mine.
Model: Pick a random neighbor. Copy all links. Random Graph with average degree 4.
SLIDE 165
Internet: copy links.
- Surf. Cool page. Link for mine.
Model: Pick a random neighbor. Copy all links. Random Graph with average degree 4. Plus Copy process
SLIDE 166
Internet: copy links.
- Surf. Cool page. Link for mine.
Model: Pick a random neighbor. Copy all links. Random Graph with average degree 4. Plus Copy process → √n
SLIDE 167
Routers.
Connection Game.
SLIDE 168
Routers.
Connection Game. Process Distance:
SLIDE 169
Routers.
Connection Game. Process Distance: Arrive randomly at point on unit square.
SLIDE 170
Routers.
Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node.
SLIDE 171
Routers.
Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1.
SLIDE 172
Routers.
Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree?
SLIDE 173
Routers.
Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn).
SLIDE 174
Routers.
Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops:
SLIDE 175
Routers.
Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square.
SLIDE 176
Routers.
Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square. Connect to first node.
SLIDE 177
Routers.
Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square. Connect to first node. Max degree?
SLIDE 178
Routers.
Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square. Connect to first node. Max degree? n −1.
SLIDE 179
Routers.
Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square. Connect to first node. Max degree? n −1. Process Distance/Hops:
SLIDE 180
Routers.
Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square. Connect to first node. Max degree? n −1. Process Distance/Hops: Arrive randomly at point on unit square.
SLIDE 181
Routers.
Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square. Connect to first node. Max degree? n −1. Process Distance/Hops: Arrive randomly at point on unit square. Connect to node with minj<i αdij +hj.
SLIDE 182
Routers.
Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square. Connect to first node. Max degree? n −1. Process Distance/Hops: Arrive randomly at point on unit square. Connect to node with minj<i αdij +hj. Power law if c ≤ α ≤ √n,
SLIDE 183
Routers.
Connection Game. Process Distance: Arrive randomly at point on unit square. Connect to closest node. Generate tree with average degree 1. Max degree? O(logn). Process Hops: Arrive randomly at point on unit square. Connect to first node. Max degree? n −1. Process Distance/Hops: Arrive randomly at point on unit square. Connect to node with minj<i αdij +hj. Power law if c ≤ α ≤ √n, → power law!
SLIDE 184