Cost-Effective Resource Allocation for Deploying 1 Vinay Setty - - PowerPoint PPT Presentation

▶
cost effective resource allocation for deploying
SMART_READER_LITE
LIVE PREVIEW

Cost-Effective Resource Allocation for Deploying 1 Vinay Setty - - PowerPoint PPT Presentation

Dec 04, 2022 474 likes •906 views

Cost-Effective Resource Allocation for Deploying 1 Vinay Setty vsetty@mpi-inf.mpg.de Pub/Sub on Cloud Published in ICDCS 2014 Roman Vitenberg Maarten van Steen Gunnar Kreitz Guido Urdaneta Cost-Effective Resource Allocation for Deploying

slide-1
SLIDE 1

Cost-Effective Resource Allocation for Deploying Pub/Sub on Cloud

Published in ICDCS 2014 Roman Vitenberg Maarten van Steen Gunnar Kreitz Guido Urdaneta

1

Vinay Setty vsetty@mpi-inf.mpg.de

slide-2
SLIDE 2

Cost-Effective Resource Allocation for Deploying Pub/Sub on Cloud

Published in ICDCS 2014 Roman Vitenberg Maarten van Steen Gunnar Kreitz Guido Urdaneta

1

Vinay Setty vsetty@mpi-inf.mpg.de

slide-3
SLIDE 3

Publish/Subscribe (Pub/Sub)

2

slide-4
SLIDE 4

Publish/Subscribe (Pub/Sub)

2

  • Pub/sub is a

communication paradigm

slide-5
SLIDE 5

Publish/Subscribe (Pub/Sub)

Publishers Subscribers

2

  • Pub/sub is a

communication paradigm

slide-6
SLIDE 6

Publish/Subscribe (Pub/Sub)

Publishers Subscribers Middleware

2

  • Pub/sub is a

communication paradigm

slide-7
SLIDE 7

Publish/Subscribe (Pub/Sub)

Publishers Subscribers

Subscriptions

Middleware

2

  • Pub/sub is a

communication paradigm

slide-8
SLIDE 8

Publish/Subscribe (Pub/Sub)

Publishers Subscribers

Publications Subscriptions

Middleware

2

  • Pub/sub is a

communication paradigm

slide-9
SLIDE 9

Publish/Subscribe (Pub/Sub)

Publishers Subscribers

Publications Subscriptions

Middleware

2

  • Pub/sub is a

communication paradigm

  • Pub/sub in the industry:
  • TIBCO rendezvous
  • GooPS: Google’s pub/

sub

  • Spotify’s pub/sub for

social interaction [DEBS

2013]

slide-10
SLIDE 10

Application: Spotify Social Interaction

Source: Wikimedia Commons (CC BY-SA 3.0) 3

slide-11
SLIDE 11

Application: Spotify Social Interaction

Source: Wikimedia Commons (CC BY-SA 3.0) 3

  • A music streaming service available in
  • ver 60 countries
  • Music events from users and artists

result in Billions of notifications every day

  • Millions of users to be notified about

these events at any time

  • Pub/sub for delivering music-related

notifications [Setty et.al. DEBS'13]

slide-12
SLIDE 12

Spotify Pub/Sub

4

slide-13
SLIDE 13

Spotify Pub/Sub

4

Real-time feed from friends and artists (fixed number of events)

slide-14
SLIDE 14

Social Interaction in Spotify

5

Spotify user

slide-15
SLIDE 15

Social Interaction in Spotify

5

Facebook Friend Spotify Friend Spotify user

slide-16
SLIDE 16

Social Interaction in Spotify

5

Facebook Friend Spotify Friend Spotify user

follow

slide-17
SLIDE 17

Social Interaction in Spotify

5

Facebook Friend Spotify Friend Spotify user

follow listened/starred track Playlist created/ updated

slide-18
SLIDE 18

Social Interaction in Spotify

5

Artists Facebook Friend Spotify Friend Spotify user

follow listened/starred track Playlist created/ updated

✔

slide-19
SLIDE 19

Social Interaction in Spotify

5

Artists Facebook Friend Spotify Friend Spotify user

follow listened/starred track follow Playlist created/ updated

✔

slide-20
SLIDE 20

Social Interaction in Spotify

5

Artists Facebook Friend Spotify Friend Spotify user

follow listened/starred track follow Album released Playlist created/ updated

✔

slide-21
SLIDE 21

Social Interaction in Spotify

5 l i s t e n e d t

  • t

r a c k , p l a y l i s t a c t i v i t y

Artists Facebook Friend Spotify Friend Spotify user

follow listened/starred track follow Album released Playlist created/ updated

✔

slide-22
SLIDE 22

Social Interaction in Spotify

5 l i s t e n e d t

  • t

r a c k , p l a y l i s t a c t i v i t y

Music Playlist Artists Facebook Friend Spotify Friend Spotify user

follow listened/starred track follow Album released Playlist created/ updated

✔

slide-23
SLIDE 23

Social Interaction in Spotify

5 l i s t e n e d t

  • t

r a c k , p l a y l i s t a c t i v i t y

Music Playlist Artists Facebook Friend Spotify Friend Spotify user

follow listened/starred track follow Album released follow Playlist created/ updated

✔

slide-24
SLIDE 24

Social Interaction in Spotify

5 l i s t e n e d t

  • t

r a c k , p l a y l i s t a c t i v i t y

Music Playlist Artists Facebook Friend Spotify Friend Spotify user

follow listened/starred track follow Album released follow Playlist updated Playlist created/ updated

✔

slide-25
SLIDE 25

Social Interaction in Spotify

5 l i s t e n e d t

  • t

r a c k , p l a y l i s t a c t i v i t y

Music Playlist Artists Facebook Friend Spotify Friend Spotify user

follow listened/starred track follow Album released follow Playlist updated Playlist created/ updated

Topic Topic Topic Subscriber

✔

slide-26
SLIDE 26

Social Interaction in Spotify

5 l i s t e n e d t

  • t

r a c k , p l a y l i s t a c t i v i t y

Music Playlist Artists Facebook Friend Spotify Friend Spotify user

follow listened/starred track follow Album released follow Playlist updated Playlist created/ updated

Topic Topic Topic Subscriber

Pub/Sub for Social Interaction!

✔

slide-27
SLIDE 27

Motivation

6

Publishers Subscribers

Datacenter/ Cloud

Publications N

  • t

i fi c a t i

  • n

s

slide-28
SLIDE 28

Motivation

6

Publishers Subscribers

Datacenter/ Cloud

Publications N

  • t

i fi c a t i

  • n

s

slide-29
SLIDE 29

Motivation

6

What is the cost-effective way to allocate and distribute workload on multiple servers in a datacenter?

Publishers Subscribers

Datacenter/ Cloud

Publications N

  • t

i fi c a t i

  • n

s

slide-30
SLIDE 30

Motivation

6

What is the cost-effective way to allocate and distribute workload on multiple servers in a datacenter? What is the minimum amount of resources needed to deploy pub/sub?

Publishers Subscribers

Datacenter/ Cloud

Publications N

  • t

i fi c a t i

  • n

s

slide-31
SLIDE 31

Motivation

6

What is the cost-effective way to allocate and distribute workload on multiple servers in a datacenter? What is the minimum amount of resources needed to deploy pub/sub? What is the monetary cost

  • f deploying pub/sub on

cloud?

Publishers Subscribers

Datacenter/ Cloud

Publications N

  • t

i fi c a t i

  • n

s

slide-32
SLIDE 32

Contributions

7

slide-33
SLIDE 33

Contributions

7

  • Novel problem to minimize cost (e.g. monetary cost) of

allocating pub/sub workload to servers in datacenters or cloud

  • Formalization and hardness analysis
  • Parametrized by generic pricing model from cloud providers
slide-34
SLIDE 34

Contributions

7

  • Novel problem to minimize cost (e.g. monetary cost) of

allocating pub/sub workload to servers in datacenters or cloud

  • Formalization and hardness analysis
  • Parametrized by generic pricing model from cloud providers
  • Efficient solutions for the formulated problem
  • Two stage heuristic-based solution
  • Several optimizations introduced
slide-35
SLIDE 35

Contributions

7

  • Novel problem to minimize cost (e.g. monetary cost) of

allocating pub/sub workload to servers in datacenters or cloud

  • Formalization and hardness analysis
  • Parametrized by generic pricing model from cloud providers
  • Efficient solutions for the formulated problem
  • Two stage heuristic-based solution
  • Several optimizations introduced
  • Extensive evaluation with real traces from Spotify and Twitter
slide-36
SLIDE 36

How to Minimize Cost?

8

slide-37
SLIDE 37

How to Minimize Cost?

8

  • Social notifications have mostly human recipients [Gomez-Rodriguez,

ICWSM 2014]

  • Delivery Rate beyond a threshold - not beneficial!
  • Delivery Rate below a threshold - users unhappy!
  • Select and deliver a cost-effective subset of the workload so as to

meet satisfaction metrics while minimizing the cost [INFOCOM'14]

Introduce Satisfaction Threshold (rate limit)

slide-38
SLIDE 38

How to Minimize Cost?

8

  • Social notifications have mostly human recipients [Gomez-Rodriguez,

ICWSM 2014]

  • Delivery Rate beyond a threshold - not beneficial!
  • Delivery Rate below a threshold - users unhappy!
  • Select and deliver a cost-effective subset of the workload so as to

meet satisfaction metrics while minimizing the cost [INFOCOM'14]

  • Cost-effective allocation of resources
  • Given limited capacity of servers topic-subscriber pairs with shared

interests

  • Goal is to minimize replication of events to different servers
  • Minimize number of servers deployed and bandwidth consumed

Introduce Satisfaction Threshold (rate limit)

slide-39
SLIDE 39

Discussion

9

slide-40
SLIDE 40

Discussion

9

  • In this work resource allocation was done based on events from

social interactions

slide-41
SLIDE 41

Discussion

9

  • In this work resource allocation was done based on events from

social interactions

  • Can business processes help resource provisioning for social

interaction applications in cloud?

  • Is targeted advertising a good application for integration of BPM and

social events?