their parallels to power Fernando Paganini . Universidad ORT, Uruguay - - PowerPoint PPT Presentation

their parallels to power
SMART_READER_LITE
LIVE PREVIEW

their parallels to power Fernando Paganini . Universidad ORT, Uruguay - - PowerPoint PPT Presentation

Bandwidth auctions and their parallels to power Fernando Paganini . Universidad ORT, Uruguay . Outline: 1. Intro: resource allocation and pricing in comm networks. 2. Background on auctions. 3. Auctions for Internet bandwidth. 4. Connections


slide-1
SLIDE 1

Bandwidth auctions and their parallels to power

Fernando Paganini. Universidad ORT, Uruguay.

Outline:

  • 1. Intro: resource allocation and pricing in comm networks.
  • 2. Background on auctions.
  • 3. Auctions for Internet bandwidth.
  • 4. Connections to auctions in the power grid.

Lund, May 2011

slide-2
SLIDE 2
  • 1. Intro: Rate allocation in the Internet

r

x Input rate

l l

y c Link rate C apacity

r

x

,

max ( )

x r r r

U x

Rx c 

LINK CAPACITY CO NSTRAINTS

SO URCE UTILITY

subject to

Netw ork Utility M axim ization (Kelly ´98)

, , 1

l r l lr r lr r

l c r x r l y R x R     

Netw ork of links, indexed by w ith capacity (e.g. M bps). End-to-end flow s, indexed by rate if route uses link Link rate aggregation: , w here 0 otherw ise   

slide-3
SLIDE 3

: ).

.

Lagrange m ultiplier : congestion price" of link ( total price of route

"

i li l l

l T

q R p i

p l q R p

  

Solution through duality (Low-Lapsley ’99)

( , ) [ ( ) ] .

r r r r l l r l

L x p U x q x p c   

 

Lagrangian

Source rate

i

x Route price

i

q

Link rate Link price

l l

y p

 

: : [ ] ,

[ ( ) ],

xr

r l l l l l

r r r r

x y c

U x q x

  

  

Links update prices as prices sent back. argm ax

Sources so lve

Dual algorithm

slide-4
SLIDE 4

Uses for this “virtual economy” of bandwidth

  • Interpretation of the equilibrium and dynamic properties of

current TCP congestion control protocols.

  • Guides in design of new protocols with:

– Better dynamic properties (convergence, etc.) – Use other utility functions, achieving other notions of fairness.

  • Extension to cross-layer optimization, including other layers
  • f the protocol stack, for both wired and wireless networks:

– Routing – Medium access control (Scheduling, random access). – Physical layer control (power control, modulation,…)

  • However, the “real” economy of bandwidth doesn’t work this
  • way. Why?

– Bandwidth has been abundant, not crucial to optimally allocate it. – This control is faster than the human time-scale.

slide-5
SLIDE 5
  • 1. Auctions
  • Popular trading mechanism

– Fast, reliable and transparent way of setting market price. – Various mechanisms exist, single and multi-unit auctions.

  • Open auctions for sale of a single unit

– English: ascending bids, open-outcry, terminates when

  • ne bidder is left.

– Dutch: descending bids, open-outcry, terminates when

  • ne bidder shouts “mine”.
  • Closed, sealed-bid auctions:

– First price: highest bidder wins, pays his/her bid. – Second price (Vickrey): highest bidder wins, pays 2nd bid.

slide-6
SLIDE 6

Vickrey Auctions and truth revelation

  • In a second-price auction, it is rational for

participants to bid their true valuation for the item:

– They gain no reduction in payment by bidding below their valuation. – They might lose the auction if they do so.

$5 $2.5 $3.7

Bidder of $5 bid wins the auction, but pays $3.7 for the item.

slide-7
SLIDE 7

Multiple unit auctions

4 3 1 2

( 2 )

b

(1)

b

(3)

b

( 4 )

b

Exam ple: sell 3 units, choose 3 highest bidders. Alternatives: Charge bid am ount: gives incentives for bidding below valuation. Vickrey-Clarke-G roves (VCG ) principle: charge users the loss

  • f valuation im posed to others by their presenc e.

(1) (3) ( 4 ) (1) (3) ( 4 ).

In this case: presence of 2nd bidder changes others' total valuation from to Should charge It is shown VCG m akes it rational to reveal the true valuations. b b b b b b    

slide-8
SLIDE 8

Is there a cost for truth revelation in loss of revenue for the seller?

Revenue Equivalence Theorem (Vickrey, M yerson, Riley-Sam uelson) Assum e: Risk neutral buyers, valuations draw n from a know n distribution. M echanism assigns objects to bidders w ith highest valuation. At Bayesian Nash equilibrium , all auction m echanism s yield the sam e expected revenue for the auctioneer. 

4 3 1 2

( 2 )

b

(1)

b

(3)

b

( 4 )

b

However, equivalence does not hold if buyers are risk averse, do not know the distribution, or do not have unbounded rationality. In such cases a first-price auction m ay give higher revenue than VCG .

slide-9
SLIDE 9

Procurement auctions

(3)

Auctioneer

  • ne or m ore

item s from low est offers (asks). e.g., buy 2 item s from offers 1, 2. VCG : pay to b buys .

  • th.

a

Double or two-sided auctions

4 3 1 2

(3)

a

( 4 )

a

( 2 )

a

(1)

a

 

( ) ( )

: . Sell m ax Here, 2 item s. E Bids for buyin quilibrium pri g an ce: d selli crossin ng g point.

k k

k b a 

(1)

a

(1)

b

( 2 )

a

(3)

a

( 4 )

a

( 2 )

b

( 3 )

b

( 4 )

b

4 3 1 2

slide-10
SLIDE 10
  • 2. Internet Bandwidth Auctions

Based on 2011 paper in Computer Networks. Joint work with:

  • Pablo Belzarena (Universidad de la República, Uruguay)
  • Andrés Ferragut (Universidad ORT, Uruguay)

Scenario: a netw ork periodically auctions capacity. Users subm it bids for am ounts

  • f end-to-end bandw idth.

A distributed algorithm m ust

  • ptim ally assign capacity.

M otivation: overlay for : ’00, ’0 , ’0 , ’0 , . ’0 prem ium services over the Internet. Related w ork Lazar Sem ret Shu Varaiya 3 Reichl W rzaczek 5 M aillé Tuffin 6 Courcoubetis et al 7.    

slide-11
SLIDE 11

Three issues and solution features

  • 1. Auction allocation/payment mechanism:

– Optimize the value of accepted bids. – Charge 1st price, VCG would have high complexity (Maillé-Tuffin ´07). – Revenue equivalence argument.

  • 2. Distributed auction over a general network topology.

– Bids submitted to “bandwidth brokers” distributed across the network. – Bidders need not know network topology, capacity, etc. – Brokers run a distributed algorithm to allocate the auction.

  • 3. Inter-temporal constraints.

– Auctions are held periodically, for currently available capacity. – Service may be longer than the auction period, and reservations are in place: a connection, once assigned, cannot be displaced by future bids. – So the seller optimize over the risk of future bids: selling capacity now with a low bid can cause the rejection of a better bid in the future.

slide-12
SLIDE 12

Notation: auction for a single service

(1) ( 2 ) (3) ( ) N

N b b b b       bids for units of bandwidth.

( ) 1

:

( ) .

a

i b i

a N

U a b

 

 

Revenue from allocating bandw idth (first-price auction) piecew ise linear, concave function.

Interpolate to

( )

b

U a

a

4 3 1 2

(1) ( 2 )

b b 

(1)

b

slide-13
SLIDE 13

Auction over a network

( )

,

subject m to ax

Network optim al revenue auction

r

r lr r l r

r b r r

a a

U a R c

 

 

Z

Integer program . Relaxation is a concave utility m axim ization as introduced in Kelly '98.

( ) (1) ( 2 ) (3)

( ) 1

) . (

r r r r

N a r r r r r r

i r b i

b b b b

a U a b

   

 

Broker collects bids for this service: If w e adm it bids for a total rate the total revenue is . , 1 .

r lr

r R R r l   Let represent a service, characterized by a reserved bandw idth betw een 2 endpoints. Single-path case: service has a fixed route, defined by a routing m atrix : iff route us es link M ul tipath generalizations are available.

slide-14
SLIDE 14

Distributed allocation algorithm

( , ) [ ]

( )

Lagrangian

r

l l lr r l l l s l

r b r

a c R a c

L U a

     

 

 

.

:

[ ( ) ],

rl l l r r r r

r

a r r r r b

R q a

a

U a q a q

  

w ith route price. Am ounts to selecting bids better than Com m unicate to links, w ho update pri argm ax ce s as

(from Low -La Brokers solv psley '99 ) e

Dual algo rithm

 

: [ ] ,

l l l l l r l lr s

y c y R a   

    

link bandw idth dem and. Prices sent back to brokers. Can be im plem ented in the control plane, variant of RSVP protocol .

w ith

2

max ( ) ( ) , 2

( )

(see , Li

prox not strictly concave, algorithm will ``chatter" around optim um . Solution:

  • ptim ization with extra variable

subject to l im a

Difficulty:

r

lr r l r

r r r r r b r s r

r b

a

d U a a d R c

U a

   

  

n-Shroff '06, also useful for m ultipath case).

slide-15
SLIDE 15

Periodic auctions for one link

Occupied bandwidth

time kT

( 1) k T  ( 1) k T  C

k

x

k k

x a 

1 k

x

1 ,

k

C a T kT      Service of bandw idth , single link of capacity . Collect bids for tim e of length allocate bandw idth units at tim e Allocated users have a reservation for service duration, assum e exp(

T

p e

  . probability that a connection is still active at the next auct ) : ion.

: sell all currently available capacity. M ay m iss higher bids in the fu , ture.

M yopic policy

k k

a C x  

1

, ).

~ (

k k k

a p

x Bin x

 W hat is the optimal policy?

slide-16
SLIDE 16

Optimal revenue problem

( ), Expectation w ith respect to bids (assum e know n distribution,

  • therw ise can be estim ated) and the de parture process.

This is a M arkov Decision Process (M DP). Solution is a policy w here

k k

a a s     ( , ). ( ) the state is can be found num erically, large com pua tional cost.

k k k

s x b a s  

 

1

) 1 ( 1

( ) ( ) [ ]

arg ( ) ( )]

max [

Here Optim ize current revenue + expected rev enue of next auction, assum ing all rem aining capacity will be sol

Receding horizon approxim ation:

i b i

a b a C x x

U a E U a E b

a U a E U C x

 

  

  

0 ,

d off at that tim e. Take auction and repeat recursiv ely.

a

1

1 lim ( ) m ax

k

b n k

n

E U a n

  

   

slide-17
SLIDE 17

1

1

( ) ( )]

arg max[

k

a C x k

x b

w

a U a E U C x

 

  

Reduces to intersection of decreasing m arginal utilities (bids) with acceptance thresholds, cost of m issed future opportunities. :

Receding horizon policy:

(1) k

b

( 2 ) k

b

1

w

2

w

 In sim ple exam ples, one-step ahead policy approxim ates well the optim al revenue.

slide-18
SLIDE 18

( ) ( ) ( ) .

b

U a U z x a C p x a z C     

EXPECTED CURRENT CURRENT EXPECTED FUTURE NEXT STEP REVENUE CAPACITY CAPACITY REVENUE CONSTRAINT CONSTRAINT

, , subject to

m ax

Fluid aproxim ation to receding horizon p olicy:

The network case

:

r r

a r z current allocation, broker : expected next-step allocation.

( ) ( ) ( ) ( )

r

r r b r

U a U z R x a C RP x a z C      

,

m ax subject to

    Netw ork utility m axim ization, w ith additional (step ahead) variables. Distributed im plem entation: dual algorithm , proxim al m ethod. Converges to fluid approxim ation, requires roundoff. Extends to m ultipath routing.

slide-19
SLIDE 19
  • 3. Auctions in the power grid

LAO

D (dem and)

In deregulated wholesale electricity m arkets, auctions are carried out by the Independent System Operator (ISO) to buy power for, e.g. one day ahead dem a nd.   auction of the type m entioned before, e xcept that pow er is divisible and m ay be offered in different Procur am oun e t m ent s.

quantity (M W )

unit price ($/MW h)

FRO

Typically, a com m on m arket price is set. Possible choices:

  • Last Accepted Offer,
  • First Rejected Offer
  • Som ething in between.

 Tw o-sided (supply-dem and) auctions also possible. Ref: Zim m erm an '2010. 

slide-20
SLIDE 20

Recall: three issues in bandwidth auctions

  • 1. Auction allocation/payment mechanism

– Optimize the value of accepted bids. – Charge 1st price, VCG would have high complexity (Maillé-Tuffin ´07). – Revenue equivalence argument.

  • 2. Distributed auction over a general network topology.

– Bids submitted to “bandwidth brokers” distributed across the network. – Bidders need not know network topology, capacity, etc. – Brokers run a distributed algorithm to allocate the auction.

  • 3. Inter-temporal constraints.

– Auctions are held periodically, for currently available capacity. – Service may be longer than the auction period, and reservations are in place: a connection, once assigned, cannot be displaced by future bids. – So the seller optimize over the risk of future bids: selling capacity now with a low bid can cause the rejection of a better bid in the future.

slide-21
SLIDE 21

Issue 1 revisited: pricing mechanism

  • In the Internet problem, we maximized the value of the bids

admitted to the network.

  • Analog for a procurement auction: minimizing the cost of

acquired power. Good for customers.

  • However, first-price (pay offers at their declared value) is not

favored, a common market clearing price (MCP) is paid. Not quite VCG, but closer in spirit to 2nd price schemes. Is social welfare of sellers the objective?

  • Difference with bandwidth case: players (generator firms) are

sophisticated, can afford to game the system.

  • Still, gaming is possible by combining

two offers, e.g. hockey-stick bidding:

MCP

D

slide-22
SLIDE 22

Issue 2 revisited: network topology

  • Previous discussion applies to trading at a single location.
  • If a transmission network is present:

– Offers associated with specific network buses. – ISO minimizes cost subject to meeting demand, and capacity constraints (the power being dispatchable). Prices become node-dependent (Locational Marginal Prices, LMPs). – Integer constraints present? – Underlying power flow more complex than convex constraints for the Internet case. Some papers use DC power flow. Recent developments (Lavaei-Low) on convexified OPF may be relevant here.).

  • Distributed solutions?

– Do not appear so relevant in the ISO case. – Perhaps for auctions involving mutliple ISOs?

slide-23
SLIDE 23

Issue 3 revisited: inter-temporal constraints

  • In the power problem, coupling over time can appear from

startup constraints: according to technology, some generator plants cannot easily be turned on and off.

i i i

i i

a q S

a

 

  • ffer in

quantity startup $ MW h cost

's.

need not select cheapest If this is done, inconsistent

In Yan et al. (IEEE Pow er "Bid '08) an additive startup cost considered cost m inim izat . ion",

i i

i

M CP q S  

to pay at the M CP (m kt clearing m arginal price). can reduce cost paid out. But, seem s an artifice of the paym ent ch oice.

"Paym ent cost m inim ization"

Startup costs do not represent correctly the m ultiple period case. Block bids for m ultiple intervals, increase auction com plexity. Perhaps a receding horizon policy can b e useful for this purpose.

slide-24
SLIDE 24

Conclusion

  • Bandwidth allocation has been the focus of substantial

academic research over the last decade, as a test case for distributed optimization and economic theory.

  • In particular, we showed work on bandwidth auctions that

attempts to put these models to practical use.

  • However, the practical Internet rarely follows sophisticated

pricing schemes: too much abundance of bandwidth?

  • Given the “real” scarcity of energy, perhaps the power grid is a

more adequate setting for exploiting these mathematical tools.