Improving DPOP with Branch Consistency for Solving Distributed - - PowerPoint PPT Presentation

improving dpop with branch consistency for solving
SMART_READER_LITE
LIVE PREVIEW

Improving DPOP with Branch Consistency for Solving Distributed - - PowerPoint PPT Presentation

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions Improving DPOP with Branch Consistency for Solving Distributed Constraint Optimization Problems Ferdinando Fioretto 1 , 2 Tiep Le 1 William Yeoh


slide-1
SLIDE 1

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Improving DPOP with Branch Consistency for Solving Distributed Constraint Optimization Problems

Ferdinando Fioretto 1,2 Tiep Le 1 William Yeoh 1 Enrico Pontelli 1 Tran Cao Son 1

  • 1Dept. Computer Science, New Mexico State University
  • 2Dept. Mathematics and Computer Science, University of Udine
  • Sept. 9, 2014
slide-2
SLIDE 2

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Talk Outline

1

Motivation and Background

2

Branch Consistency for Pseudo-Trees

3

Experiments and Results

4

Conclusions

slide-3
SLIDE 3

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Distributed Optimization: Motivations

Some problems cannot be realistically addressed in a centralized fashion. Agents cooperate to achieve a common objective. Simultaneously they can purse private goals. Agents are constrained by limited communication capabilities.

Source: http://kenanaonline.com/users/antennamaker

slide-4
SLIDE 4

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Distributed Optimization: Motivations

Some problems cannot be realistically addressed in a centralized fashion. Agents cooperate to achieve a common objective. Simultaneously they can purse private goals. Agents are constrained by limited communication capabilities. Solving time is important!

slide-5
SLIDE 5

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Distributed Constrained Optimization (DCOP)

A DCOP is defined by a tuple A, X, D, F α, where: A is a set of agents; X is a set of variables. D is a set of finite domains. F is a set of utility functions, fi : ×xj∈scope(fi)Dj → N ∪ {0, −∞}. α : X → A maps each variable to one agent.

a2 a1 a3 a4 a5

x1 x3 x4 x5

= < =

soft

x2

>

x1 x3 x4 x5

= < =

soft

x2

>

x1 x5 Utilities 20 1 8 2 10 3 3 . . . 3 3 2

Constraint Graph Pseudo-tree Soft Constraint Table

slide-6
SLIDE 6

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Distributed Constrained Optimization (DCOP)

A DCOP is defined by a tuple A, X, D, F α, where: A is a set of agents; X is a set of variables. D is a set of finite domains. F is a set of utility functions, fi : ×xj∈scope(fi)Dj → N ∪ {0, −∞}. α : X → A maps each variable to one agent.

a2 a1 a3 a4 a5

x1 x3 x4 x5

= < =

soft

x2

>

x1 x3 x4 x5

= < =

soft

x2

>

x1 x3 Utilities −∞ 1 2 3 . . . 3 3 −∞

Constraint Graph Pseudo-tree Hard Constraint Table

slide-7
SLIDE 7

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Solving DCOP

Find an utility maximal assignment for all the variables of the problem. Agents communicate exchanging messages. This is often the bottleneck!

slide-8
SLIDE 8

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Solving DCOP (cont.)

Distributed Pseudo-Tree Optimization Procedure (DPOP)

1

Pseudo-Tree Construction Phase.

2

UTIL propagation phase.

3

VALUE propagation phase.

UTIL Phase Computations of a5 (x5): UTIL Table x1 x4 Utilities max(20+0, 8-∞, 10-∞, 3-∞) = 20 1 max(20-∞, 8+0, 10-∞, 3-∞) = 8 2 max(20-∞, 8-∞, 10+0, 3-∞) = 10 3 max(20-∞, 8-∞, 10-∞, 3+0) = 3 . . . . . .

= < =

soft

x1 x3 x4 x5 x2 > x1 x5 Utilities 20 1 8 2 10 3 3 . . .

slide-9
SLIDE 9

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Solving DCOP (cont.)

Distributed Pseudo-Tree Optimization Procedure (DPOP)

1

Pseudo-Tree Construction Phase.

2

UTIL propagation phase.

3

VALUE propagation phase.

UTIL Phase Computations of a5 (x5): UTIL Table x1 x4 Utilities max(20+0, 8-∞, 10-∞, 3-∞) = 20 1 max(20-∞, 8+0, 10-∞, 3-∞) = 8 2 max(20-∞, 8-∞, 10+0, 3-∞) = 10 3 max(20-∞, 8-∞, 10-∞, 3+0) = 3 . . . . . .

= < =

soft

x1 x3 x4 x5 x2 > x1 x5 Utilities 20 1 8 2 10 3 3 . . .

slide-10
SLIDE 10

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Solving DCOP (cont.)

Distributed Pseudo-Tree Optimization Procedure (DPOP)

1

Pseudo-Tree Construction Phase.

2

UTIL propagation phase.

3

VALUE propagation phase.

UTIL Phase Computations of a5 (x5): UTIL Table x1 x4 Utilities max(20+0, 8-∞, 10-∞, 3-∞) = 20 1 max(20-∞, 8+0, 10-∞, 3-∞) = 8 2 max(20-∞, 8-∞, 10+0, 3-∞) = 10 3 max(20-∞, 8-∞, 10-∞, 3+0) = 3 . . . . . .

= < =

soft

x1 x3 x4 x5 x2 > x1 x5 Utilities 20 1 8 2 10 3 3 . . .

slide-11
SLIDE 11

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Solving DCOP (cont.)

Distributed Pseudo-Tree Optimization Procedure (DPOP)

1

Pseudo-Tree Construction Phase.

2

UTIL propagation phase.

3

VALUE propagation phase.

UTIL Phase Computations of a5 (x5): UTIL Table x1 x4 Utilities max(20+0, 8-∞, 10-∞, 3-∞) = 20 1 max(20-∞, 8+0, 10-∞, 3-∞) = 8 2 max(20-∞, 8-∞, 10+0, 3-∞) = 10 3 max(20-∞, 8-∞, 10-∞, 3+0) = 3 . . . . . .

= < =

soft

x1 x3 x4 x5 x2 > x1 x5 Utilities 20 1 8 2 10 3 3 . . .

slide-12
SLIDE 12

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Solving DCOP (cont.)

Distributed Pseudo-Tree Optimization Procedure (DPOP)

1

Pseudo-Tree Construction Phase.

2

UTIL propagation phase.

3

VALUE propagation phase.

UTIL Phase Computations of a5 (x5): UTIL Table x1 x4 Utilities max(20+0, 8-∞, 10-∞, 3-∞) = 20 1 max(20-∞, 8+0, 10-∞, 3-∞) = 8 2 max(20-∞, 8-∞, 10+0, 3-∞) = 10 3 max(20-∞, 8-∞, 10-∞, 3+0) = 3 . . . . . .

= < =

soft

x1 x3 x4 x5 x2 > x1 x5 Utilities 20 1 8 2 10 3 3 . . .

slide-13
SLIDE 13

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Solving DCOP (cont.)

Distributed Pseudo-Tree Optimization Procedure (DPOP)

1

Pseudo-Tree Construction Phase.

2

UTIL propagation phase.

3

VALUE propagation phase.

UTIL Phase Computations of a5 (x5): UTIL Table x1 x4 Utilities max(20+0, 8-∞, 10-∞, 3-∞) = 20 1 max(20-∞, 8+0, 10-∞, 3-∞) = 8 2 max(20-∞, 8-∞, 10+0, 3-∞) = 10 3 max(20-∞, 8-∞, 10-∞, 3+0) = 3 . . . . . .

= < =

soft

x1 x3 x4 x5 x2 > x1 x5 Utilities 20 1 8 2 10 3 3 . . .

slide-14
SLIDE 14

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Solving DCOP (cont.)

Distributed Pseudo-Tree Optimization Procedure (DPOP)

1

Pseudo-Tree Construction Phase.

2

UTIL propagation phase.

3

VALUE propagation phase.

UTIL Phase Computations of a5 (x5): UTIL Table x1 x4 Utilities max(20+0, 8-∞, 10-∞, 3-∞) = 20 1 max(20-∞, 8+0, 10-∞, 3-∞) = 8 2 max(20-∞, 8-∞, 10+0, 3-∞) = 10 3 max(20-∞, 8-∞, 10-∞, 3+0) = 3 . . . . . .

= < =

soft

x1 x3 x4 x5 x2 > x1 x5 Utilities 20 1 8 2 10 3 3 . . .

slide-15
SLIDE 15

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Solving DCOP (cont.)

Distributed Pseudo-Tree Optimization Procedure (DPOP)

1

Pseudo-Tree Construction Phase.

2

UTIL propagation phase.

3

VALUE propagation phase.

UTIL Phase Computations of a5 (x5): UTIL Table x1 x4 Utilities max(20+0, 8-∞, 10-∞, 3-∞) = 20 1 max(20-∞, 8+0, 10-∞, 3-∞) = 8 2 max(20-∞, 8-∞, 10+0, 3-∞) = 10 3 max(20-∞, 8-∞, 10-∞, 3+0) = 3 . . . . . .

= < =

soft

x1 x3 x4 x5 x2 > x1 x5 Utilities 20 1 8 2 10 3 3 . . .

slide-16
SLIDE 16

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Solving DCOP (cont.)

Distributed Pseudo-Tree Optimization Procedure (DPOP)

1

Pseudo-Tree Construction Phase.

2

UTIL propagation phase.

3

VALUE propagation phase.

UTIL Phase Computations of a5 (x5): UTIL Table x1 x4 Utilities max(20+0, 8-∞, 10-∞, 3-∞) = 20 1 max(20-∞, 8+0, 10-∞, 3-∞) = 8 2 max(20-∞, 8-∞, 10+0, 3-∞) = 10 3 max(20-∞, 8-∞, 10-∞, 3+0) = 3 . . . . . .

= < =

soft

x1 x3 x4 x5 x2 > x1 x5 Utilities 20 1 8 2 10 3 3 . . .

slide-17
SLIDE 17

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Solving DCOP (cont.)

Distributed Pseudo-Tree Optimization Procedure (DPOP)

1

Pseudo-Tree Construction Phase.

2

UTIL propagation phase.

3

VALUE propagation phase.

UTIL Phase Computations of a5 (x5): UTIL Table x1 x4 Utilities max(20+0, 8-∞, 10-∞, 3-∞) = 20 1 max(20-∞, 8+0, 10-∞, 3-∞) = 8 2 max(20-∞, 8-∞, 10+0, 3-∞) = 10 3 max(20-∞, 8-∞, 10-∞, 3+0) = 3 . . . . . .

= < =

soft

x1 x3 x4 x5 x2 > x1 x5 Utilities 20 1 8 2 10 3 3 . . .

slide-18
SLIDE 18

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Distributed Optimization: Current Limitations

1

The DCOP community has not focused on exploiting hard constraints.1

2

Number of messages exchanged vs Message Size.

1With few exceptions that do not take advantage of CP technologies.

slide-19
SLIDE 19

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Distributed Optimization: Current Limitations

1

The DCOP community has not focused on exploiting hard constraints.1

2

Number of messages exchanged vs Message Size.

3

Can we improve on these limitations and achieve better results?

1With few exceptions that do not take advantage of CP technologies.

slide-20
SLIDE 20

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Exploiting Hard Constraints

In the context of the DPOP algorithm. Assume that we are given a DCOP with hard constraints. First Trial: Integrating Arc Consistency to prune the UTIL table.

slide-21
SLIDE 21

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Exploiting Hard Constraints

In the context of the DPOP algorithm. Assume that we are given a DCOP with hard constraints. First Trial: Integrating Arc Consistency to prune the UTIL table.

Given a set of links. Assign them a frequency. The inference at the receivers: |xi − xj| > s. Use as few frequencies as possible. Radio Frequency Assignment Problem

Number of Agents Message Size improvement 10 20 30 40 50 60 5 10 15 20 25 30 35 40 45 50 55 AC vs DPOP

  • ut of memory
slide-22
SLIDE 22

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Exploiting Hard Constraints

In the context of the DPOP algorithm. Assume that we are given a DCOP with hard constraints. First Trial: Integrating Arc Consistency to prune the UTIL table.

= < =

soft

x1 x3 x4 x5 x2 >

1 2 3 1 2 3 1 2 3 1 2 3 1 2 3

slide-23
SLIDE 23

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Exploiting Hard Constraints

In the context of the DPOP algorithm. Assume that we are given a DCOP with hard constraints. First Trial: Integrating Arc Consistency to prune the UTIL table.

= < =

soft

x1 x3 x4 x5 x2 >

1 2 3 1 2 3 1 2 3 1 2 3 1 2 3

slide-24
SLIDE 24

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Exploiting Hard Constraints

In the context of the DPOP algorithm. Assume that we are given a DCOP with hard constraints. First Trial: Integrating Arc Consistency to prune the UTIL table.

= < =

soft

x1 x3 x4 x5 x2 >

1 2 3 1 2 3 1 2 3 1 2 3 1 2 3

x5 x4 x1

0 0 1 0 0 2 0 1 1 0 1 2 1 0 1 1 0 2 1 1 1 1 1 2

UTIL5

slide-25
SLIDE 25

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Exploiting Hard Constraints

In the context of the DPOP algorithm. Assume that we are given a DCOP with hard constraints. First Trial: Integrating Arc Consistency to prune the UTIL table.

= < =

soft

x1 x3 x4 x5 x2 >

1 2 3 1 2 3 1 2 3 1 2 3 1 2 3

x5 x4 x1

0 0 1 0 0 2 0 1 1 0 1 2 1 0 1 1 0 2 1 1 1 1 1 2

UTIL5

slide-26
SLIDE 26

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Exploiting Hard Constraints

In the context of the DPOP algorithm. Assume that we are given a DCOP with hard constraints. First Trial: Integrating Arc Consistency to prune the UTIL table.

= < =

soft

x1 x3 x4 x5 x2 >

1 2 3 1 2 3 1 2 3 1 2 3 1 2 3

x5 x4 x1

0 0 1 0 0 2 0 1 1 0 1 2 1 0 1 1 0 2 1 1 1 1 1 2

UTIL5

slide-27
SLIDE 27

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Branch Consistency (BrC)

  • Obs. 1: The domain store transmits a limited amount of
  • information. It accounts for no interaction among variables.
  • Obs. 2: A Pseudo-Tree branch contains the relevant information

to build the UTIL tables.

slide-28
SLIDE 28

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Branch Consistency (BrC) (cont.)

  • Def. Branch Consistency for

pair of values:

= < =

soft

x1 x3 x4 x5 x2 >

1 2 3 1 2 3 1 2 3 1 2 3 1 2 3

  • Def. A DCOP is Branch Consistent (BrC) iff for any pair of variables (xi, xj) with xi

and xj in the same branch, and any (u, v) ∈ fij, (u, v) is branch consistent.

  • Def. The Value Reachability Matrix (VRM) Mij of xi and xj, with xi ancestor of xj, is

a binary matrix of size |Di|×|Dj|, where Mij[r, c]=1 iff (r, c) is BrC.

slide-29
SLIDE 29

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

BrC-DPOP

BrC-DPOP consists of 5 phases:

  • 1. Pseudo-tree Generation Phase.

= < =

soft

x1 x3 x4 x5 x2 >

slide-30
SLIDE 30

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

BrC-DPOP

BrC-DPOP consists of 5 phases:

  • 2. Path Construction Phase.

= < =

soft

x1 x3 x4 x5 x2 > x1 x2

<

x3 x4

=

x4 x5

=

x1 x3

> 0 1 1 1 0 0 1 1 0 0 0 1 0 0 0 0

x1 x2

0 0 0 0 1 0 0 0 1 1 0 0 1 1 1 0

x1 x3

1 0 0 0 0 1 0 0 0 0 1 0 0 0 0 1

x3 x4

1 0 0 0 0 1 0 0 0 0 1 0 0 0 0 1

x4 x5

0 1 2 3 1 2 3

slide-31
SLIDE 31

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

BrC-DPOP

BrC-DPOP consists of 5 phases:

  • 2. Path Construction Phase.

= < =

soft

x1 x3 x4 x5 x2 > x1 x5

x3

x1 x5

x4

x3 x5

x5

x1 x2

<

x3 x4

=

x4 x5

=

x1 x3

> 0 1 1 1 0 0 1 1 0 0 0 1 0 0 0 0

x1 x2

0 0 0 0 1 0 0 0 1 1 0 0 1 1 1 0

x1 x3

1 0 0 0 0 1 0 0 0 0 1 0 0 0 0 1

x3 x4

1 0 0 0 0 1 0 0 0 0 1 0 0 0 0 1

x4 x5

0 1 2 3 1 2 3

slide-32
SLIDE 32

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

BrC-DPOP

BrC-DPOP consists of 5 phases:

  • 2. Path Construction Phase.

= < =

soft

x1 x3 x4 x5 x2 > = < =

soft

x1 x3 x4 x5 x2 > x1 x5

x3

x1 ?

x4

x3 ?

x5

x1 x2

<

x3 x4

=

x4 x5

=

x1 x3

> 0 1 1 1 0 0 1 1 0 0 0 1 0 0 0 0

x1 x2

0 0 0 0 1 0 0 0 1 1 0 0 1 1 1 0

x1 x3

1 0 0 0 0 1 0 0 0 0 1 0 0 0 0 1

x3 x4

1 0 0 0 0 1 0 0 0 0 1 0 0 0 0 1

x4 x5

0 1 2 3 1 2 3

slide-33
SLIDE 33

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

BrC-DPOP

BrC-DPOP consists of 5 phases:

  • 3. Arc Consistency Enforcement Phase.

= < =

soft

x1 x3 x4 x5 x2 > x1 x2

<

x3 x4

=

x4 x5

=

x1 x3

> 0 1 1 1 0 0 1 1 0 0 0 1 0 0 0 0

x1 x2

0 0 0 0 1 0 0 0 1 1 0 0 1 1 1 0

x1 x3

1 0 0 0 0 1 0 0 0 0 1 0 0 0 0 1

x3 x4

1 0 0 0 0 1 0 0 0 0 1 0 0 0 0 1

x4 x5

0 1 2 3 1 2 3

slide-34
SLIDE 34

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

BrC-DPOP

BrC-DPOP consists of 5 phases:

  • 3. Arc Consistency Enforcement Phase.

= < =

soft

x1 x3 x4 x5 x2 > x1 x2

<

x3 x4

=

x4 x5

=

x1 x3

> 0 0 0 0 0 0 1 1 0 0 0 1 0 0 0 0

x1 x2

0 0 0 0 1 0 0 0 1 1 0 0 0 0 0 0

x1 x3

1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0

x3 x4

1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0

x4 x5

0 1 2 3 1 2 3

slide-35
SLIDE 35

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

BrC-DPOP

BrC-DPOP consists of 5 phases:

  • 4. Branch Consistency Enforcement Phase.

= < =

soft

x1 x3 x4 x5 x2 > = < =

soft

x1 x3 x4 x5 x2 > x1 x2

<

x3 x4

=

x4 x5

=

x1 x3

> 0 0 0 0 0 0 1 1 0 0 0 1 0 0 0 0

x1 x2

0 0 0 0 1 0 0 0 1 1 0 0 0 0 0 0

x1 x3

1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0

x3 x4

1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0

x4 x5

0 1 2 3 1 2 3

slide-36
SLIDE 36

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

BrC-DPOP

BrC-DPOP consists of 5 phases:

  • 4. Branch Consistency Enforcement Phase.

= < =

soft

x1 x3 x4 x5 x2 > = < =

soft

x1 x3 x4 x5 x2 > x1 x5

x3

M11

0 0 0 0 0 1 0 0 0 0 1 0 0 0 0 0

x1 x1 x1 x2

<

x3 x4

=

x4 x5

=

x1 x3

> 0 0 0 0 0 0 1 1 0 0 0 1 0 0 0 0

x1 x2

0 0 0 0 1 0 0 0 1 1 0 0 0 0 0 0

x1 x3

1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0

x3 x4

1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0

x4 x5

0 1 2 3 1 2 3

slide-37
SLIDE 37

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

BrC-DPOP

BrC-DPOP consists of 5 phases:

  • 4. Branch Consistency Enforcement Phase.

= < =

soft

x1 x3 x4 x5 x2 > = < =

soft

x1 x3 x4 x5 x2 > x1 ?

x4

M31

0 0 0 0 1 0 0 0 1 1 0 0 0 0 0 0

x1 x3

M11

0 0 0 0 0 1 0 0 0 0 1 0 0 0 0 0

x1 x1 X

=

M31

0 0 0 0 1 0 0 0 1 1 0 0 0 0 0 0

x1 x3 x1 x2

<

x3 x4

=

x4 x5

=

x1 x3

> 0 0 0 0 0 0 1 1 0 0 0 1 0 0 0 0

x1 x2

0 0 0 0 1 0 0 0 1 1 0 0 0 0 0 0

x1 x3

1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0

x3 x4

1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0

x4 x5

0 1 2 3 1 2 3

slide-38
SLIDE 38

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

BrC-DPOP

BrC-DPOP consists of 5 phases:

  • 4. Branch Consistency Enforcement Phase.

= < =

soft

x1 x3 x4 x5 x2 > = < =

soft

x1 x3 x4 x5 x2 > x3 ?

x5

M43

1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0

x3 x4

M31

0 0 0 0 1 0 0 0 1 1 0 0 0 0 0 0

x1 x3 X

=

M41

0 0 0 0 1 0 0 0 1 1 0 0 0 0 0 0

x1 x4 x1 x2

<

x3 x4

=

x4 x5

=

x1 x3

> 0 0 0 0 0 0 1 1 0 0 0 1 0 0 0 0

x1 x2

0 0 0 0 1 0 0 0 1 1 0 0 0 0 0 0

x1 x3

1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0

x3 x4

1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0

x4 x5

0 1 2 3 1 2 3

slide-39
SLIDE 39

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

BrC-DPOP

BrC-DPOP consists of 5 phases:

  • 4. Branch Consistency Enforcement Phase.

= < =

soft

x1 x3 x4 x5 x2 > = < =

soft

x1 x3 x4 x5 x2 >

M54

1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0

x4 x5

M41

0 0 0 0 1 0 0 0 1 1 0 0 0 0 0 0

x1 x4 X

=

M51

0 0 0 0 1 0 0 0 1 1 0 0 0 0 0 0

x1 x5 x1 x2

<

x3 x4

=

x4 x5

=

x1 x3

> 0 0 0 0 0 0 1 1 0 0 0 1 0 0 0 0

x1 x2

0 0 0 0 1 0 0 0 1 1 0 0 0 0 0 0

x1 x3

1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0

x3 x4

1 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0

x4 x5

0 1 2 3 1 2 3

slide-40
SLIDE 40

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

BrC-DPOP

BrC-DPOP consists of 5 phases:

  • 5. UTIL and VALUE Phases.

= < =

soft

x1 x3 x4 x5 x2 >

x5 x4 x1

0 0 1 0 0 2 1 1 2

UTIL5

slide-41
SLIDE 41

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

BrC-DPOP

BrC-DPOP consists of 5 phases:

  • 5. UTIL and VALUE Phases.

Radio Frequency Assignment Problem

Number of Agents Message Size improvement 10 20 30 40 50 60 5 10 15 20 25 30 35 40 45 50 55 AC vs DPOP

  • ut of memory
slide-42
SLIDE 42

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

BrC-DPOP

BrC-DPOP consists of 5 phases:

  • 5. UTIL and VALUE Phases.

Radio Frequency Assignment Problem

Number of Agents Message Size improvement 10 20 30 40 50 60 5 10 15 20 25 30 35 40 45 50 55 AC vs DPOP BrC vs DPOP

slide-43
SLIDE 43

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

BrC-DPOP: Theoretical Results

Let n = |A|, e = |F| and d = maxxi∈X |Di|. Theorem 1. The AC propagation phase requires O(nde) messages, each of size O(d). Theorem 2. The BrC propagation phase requires O(e) messages, each of size O(d2). Theorem 3. The DCOP is arc consistent after the AC propagation phase. Theorem 4. The DCOP is branch consistent after the BrC propagation phase. Theorem 5. BrC-DPOP is complete and correct.

slide-44
SLIDE 44

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Experiments: Algorithms

DPOP H-DPOP P(rivacy-enhanced) H-DPOP AC-DPOP (only AC Propagation phase) BrC-DPOP

slide-45
SLIDE 45

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Experiments: Radio Link Frequency Assignment

  • BC−DPOP

AC−DPOP DPOP H−DPOP PH−DPOP

Number of Agents Message Size

5 10 15 20 25 30 35 40 45 50 55 10 102 103 104 105 106 107

  • Number of Agents

Simlated Time (ms)

5 10 15 20 25 30 35 40 45 50 55 0.1 1 10 100 103 104 105

slide-46
SLIDE 46

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Experiments: Random Graphs (Varying p1)

|A| = 10. |X| = 10. |Di| = 8, ∀xi ∈ X. p2 = 0.6 We randomly injected hard constraints of type < or =.

  • BC−DPOP

AC−DPOP DPOP H−DPOP PH−DPOP

p1 Simulated Time (ms)

0.3 0.4 0.5 0.6 0.7 0.8 0.9

1 10 100 103 104 105

slide-47
SLIDE 47

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Experiments: Random Graphs (Varying p2)

|A| = 10. |X| = 10. |Di| = 8, ∀xi ∈ X. p1 = 0.6 We randomly injected hard constraints of type < or =.

  • BC−DPOP

AC−DPOP DPOP H−DPOP PH−DPOP

p2 Simulated Time (ms)

0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9

10 100 103 104 105

slide-48
SLIDE 48

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Conclusions and Future Works

Message size is one of the most important bottleneck in solving DCOPs. We have introduced the concept of Branch Consistency for Pseudo-Trees. We have introduced BrC-DPOP. Enhanced performances and scalability on random graphs and RLFA problems. We plan to extend this approach by:

Exploring propagation of soft constraints. Handling high arity constraints.

We are also interested in studying memory bounded solutions to scale up even to larger problems.

slide-49
SLIDE 49

Motivation and Background Branch Consistency for Pseudo-Trees Experiments and Results Conclusions

Conclusions and Future Works

Message size is one of the most important bottleneck in solving DCOPs. We have introduced the concept of Branch Consistency for Pseudo-Trees. We have introduced BrC-DPOP. Enhanced performances and scalability on random graphs and RLFA problems. We plan to extend this approach by:

Exploring propagation of soft constraints. Handling high arity constraints.

We are also interested in studying memory bounded solutions to scale up even to larger problems. Thank You!