SLIDE 1
Robin Sommer
ICSI / LBNL / Broala
robin@icsi.berkeley.edu robin@broala.com http://www.icir.org/robin
Broker
Bro Communication
2
Broker Bros New Communication Library Robin Sommer ICSI / LBNL / - - PowerPoint PPT Presentation
Broker Bros New Communication Library Robin Sommer ICSI / LBNL / - - PowerPoint PPT Presentation
Broker Bros New Communication Library Robin Sommer ICSI / LBNL / Broala robin@icsi.berkeley.edu robin@broala.com http://www.icir.org/robin Bro Communication 2 Broker Bro Communication Exchanging Events Separates event generation from
SLIDE 2
SLIDE 3
Broker
Bro Communication
Exchanging Events
Separates event generation from handling.
2
SLIDE 4
Broker
Bro Communication
Exchanging Events
Separates event generation from handling.
Logging Remotely
Aggregates logs on remote side.
2
SLIDE 5
Broker
Bro Communication
Exchanging Events
Separates event generation from handling.
Logging Remotely
Aggregates logs on remote side.
Distributing State
Provides shared view across instances.
2
SLIDE 6
Broker
Bro Communication
Exchanging Events
Separates event generation from handling.
Logging Remotely
Aggregates logs on remote side.
Distributing State
Provides shared view across instances.
2
SLIDE 7
Broker
Use Case: Bro Cluster
3
Bro Manager Bro Worker 1 Bro Worker 2
Load-balanced Traffic Stream
Bro Worker 3
Logs & Events
SLIDE 8
Broker
Use Case: Bro Cluster
3
Bro Manager Bro Worker 1 Bro Worker 2
Load-balanced Traffic Stream
Bro Proxy Bro Worker 3
&synchronized State Logs & Events
SLIDE 9
Broker
Use Case: External Integration
4
Application A Application B Events
Bro
Application C
SLIDE 10
Broker
Traditional Implementation
5
Bro A Bro B
Events Logs State Updates
SLIDE 11
Broker
Traditional Implementation
5
Bro A Child Process Child Process Bro B
Events Logs State Updates
SLIDE 12
Broker
Traditional Implementation
5
Bro A Child Process Child Process Bro B libbroccoli
Events Logs State Updates Events C Python Ruby Perl
SLIDE 13
Broker
Traditional Implementation
5
Bro A Child Process Child Process Bro B libbroccoli
Events Logs State Updates Events C Python Ruby Perl
It’s showing its age …
Race conditions with &synchronized. No good persistence story. Not much control over data flow. Complex & inefficient protocol. Implementation deficiencies. Two independent implementations.
SLIDE 14
Broker
Introducing the Broker Library
6
Bro A Bro B
Events Logs State Updates
SLIDE 15
Broker
Introducing the Broker Library
6
Bro A Bro B Broker Broker
Events Logs State Updates
SLIDE 16
Broker
Introducing the Broker Library
6
Bro A Bro B Broker Broker Broker
C C++ Python
Application
Events Logs State Updates
SLIDE 17
Broker
Introducing the Broker Library
6
Bro A Bro B Broker Broker Broker
C C++ Python
Application
Events Logs State Updates
Broker
Unified Library New protocol Publish/subscribe Limiting type system’s flexibility. Explicit state operations.
SLIDE 18
Broker
Exchanging Events with Broker
7
Bro Broker Broker Bro Receiver Sender my_event(“Bro”, 42)
SLIDE 19
Broker
Exchanging Events with Broker
7
Bro Broker Broker Bro Receiver Sender my_event(“Bro”, 42) Topic: “bro/event”
SLIDE 20
Broker
Exchanging Events with Broker
7
Bro Broker Broker Bro Receiver Sender subscribe_to_events(“bro/event”) my_event(“Bro”, 42) Topic: “bro/event”
SLIDE 21
Broker
Exchanging Events with Broker
7
Bro Broker Broker Bro Receiver Sender subscribe_to_events(“bro/event”) my_event(“Bro”, 42) my_event(“Bro”, 42) Topic: “bro/event”
SLIDE 22
Broker
Exchanging Events with Broker
7
Bro Broker Broker Bro Receiver Sender subscribe_to_events(“bro/event”) my_event(“Bro”, 42) my_event(“Bro”, 42) my_event(“Bro”, 42) Topic: “bro/event”
SLIDE 23
Broker
Exchanging Events with Broker
8
Demo
SLIDE 24
Broker
Forwarding Logs with Broker
9
Broker Bro Broker Bro Receiver Sender Log::write(…)
SLIDE 25
Broker
Forwarding Logs with Broker
9
Broker Bro Broker Bro Receiver Sender Log::write(…) Topic: “bro/log”
SLIDE 26
Broker
Forwarding Logs with Broker
9
Broker Bro Broker Bro Receiver Sender subscribe_to_logs(“bro/log”) Log::write(…) Topic: “bro/log”
SLIDE 27
Broker
Forwarding Logs with Broker
9
Broker Bro Broker Bro Receiver Sender subscribe_to_logs(“bro/log”) Log::write(…) Log::write(…) Topic: “bro/log”
SLIDE 28
Broker
Forwarding Logs with Broker
9
Broker Bro Broker Bro Receiver Sender subscribe_to_logs(“bro/log”) Log::write(…) Log::write(…) Log::write(…) Topic: “bro/log”
SLIDE 29
Broker
Data Stores with Broker
10
SLIDE 30
Broker
Data Stores with Broker
10
Broker maintains global, persistent key/value stores.
SLIDE 31
Broker
Data Stores with Broker
10
Bro Broker Bro Broker Client Master
Broker maintains global, persistent key/value stores.
SLIDE 32
Broker
Data Stores with Broker
10
Bro Broker Bro Broker Client Master
Broker maintains global, persistent key/value stores.
s = create_master(“my_store”)
Key Value
Authoritative Version
SLIDE 33
Broker
Data Stores with Broker
10
Bro Broker Bro Broker Client Master
Broker maintains global, persistent key/value stores.
s = create_master(“my_store”)
Key Value
Authoritative Version
insert(s, 192.150.187.12, 21)
192.150.187.12 21
SLIDE 34
Broker
Data Stores with Broker
10
Bro Broker Bro Broker Client Master
Broker maintains global, persistent key/value stores.
s = create_master(“my_store”)
Key Value
Authoritative Version
insert(s, 192.150.187.12, 21)
192.150.187.12 21
insert(s, 131.159.14.1, 5)
131.159.14.1 5
SLIDE 35
Broker
Data Stores with Broker
10
Bro Broker Bro Broker Client Master
Broker maintains global, persistent key/value stores.
s = create_master(“my_store”)
Key Value
Authoritative Version
insert(s, 192.150.187.12, 21)
192.150.187.12 21
insert(s, 131.159.14.1, 5)
131.159.14.1 5
c = create_clone(“my_store”)
SLIDE 36
Broker
Data Stores with Broker
10
Bro Broker Bro Broker Client Master
Broker maintains global, persistent key/value stores.
s = create_master(“my_store”)
Key Value
Authoritative Version
insert(s, 192.150.187.12, 21)
192.150.187.12 21
insert(s, 131.159.14.1, 5)
131.159.14.1 5
c = create_clone(“my_store”)
clone()
Key Value
Cached Version
SLIDE 37
Broker
Data Stores with Broker
10
Bro Broker Bro Broker Client Master
Broker maintains global, persistent key/value stores.
s = create_master(“my_store”)
Key Value
Authoritative Version
insert(s, 192.150.187.12, 21)
192.150.187.12 21
insert(s, 131.159.14.1, 5)
131.159.14.1 5
c = create_clone(“my_store”)
clone()
Key Value
Cached Version
{ content }
192.150.187.12 21 131.159.14.1 5
SLIDE 38
Broker
Bro Broker
Key Value
Cached Version 192.150.187.12 21 131.159.14.1 5
Data Stores with Broker
10
Bro Broker Bro Broker Client Master
Broker maintains global, persistent key/value stores.
s = create_master(“my_store”)
Key Value
Authoritative Version
insert(s, 192.150.187.12, 21)
192.150.187.12 21
insert(s, 131.159.14.1, 5)
131.159.14.1 5
c = create_clone(“my_store”)
Key Value
Cached Version 192.150.187.12 21 131.159.14.1 5
SLIDE 39
Broker
Bro Broker
Key Value
Cached Version 192.150.187.12 21 131.159.14.1 5
Data Stores with Broker
10
Bro Broker Bro Broker Client Master
Broker maintains global, persistent key/value stores.
s = create_master(“my_store”) n = lookup(c, 192.150.187.12)
Key Value
Authoritative Version
insert(s, 192.150.187.12, 21)
192.150.187.12 21
insert(s, 131.159.14.1, 5)
131.159.14.1 5
c = create_clone(“my_store”)
Key Value
Cached Version 192.150.187.12 21 131.159.14.1 5
SLIDE 40
Broker
Bro Broker
Key Value
Cached Version 192.150.187.12 21 131.159.14.1 5
Data Stores with Broker
10
Bro Broker Bro Broker Client Master
Broker maintains global, persistent key/value stores.
s = create_master(“my_store”) insert(c, 192.150.187.43, 1947) n = lookup(c, 192.150.187.12)
Key Value
Authoritative Version
insert(s, 192.150.187.12, 21)
192.150.187.12 21
insert(s, 131.159.14.1, 5)
131.159.14.1 5
c = create_clone(“my_store”)
Key Value
Cached Version 192.150.187.12 21 131.159.14.1 5
SLIDE 41
Broker
Bro Broker
Key Value
Cached Version 192.150.187.12 21 131.159.14.1 5
Data Stores with Broker
10
Bro Broker Bro Broker Client Master
Broker maintains global, persistent key/value stores.
s = create_master(“my_store”) insert(c, 192.150.187.43, 1947) n = lookup(c, 192.150.187.12)
Key Value
Authoritative Version
insert(s, 192.150.187.12, 21)
192.150.187.12 21
insert(s, 131.159.14.1, 5)
131.159.14.1 5
c = create_clone(“my_store”)
Key Value
Cached Version 192.150.187.12 21 131.159.14.1 5
insert(…)
192.150.187.43 1947
SLIDE 42
Broker
Bro Broker
Key Value
Cached Version 192.150.187.12 21 131.159.14.1 5
Data Stores with Broker
10
Bro Broker Bro Broker Client Master
Broker maintains global, persistent key/value stores.
s = create_master(“my_store”) insert(c, 192.150.187.43, 1947) n = lookup(c, 192.150.187.12)
Key Value
Authoritative Version
insert(s, 192.150.187.12, 21)
192.150.187.12 21
insert(s, 131.159.14.1, 5)
131.159.14.1 5
c = create_clone(“my_store”)
Key Value
Cached Version 192.150.187.12 21 131.159.14.1 5
insert(…)
192.150.187.43 1947
insert(…) insert(…)
192.150.187.43 1947 192.150.187.43 1947
SLIDE 43
Broker
Data Stores with Broker
11
Demo
SLIDE 44
Broker
Data Store Features
12
SLIDE 45
Broker
Data Store Features
Data Types Supports Bro data types for keys & values.
12
SLIDE 46
Broker
Data Store Features
Data Types Supports Bro data types for keys & values. Operations Increment/decrement. Set insert/delete. Vector push/pop. Automatic expiry.
12
SLIDE 47
Broker
Data Store Features
Data Types Supports Bro data types for keys & values. Operations Increment/decrement. Set insert/delete. Vector push/pop. Automatic expiry. Persistence Choice of SQLite or RocksDB.
12
SLIDE 48
Broker
Broker Bits & Pieces
13
SLIDE 49
Broker
Broker Bits & Pieces
Fine-granular Subscription Model
All elements come with a topic or name. Prefixed-based subscription for topics. Fine control what’s published and subscribed to.
13
SLIDE 50
Broker
Broker Bits & Pieces
Fine-granular Subscription Model
All elements come with a topic or name. Prefixed-based subscription for topics. Fine control what’s published and subscribed to.
Security Model
Peers are assumed to be trustworthy. Currently no encryption/authentication; SSL later.
13
SLIDE 51
Broker
Broker’s Foundation: CAF
14
http://actor-framework.org
SLIDE 52
Broker
Broker’s Foundation: CAF
C++ Actor Framework
Concurrency through Erlang-style lightweight actors. Concise messaging API. Network-transparency abstracting transport. Efficient and adaptive. BSD license.
14
http://actor-framework.org
SLIDE 53
Broker
Broker’s Foundation: CAF
C++ Actor Framework
Concurrency through Erlang-style lightweight actors. Concise messaging API. Network-transparency abstracting transport. Efficient and adaptive. BSD license.
Trade-Offs
Needs a C++11 compiler. Introduces a new, non-standard dependency.
14
http://actor-framework.org
SLIDE 54
Broker
The Future: A “Stateful Deep Cluster”
15
SLIDE 55
Broker
The Future: A “Stateful Deep Cluster”
15
Example: Geographically distributed organization.
Global Master Bro
SLIDE 56
Broker
The Future: A “Stateful Deep Cluster”
15
Example: Geographically distributed organization.
Bro
US
Bro
UK
Bro
FR
Bro
CN
Regional Heads Global Master Bro
SLIDE 57
Broker
The Future: A “Stateful Deep Cluster”
15
Bro Bro Bro Bro Bro Bro Bro Bro
Local Clusters
Example: Geographically distributed organization.
Bro
US
Bro
UK
Bro
FR
Bro
CN
Regional Heads Global Master Bro
SLIDE 58
Broker
The Future: A “Stateful Deep Cluster”
15
Bro Bro Bro Bro Bro Bro Bro Bro
Local Clusters
Example: Geographically distributed organization.
Bro
US
Bro
UK
Bro
FR
Bro
CN
Regional Heads Global Master Bro
Corp/US/ Corp/UK/ Corp/FR/ Corp/CN/ Corp/GLOBAL/
Corp/US/… Corp/US/… Corp/UK/… Corp/UK/… Corp/FR/… Corp/FR/… Corp/CN/… Corp/CN/…
SLIDE 59
Broker
The Future: A “Stateful Deep Cluster”
15
Bro Bro Bro Bro Bro Bro Bro Bro
Local Clusters
Data Node Data Node Data Node Data Node
Data Node
Example: Geographically distributed organization.
Bro
US
Bro
UK
Bro
FR
Bro
CN
Regional Heads Global Master Bro
Corp/US/ Corp/UK/ Corp/FR/ Corp/CN/ Corp/GLOBAL/
Corp/US/… Corp/US/… Corp/UK/… Corp/UK/… Corp/FR/… Corp/FR/… Corp/CN/… Corp/CN/…
SLIDE 60
Broker
Broker, beyond Bro
16
SLIDE 61
Broker
Broker, beyond Bro
16
Distributed, real-time publish/subscribe platform, with a data model.
SLIDE 62
Broker
What This All Means for You Right Now
17
SLIDE 63
Broker
What This All Means for You Right Now
Bro 2.4
Legacy communication still the primary mechanism. Broker optional, —enable-broker to compile support. (CAF 0.13, C++11)
17
SLIDE 64
Broker
What This All Means for You Right Now
Bro 2.4
Legacy communication still the primary mechanism. Broker optional, —enable-broker to compile support. (CAF 0.13, C++11)
Git master, as of today
Legacy communication still the primary mechanism. Broker built by default, —disable-broker turns off.
(CAF 0.14, C++11)
17
SLIDE 65
Broker
What This All Means for You Right Now
Bro 2.4
Legacy communication still the primary mechanism. Broker optional, —enable-broker to compile support. (CAF 0.13, C++11)
Git master, as of today
Legacy communication still the primary mechanism. Broker built by default, —disable-broker turns off.
(CAF 0.14, C++11)
Bro 2.5 (tentative)
Broker provides primary communication mechanism. Legacy communication deprecated, but remains available.
17
SLIDE 66
Broker
What This All Means for You Right Now
Bro 2.4
Legacy communication still the primary mechanism. Broker optional, —enable-broker to compile support. (CAF 0.13, C++11)
Git master, as of today
Legacy communication still the primary mechanism. Broker built by default, —disable-broker turns off.
(CAF 0.14, C++11)
Bro 2.5 (tentative)
Broker provides primary communication mechanism. Legacy communication deprecated, but remains available.
Bro 2.6 (even more tentative)
Broker provides primary communication mechanism. Legacy communication no longer available.
17
SLIDE 67
Broker
What This All Means for You Right Now
Bro 2.4
Legacy communication still the primary mechanism. Broker optional, —enable-broker to compile support. (CAF 0.13, C++11)
Git master, as of today
Legacy communication still the primary mechanism. Broker built by default, —disable-broker turns off.
(CAF 0.14, C++11)
Bro 2.5 (tentative)
Broker provides primary communication mechanism. Legacy communication deprecated, but remains available.
Bro 2.6 (even more tentative)
Broker provides primary communication mechanism. Legacy communication no longer available.
17
Credit for Broker goes to Jon Siwek!
SLIDE 68
Robin Sommer
ICSI / LBNL / Broala
robin@icsi.berkeley.edu robin@broala.com http://www.icir.org/robin