Provenance Collection on GENI Experimental Networks GUSH and - - PowerPoint PPT Presentation

▶

Jul 14, 2023 452 likes •510 views

Provenance Collection on GENI Experimental Networks GUSH and Twister on Planetlab GUSH deploys Node 0 Head node of BFS application and application. Called Node 0 in Partition graph monitors status. PlanetLab slice Its like a shell or

SLIDE 1

Provenance Collection on GENI Experimental Networks

SLIDE 2

M R

Head node of BFS

application. Called Node 0 in

PlanetLab slice

Graph coloring done in nodes 1-10 of PlanetLab slice GUSH

M: Map R: Reduce M M M

…

R R R Work Pool Local Disk Node 1

……

Broker Partition graph BFS driver Collect result from reduce Node 0 M M M

…

R R R Work Pool Local Disk Node 10 GUSH deploys application and monitors status. It’s like a shell or window.

GUSH and Twister on Planetlab

SLIDE 3

GUSH

M: Map R: Reduce M M M

…

R R R Work Pool Local Disk Node 1

……

Broker Partition graph BFS driver Collect result from reduce Node 0 M M M

…

R R R Work Pool Local Disk Node 10

Log

NetKarma Provenance Collection System NetKarma Provenance Collection System GENI Adaptor GENI Adaptor

PL: PlanetLab Node VM: Virtual Machine RM: Remote Machine (IN) PL VM RM RM VM VM PL PL PL VM

Provenance Capture using NetKarma

SLIDE 4

GENI Provenance Adaptor NetKarma Service Notifications Queued Provenance Visualization Provenance Repository Rule file Message Bus Notifications Ingested

Twister + BFS Provenance Capture, Retrieval, Visualization

Twister Single Run Log‐file Twister Multiple Run Log‐file NetKarma Query Client Provenance Graph Retrieved

LM: Local Machine VM: Local Virtual Machine RM: Remote Machine (IN) LM VM RM LM RM RM RM VM LM VM VM VM

Capture Capture Retrieve Retrieve Visualize Visualize

Web Service

GMOC Adaptor GMOC Database