Provenance Collection on GENI Experimental Networks GUSH and - PowerPoint PPT Presentation

Provenance Collection on GENI Experimental Networks

GUSH and Twister on Planetlab GUSH deploys Node 0 Head node of BFS application and application. Called Node 0 in Partition graph monitors status. PlanetLab slice It’s like a shell or window. Broker BFS driver Collect result from reduce GUSH Graph coloring done Node 1 Node 10 in nodes 1-10 of PlanetLab slice M M M … M M … M R R R R R R …… M: Map Work Pool Work Pool M R: Reduce R Local Disk Local Disk

Provenance Capture using NetKarma NetKarma Provenance NetKarma Provenance Collection System Collection System RM GENI Adaptor GENI Adaptor PL Node 0 Partition graph VM Broker BFS driver Collect result from reduce Log GUSH VM VM Node 1 PL Node 10 PL M M … M M M … M R R R R R R …… PL PL: PlanetLab Node M: Map Work Pool Work Pool VM VM: Virtual Machine R: Reduce RM RM: Remote Machine (IN) Local Disk Local Disk

Twister + BFS Provenance Capture, Retrieval, Visualization Twister Single Twister Multiple Rule file Run Log ‐ file Run Log ‐ file VM VM VM GENI Provenance Adaptor GMOC Database VM Notifications Queued Web Service Message Bus GMOC Adaptor Capture Capture RM RM Notifications Ingested Provenance NetKarma Service Repository RM RM Provenance Graph Retrieved Retrieve Retrieve NetKarma Query Client LM LM LM: Local Machine VM VM: Local Virtual Machine RM RM: Remote Machine (IN) Provenance Visualization Visualize Visualize LM