Artemis Distributed system Hun0ng for Dryad Bugs with Overview - - PowerPoint PPT Presentation

▶
artemis
SMART_READER_LITE
LIVE PREVIEW

Artemis Distributed system Hun0ng for Dryad Bugs with Overview - - PowerPoint PPT Presentation

Jan 29, 2024 612 likes •882 views

Artemis Distributed system Hun0ng for Dryad Bugs with Overview Artemis Logs System Architecture Data Data collec1on Collec1o n Database View GUI Plugins GUI Plugins Conclusion s Hunting for Bugs with Artemis pptPlex

slide-1
SLIDE 1

Artemis

Logs Database View

Data Collec1o n

GUI

Dryad Overview

Data collec1on Distributed system Plug‐ins GUI

Plug‐ins

Hun0ng for Bugs with Artemis

System Architecture

Conclusion s

slide-2
SLIDE 2

pptPlex Section Divider

Hunting for Bugs with Artemis

The slides after this divider will be grouped into a section and given the label you type above. Feel free to move this slide to any position in the deck.

slide-3
SLIDE 3

Hun0ng for Bugs with Artemis

Gabriela F. Creţu-Ciocârlie Mihai Budiu Moises Goldszmidt Microsoft Research, Silicon Valley WASL 2008

This presenta0on is built and should be viewed with pptPlex: hBp://www.officelabs.com/projects/pptPlex/Pages

slide-4
SLIDE 4

Artemis Goal One‐stop shop for performance analysis of distributed systems

slide-5
SLIDE 5

Principles

1) Modular: Separate generic from applica0on specific parts 2) Extensible: add new analyses via plug‐ins 3) Interac3ve: human expert part of the analysis loop

slide-6
SLIDE 6

pptPlex Section Divider

System Architecture

The slides after this divider will be grouped into a section and given the label you type above. Feel free to move this slide to any position in the deck.

slide-7
SLIDE 7

Logs Database View Data collec1on Distributed system Plug‐ins GUI

Distributed Local

slide-8
SLIDE 8

Logs Database View Data collec1on Distributed system Plug‐ins GUI

Applica0on‐ Specific Generic

slide-9
SLIDE 9

pptPlex Section Divider

Dryad Overview

The slides after this divider will be grouped into a section and given the label you type above. Feel free to move this slide to any position in the deck.

slide-10
SLIDE 10

grep sed sort awk perl grep grep sed sort sort awk

Input files Ver1ces Output files Channels Stage

Dryad Applica0on Structure

slide-11
SLIDE 11

Dryad System Architecture

data plane

job schedule

control plane

Serv Serv Serv V V V

Job manager cluster

slide-12
SLIDE 12

pptPlex Section Divider

Data Collection

The slides after this divider will be grouped into a section and given the label you type above. Feel free to move this slide to any position in the deck.

slide-13
SLIDE 13

Text Binary XML Perfmon Text Binary XML Perfmon Data Persisted data Copy Parse Filter Aggregate

DryadLINQ applica1on

10GB‐1TB 100MB‐1GB Text Binary XML Perfmon

slide-14
SLIDE 14

pptPlex Section Divider

GUI

The slides after this divider will be grouped into a section and given the label you type above. Feel free to move this slide to any position in the deck.

slide-15
SLIDE 15
slide-16
SLIDE 16
slide-17
SLIDE 17
slide-18
SLIDE 18
slide-19
SLIDE 19

pptPlex Section Divider

Plug-ins

The slides after this divider will be grouped into a section and given the label you type above. Feel free to move this slide to any position in the deck.

slide-20
SLIDE 20
slide-21
SLIDE 21

Machine U0liza0on Plug‐in

slide-22
SLIDE 22

Complex sta0s0cs: HiLighter plug‐in

22

Metrics

Binary search over logis0c regression with L1 regulariza0on

Key Performance Indicator

Correlated metrics

slide-23
SLIDE 23

Interac0ve Analysis

Feature Computa0on Visualiza0on Hilighter KPI Selec0on

slide-24
SLIDE 24

pptPlex Section Divider

Conclusions

The slides after this divider will be grouped into a section and given the label you type above. Feel free to move this slide to any position in the deck.

slide-25
SLIDE 25

Raw data Summariza0on Feature extrac0on Sta0s0cal analyses Automa0c diagnosis Distributed system Artemis today Goal

Conclusions