FROM RETROSPECTIVE TO CONTINUOUS DEEP ANALYTICS Seif Haridi KTH - - PowerPoint PPT Presentation

from retrospective to continuous deep analytics
SMART_READER_LITE
LIVE PREVIEW

FROM RETROSPECTIVE TO CONTINUOUS DEEP ANALYTICS Seif Haridi KTH - - PowerPoint PPT Presentation

FROM RETROSPECTIVE TO CONTINUOUS DEEP ANALYTICS Seif Haridi KTH SICS Why most Data Analysis today is Retrospective From OLAP Databases Data Cube LOCATION TIME To Deep Analysis on Batches Past Data Sets Map Map Map Map Map Map


slide-1
SLIDE 1

FROM RETROSPECTIVE TO CONTINUOUS DEEP ANALYTICS

Seif Haridi KTH ‐ SICS

slide-2
SLIDE 2

Why most Data Analysis today is Retrospective

slide-3
SLIDE 3

From OLAP Databases

TIME LOCATION Data Cube

slide-4
SLIDE 4

To Deep Analysis on Batches

Map Reduce Map Reduce Map Reduce Map Reduce Map Reduce Map Reduce

Past Data Sets Past Models

slide-5
SLIDE 5

And Machine Learning Pipelines

Yesterday’s Dataset Feature Extraction Model Training

slide-6
SLIDE 6

Today’s Retrospective Data Processing

STORE LOAD PROCESS STORE Data Knowledge

slide-7
SLIDE 7

Today’s Retrospective Data Processing Takes Long to Extract Knowledge

Data Knowledge time

slide-8
SLIDE 8

Models and patterns on older data are often irrelevant today

personalized ad winter jacket discount!

slide-9
SLIDE 9

Critical Decisions demand Continuous Analysis

slide-10
SLIDE 10

We propose a continuous processing architecture

STORE LOAD PROCESS STORE time Data Knowledge

slide-11
SLIDE 11

PROCESS

We propose a continuous processing architecture

time Data Knowledge

slide-12
SLIDE 12

PROCESS

We propose a deep processing architecture

arbitrarily iterative computation

slide-13
SLIDE 13

PROCESS TPUs

We propose a fast processing architecture

slide-14
SLIDE 14

for Dynamic Graph analysis

virus outbreaks social network trends

slide-15
SLIDE 15

for Online Machine Learning

feature learning tensor programming

slide-16
SLIDE 16

and Relational Data Streaming

dynamic tables

σθ σθ σθ σθ π π

slide-17
SLIDE 17

Unified and Optimised

  • n a Common Representation

Intermediate Representation Dynamic Graphs Online ML Relational Streams

slide-18
SLIDE 18

A Runtime Designed for Continuous Deep Analysis

Distributed Runtime Intermediate Representation

metrics config constraints

Self‐Reconfiguration

slide-19
SLIDE 19

A Full Stack for Continuous Deep Analytics

Intermediate Representation Dynamic Graphs Online ML Relational Streams Distributed Runtime

metrics config constraints

Interpretable, Online Models of the world