Deep Learning on the mobile edge Georg Eickelpasch advised by - - PowerPoint PPT Presentation

deep learning on the mobile edge
SMART_READER_LITE
LIVE PREVIEW

Deep Learning on the mobile edge Georg Eickelpasch advised by - - PowerPoint PPT Presentation

Chair of Network Architectures and Services Department of Informatics Technical University of Munich Deep Learning on the mobile edge Georg Eickelpasch advised by Marton Kajo Thursday 10 th October, 2019 Chair of Network Architectures and


slide-1
SLIDE 1

Chair of Network Architectures and Services Department of Informatics Technical University of Munich

Deep Learning on the mobile edge

Georg Eickelpasch

advised by Marton Kajo Thursday 10th October, 2019 Chair of Network Architectures and Services Department of Informatics Technical University of Munich

slide-2
SLIDE 2

Structure

  • Introduction
  • Use cases
  • Scheduling strategies
  • G. Eickelpasch — DL on the edge

2

slide-3
SLIDE 3

Introduction

Problem of mobile Deep Learning

  • Offloading to cloud
  • Bottleneck bandwidth
  • Unstable mobile connection
  • Compute on device
  • Compute using the edge
  • G. Eickelpasch — DL on the edge

3

slide-4
SLIDE 4

Introduction

Terminology of Edge

  • 1. Edge as mobile device -> offload from
  • 2. Edge as local server -> offload to

Possible layers in an edge system

  • G. Eickelpasch — DL on the edge

4

slide-5
SLIDE 5

Use cases

Speech

  • Speech recognition
  • Natural Language Processing
  • Real-time processing
  • Robustness
  • Complex Data
  • G. Eickelpasch — DL on the edge

5

slide-6
SLIDE 6

Use cases

Computer Vision

  • Object identification
  • Continuous Vision
  • Real-time processing
  • Mobile context
  • Large files
  • G. Eickelpasch — DL on the edge

6

slide-7
SLIDE 7

Use cases

E-Health

  • Health Tracking
  • Diseas identification
  • Highly sensitive data
  • Requiered robustness
  • Heterogeneous data
  • G. Eickelpasch — DL on the edge

7

slide-8
SLIDE 8

Scheduling

Preprocessing Strategy Simplified overview for NeuroSurgeon algorithm

  • G. Eickelpasch — DL on the edge

8

slide-9
SLIDE 9

Scheduling

Preprocessing Strategy

  • G. Eickelpasch — DL on the edge

9

slide-10
SLIDE 10

Scheduling

Deadline Strategy Simplified overview for Edgent algorithm

  • G. Eickelpasch — DL on the edge

10

slide-11
SLIDE 11

Scheduling

Deadline Strategy

  • G. Eickelpasch — DL on the edge

11

slide-12
SLIDE 12

Conclusion

  • NeuroSurgeon
  • only optimization
  • weak edge
  • Edgent
  • best result in given time
  • strong edge
  • G. Eickelpasch — DL on the edge

12

slide-13
SLIDE 13

Future work

  • Optimization of Edgent with NeuroSurgeon approach Preprocessing on the device as well

as early exit

  • G. Eickelpasch — DL on the edge

13

slide-14
SLIDE 14

Discussion questions

  • Do you think Edge Computing will be the dominant solution in the future?
  • G. Eickelpasch — DL on the edge

14