Chaos: The Last Stand Against Our Robot Overlords Nathan - - PowerPoint PPT Presentation

chaos
SMART_READER_LITE
LIVE PREVIEW

Chaos: The Last Stand Against Our Robot Overlords Nathan - - PowerPoint PPT Presentation

Chaos: The Last Stand Against Our Robot Overlords Nathan schbacher @ gen_nja Freezing Robot Problem: Once the environment surpasses a certain level of dynamic complexity, the path planner decides that all forward paths are unsafe. 01101


slide-1
SLIDE 1

Chaos:

The Last Stand Against Our Robot Overlords

Nathan Äschbacher

@gen_nja

slide-2
SLIDE 2

Freezing Robot Problem: Once the environment surpasses a certain level of dynamic complexity, the path planner decides that all forward paths are unsafe.

slide-3
SLIDE 3
slide-4
SLIDE 4
slide-5
SLIDE 5
slide-6
SLIDE 6
slide-7
SLIDE 7
slide-8
SLIDE 8

01101 26262

slide-9
SLIDE 9

When are the models done?

01101

slide-10
SLIDE 10

Eleventy-Bazillion

Miles

slide-11
SLIDE 11

How do you know the software is safe?

01101

slide-12
SLIDE 12

¯\_(ツ)_/¯

slide-13
SLIDE 13

How do you know the software is safe?

26262

slide-14
SLIDE 14

MISRA

slide-15
SLIDE 15

HARD

realtime

slide-16
SLIDE 16

26262

slide-17
SLIDE 17
slide-18
SLIDE 18

But the AI isn’t deterministic, so…?

26262

slide-19
SLIDE 19

¯\_(ツ)_/¯

slide-20
SLIDE 20

ಠ_ಠ

slide-21
SLIDE 21

26262 01101

slide-22
SLIDE 22 Formal Methods Model Checking Deductive Verification Local Testing Property-Based Fuzz Unit / Acceptance Implementation Integration Testing Chaos Mutation
slide-23
SLIDE 23

It’s not all about introducing chaos to the

  • system. It’s about the chaos inherent in the

system itself. Chaos Engineering is about engineering practices that help us surface those systemic effects.

  • - Casey Rosenthal
Traffic & Chaos Manager

Netflix

“ ”

slide-24
SLIDE 24

Control Decision Perception

slide-25
SLIDE 25
slide-26
SLIDE 26
slide-27
SLIDE 27

ಥ_ಥ

slide-28
SLIDE 28

+

slide-29
SLIDE 29
slide-30
SLIDE 30
slide-31
SLIDE 31
slide-32
SLIDE 32

  • - Principles of Chaos

“ ”

Chaos strongly prefers to experiment directly

  • n production traffic.
  • - Chaos Engineering

the Book

“ We don’t expect engineers to inject noise into

the sensors of self-driving cars containing unsuspecting passengers!

slide-33
SLIDE 33

“ ”

  • - Chaos Engineering

the Book However, we suspect most users are not working on these kinds of safety-critical systems.

slide-34
SLIDE 34
slide-35
SLIDE 35
slide-36
SLIDE 36
slide-37
SLIDE 37
slide-38
SLIDE 38

Over-Engineering

slide-39
SLIDE 39 Unit

Software FEA ?

Chaos

Integration Property-Based Formal Methods Fuzz

slide-40
SLIDE 40

Good ol’ Engineering

slide-41
SLIDE 41
slide-42
SLIDE 42
slide-43
SLIDE 43