IS YOUR TEAM INSTRUMENT RATED? (OR DEPLOYING 89,000 TIMES A - - PowerPoint PPT Presentation

is your team instrument rated
SMART_READER_LITE
LIVE PREVIEW

IS YOUR TEAM INSTRUMENT RATED? (OR DEPLOYING 89,000 TIMES A - - PowerPoint PPT Presentation

IS YOUR TEAM INSTRUMENT RATED? (OR DEPLOYING 89,000 TIMES A DAY) J. Paul Reed Principal Consultant Friday, May 9, 14 J. P AUL R EED Fifteen years as a build/release engineer Sober Build Engineer @SoberBuildEng Friday, May


slide-1
SLIDE 1

IS YOUR TEAM INSTRUMENT RATED?

(OR DEPLOYING 89,000 TIMES A DAY)

  • J. Paul Reed

Principal Consultant

Friday, May 9, 14

slide-2
SLIDE 2
  • J. PAUL REED
  • Fifteen years as a build/release engineer
  • “Sober Build Engineer”
  • @SoberBuildEng

Friday, May 9, 14

slide-3
SLIDE 3

AVAILABLE ON ITUNES!

www.theshipshow.com @ShipShowPodcast

@eciramella @buildscientist @cheeseplus @sascha_d

Friday, May 9, 14

slide-4
SLIDE 4

IN PREPARATION FOR OUR FLIGHT...

Friday, May 9, 14

slide-5
SLIDE 5

“CULTURE?”

Set of shared mental assumptions that guide interpretation and action in organizations by defining appropriate behavior for various situations.

– Ravisi & Schultz, via Wikipedia

(via Damon’s talk)

Friday, May 9, 14

slide-6
SLIDE 6

“CULTURE” FOR TODAY Incentives + Human Factors

Friday, May 9, 14

slide-7
SLIDE 7

“CULTURE” FOR TODAY Incentives + Human Factors

(organizational, behavioral, and economic) (methods for facilitating and fostering those incentives)

Friday, May 9, 14

slide-8
SLIDE 8

WHY AVIATION?

Craft Provided unique requirements, individuals perfecting their own methods & techniques Trade Groups of “craftspeople” sharing domain knowledge Science Processes consistently repeatable by others, under different environments/conditions Industry Reduce/combine processes to

  • ptimize for specific business

requirements or outcomes

“ P r

  • g

r e s s ”

Friday, May 9, 14

slide-9
SLIDE 9

WHY AVIATION?

Friday, May 9, 14

slide-10
SLIDE 10

WHY AVIATION?

But... when we’re talking incident response, the house is already on fire

Friday, May 9, 14

slide-11
SLIDE 11

WHY AVIATION? Dev Ops

Friday, May 9, 14

slide-12
SLIDE 12

WHY AVIATION? Dev Ops

Friday, May 9, 14

slide-13
SLIDE 13

WHY AVIATION?

Scale much?

Friday, May 9, 14

slide-14
SLIDE 14

VISUAL FLIGHT RULES

Friday, May 9, 14

slide-15
SLIDE 15

VISUAL FLIGHT RULES

Friday, May 9, 14

slide-16
SLIDE 16

VISUAL FLIGHT RULES

Friday, May 9, 14

slide-17
SLIDE 17

INSTRUMENT FLIGHT RULES

Friday, May 9, 14

slide-18
SLIDE 18

INSTRUMENT FLIGHT RULES

Friday, May 9, 14

slide-19
SLIDE 19

INSTRUMENT FLIGHT RULES

Friday, May 9, 14

slide-20
SLIDE 20

Friday, May 9, 14

slide-21
SLIDE 21
  • Standardization
  • Communication
  • Expectations
  • Remediation

WHAT IT IS

Friday, May 9, 14

slide-22
SLIDE 22

STANDARDIZATION

A set of

  • perational

primitives based

  • n your
  • rganizational

and business requirements.

Friday, May 9, 14

slide-23
SLIDE 23

STANDARDIZATION

Leveraged to define your

  • perational

procedures.

Friday, May 9, 14

slide-24
SLIDE 24

STANDARDIZATION

Leveraged to define

  • perational

procedures. Leveraged to define your

  • perational

procedures.

Friday, May 9, 14

slide-25
SLIDE 25
  • Standardization
  • Communication
  • Expectations
  • Remediation

WHAT IT IS

Friday, May 9, 14

slide-26
SLIDE 26

COMMUNICATION

“We're cleared to New York's JFK Airport via the SAN FRANCISCO EIGHT, radar vectors to Linden, direct JSICA, direct Wilson Creek, Jet 80, Kansas City, Jet 24, Saint Louis, direct Brickyard, direct Rosewood, Jet 29, Jamestown, Jet 70, Wilkes Barre, to the LENDY FIVE arrival into JFK; climb and maintain fifteen, one-five-thousand; expect three- five-zero in ten; squawk six-three-seven-seven.”

– Redwood Flight 34’s Inaugural Clearance

Friday, May 9, 14

slide-27
SLIDE 27

COMMUNICATION

SFO SFO8 LIN JSICA ILC J80 MCI J24 STL VHP ROD J29 JMS J70 LVZ LENDY5

– Redwood Flight 34’s Inaugural Clearance

Friday, May 9, 14

slide-28
SLIDE 28

COMMUNICATION

In other words, trying to avoid this...

Friday, May 9, 14

slide-29
SLIDE 29
  • Hesitance to use appropriate terms to communicate the

situation

  • A transcontinental Boeing 707 arrives low on fuel & to bad

weather; pilots do not use the single phrase necessary–“we’re declaring an emergency”–which would have activated emergency services (Avianca Flight 52)

  • Misuse of defined terminology
  • In 1995, a controller clears a 757 “directly” to the airport,

setting off an accident chain (American Airlines Flight 965)

COMMUNICATION

Friday, May 9, 14

slide-30
SLIDE 30
  • Standardization
  • Communication
  • Expectations
  • Remediation

WHAT IT IS

Friday, May 9, 14

slide-31
SLIDE 31

EXPECTATIONS

Once standards are established and requirements/ intentions communicated, expectations and responsibilities can be derived.

Friday, May 9, 14

slide-32
SLIDE 32
  • Standardization
  • Communication
  • Expectations
  • Remediation

WHAT IT IS

Friday, May 9, 14

slide-33
SLIDE 33

WHAT IT IS

With expectations and responsibilities clarified, remediation processes can be integrated into processes & automation, not tacked

  • n or “invented on the fly.”

Friday, May 9, 14

slide-34
SLIDE 34
  • Static
  • Blind reliance on automation, tooling, or process
  • “Fun-Verboten”

WHAT IT IS NOT

Friday, May 9, 14

slide-35
SLIDE 35

NOT STATIC

Friday, May 9, 14

slide-36
SLIDE 36

Friday, May 9, 14

slide-37
SLIDE 37
  • Static
  • Blind reliance on automation, tooling, or process
  • “Fun-Verboten”

WHAT IT IS NOT

Friday, May 9, 14

slide-38
SLIDE 38

NOT AUTOMATION?!

Friday, May 9, 14

slide-39
SLIDE 39
  • Misreading/looking at the wrong metrics
  • A 737 suffers an engine “disturbance”; after not looking at all

the appropriate instruments, pilots shut down the good engine; the remaining (bad) engine eventually fails fully (British Midlands Flight 92)

  • Partial automation failure and resulting confusion
  • After a series of instrument failures in the highly-automated

A-330, the junior pilot pulls the plane into a prolonged stall (Air France 447)

NOT AUTOMATION?!

Friday, May 9, 14

slide-40
SLIDE 40

NOT AUTOMATION?!

Friday, May 9, 14

slide-41
SLIDE 41
  • Static
  • Blind reliance on automation, tooling, or process
  • “Fun-Verboten”

WHAT IT IS NOT

Friday, May 9, 14

slide-42
SLIDE 42

NOT “FUN VERBOTEN”

Friday, May 9, 14

slide-43
SLIDE 43

NOT “FUN VERBOTEN”

Friday, May 9, 14

slide-44
SLIDE 44
  • Define organizational vocabulary & process primitives
  • Formalize roles, responsibilities, and priorities
  • Understand (current) limitations
  • Investigate outcomes

GETTING “INSTRUMENT RATED”

Friday, May 9, 14

slide-45
SLIDE 45

DEFINE YOUR APPROACHES

  • Define what you do today,

focusing on the “operational requirements”

  • Derive (or define)

primitives

  • Define your operational

dictionary

  • Make sure they’re owned!

Friday, May 9, 14

slide-46
SLIDE 46
  • Define organizational vocabulary & process primitives
  • Formalize roles, responsibilities, and priorities
  • Understand (current) limitations
  • Investigate outcomes

GETTING RATED

Friday, May 9, 14

slide-47
SLIDE 47

FORMALIZE “2R+P”

  • Be able to answer “Who is responsible for that?”
  • Drill/train or delegate
  • Determine “priority classes”

Friday, May 9, 14

slide-48
SLIDE 48
  • Define organizational vocabulary & process primitives
  • Formalize roles, responsibilities, and priorities
  • Understand (current) limitations
  • Investigate outcomes

GETTING RATED

Friday, May 9, 14

slide-49
SLIDE 49

LINE UP AND WAIT

For organizational change to even be a possibility, the current limitations need to be internalized.

Friday, May 9, 14

slide-50
SLIDE 50

KNOW WHEN TO HOLD ‘EM

Friday, May 9, 14

slide-51
SLIDE 51
  • Define organizational vocabulary & process primitives
  • Formalize roles & responsibilities
  • Understand (current) limitations
  • Investigate outcomes

GETTING RATED

Friday, May 9, 14

slide-52
SLIDE 52

“OOPS” WILL HAPPEN

Friday, May 9, 14

slide-53
SLIDE 53
  • NASA Aviation Safety Reporting System
  • Separation of investigation roles
  • National Transportation Safety Board
  • “No Blame” postmortems
  • (Though not for the reason you might think!)

AFTER THE “OOPS”

Friday, May 9, 14

slide-54
SLIDE 54

OPERATIONAL MODELS Incentives + Human Factors

Friday, May 9, 14

slide-55
SLIDE 55
  • J. Paul Reed

www.soberbuildengineer.com @SoberBuildEng

www.releng-approaches.com Simply Ship. Every Time.

Friday, May 9, 14