Evaluation of a Display for Airborne Separation in Safety-critical - - PowerPoint PPT Presentation

evaluation of a display for airborne separation in safety
SMART_READER_LITE
LIVE PREVIEW

Evaluation of a Display for Airborne Separation in Safety-critical - - PowerPoint PPT Presentation

Evaluation of a Display for Airborne Separation in Safety-critical Situations Marcus ARENIUS Human and Organisational Engineering & Systemic Design Heinrich-Plett-Str. 40, D-34132 University of Kassel Arenius et al, ICRAT 2014, 28.05.2014


slide-1
SLIDE 1

Evaluation of a Display for Airborne Separation in Safety-critical Situations

Arenius et al, ICRAT 2014, 28.05.2014

Marcus ARENIUS Human and Organisational Engineering & Systemic Design Heinrich-Plett-Str. 40, D-34132 University of Kassel

slide-2
SLIDE 2
  • Above spec. FL: Airborne - Separation

Pilots conduct separation (without ATC assistance) Find optimale flight route

Airborne separation

Arenius et al, ICRAT 2014, 28.05.2014 (Schneider, 2014) (Schneider, 2014)

slide-3
SLIDE 3

Perspective of the airline– Implications?

  • Effect of additional task on exisiting “task ecology“?
  • Avanced Training and Qualification Programm (ATQP)

„fly the aircraft first“ (CRM-Training)

Arenius et al, ICRAT 2014, 28.05.2014

Prepare pilots for new demands in task coordination (Training Curriculum) Maintaining adequate Situation Awareness in challenging situations?

slide-4
SLIDE 4

1.

Arenius et al, ICRAT 2014, 28.05.2014

Aim.

slide-5
SLIDE 5

Discern effect of the ATC-display on Situational Awareness in Safety-critical situations

Aim of Study

Arenius et al, ICRAT 2014, 28.05.2014

in Safety-critical situations Simulator study with ATC-Display Using Measurements of visual attention; Expert ratings (and others)

slide-6
SLIDE 6

2.

Arenius et al, ICRAT 2014, 28.05.2014

Theory.

slide-7
SLIDE 7

„the perception of the elements in the environment within a volume of time and space, the comprehension of their meaning and the projection of their status in the near future.

Situational Awareness

Arenius et al, ICRAT 2014, 28.05.2014

(Endsley & Garland, 2001, p. 5)

(Wickens, 2002)

slide-8
SLIDE 8
  • Tasks necessary for flying the aircraft
  • Six important variables

Rollers / Rolling Pitch Steering

Spatial Awareness

Arenius et al, ICRAT 2014, 28.05.2014

Yawing Flight level Lateral deviations from flight route Position on flight route Positioning in time & space

slide-9
SLIDE 9
  • Different technical systems and displays

Mainly monitoring Awareness of System

Systems Awareness

Arenius et al, ICRAT 2014, 28.05.2014

System paramenters Routine Unexpected situations Risk: Loss of Control

slide-10
SLIDE 10

A – Aviating N – Navigating

Priority

Task Awareness

Arenius et al, ICRAT 2014, 28.05.2014

N – Navigating C – Communications S – Systems Management

Flexibility

slide-11
SLIDE 11

Assessment System Decisions Performance Interface Process Indices Direct Indices Behaviour and Performance Indices

Measuring SA

Arenius et al, ICRAT 2014, 28.05.2014

Processes Awareness Decisions Performance System Eye-Tracking Evasion option Ratings

(ad. fr. Endsley & Garland, 2001, p. xi)

slide-12
SLIDE 12

3.

Arenius et al, ICRAT 2014, 28.05.2014

The ATC display.

slide-13
SLIDE 13
  • Defined warning volume around the aircraft (preventive):
  • Vector-based conflict detection:
  • Minimize devitions of flight route:

Requirements & Functioning

Arenius et al, ICRAT 2014, 28.05.2014 (Schneider, 2014) (Schneider, 2014)

slide-14
SLIDE 14

Implementation

  • Iterative development based on pilot feedback
  • Fitted to “look-and-feel” Boeing 737 (radar)
  • Radar-based view (horizontal sep.)
  • Elevation profile (vertical sep.)

Arenius et al, ICRAT 2014, 28.05.2014

  • Display of conflict / avoidance options

(Schneider, 2014)

slide-15
SLIDE 15

Layout

Arenius et al, ICRAT 2014, 28.05.2014 (Schneider, 2014)

slide-16
SLIDE 16

4.

Arenius et al, ICRAT 2014, 28.05.2014

Scenario & Participants.

slide-17
SLIDE 17
  • Flight Athens - Heraklion
  • 10 commerical pilots
  • Flight Szenario (3 min)
  • Boeing 737-800 simulator

Scenario & Participants.

Arenius et al, ICRAT 2014, 28.05.2014

  • Rated by Check-Pilot
  • Eye-tracking (PF)
slide-18
SLIDE 18

Traffic Warning Single Engine Failure

Scenario

Arenius et al, ICRAT 2014, 28.05.2014

slide-19
SLIDE 19

AirCrt137 HDG 130° FL360 Arenius et al, ICRAT 2014, 28.05.201419

slide-20
SLIDE 20

5.

Arenius et al, ICRAT 2014, 28.05.2014

Results.

slide-21
SLIDE 21

P8 P9 P10 P11 ipant

Delay in noticing the Engine Failure

Noticing of the Engine Failure

Arenius et al, ICRAT 2014, 28.05.2014

5 10 15 P1 P3 P4 P5 P6 P7 Delay in [sec] Particip

slide-22
SLIDE 22
  • Significant Correlations (α = 0,05; n = 10), two-tailed t-Test:

Variable A Variable B Correlation coeff. Fixation Duration ATC-Display Performance Rating

  • 0,75

Noticing Engine Failure Performance Rating

  • 0,65

Results

Arenius et al, ICRAT 2014, 28.05.2014

  • Non-significant Correlations:

Variable A Variable B Correlation coeff. ET strategy Performance rating

  • 0,17
slide-23
SLIDE 23
  • Comparison P4 (high rating) - P8 (low rating):

Fixation Duration (Cumulative)

Arenius et al, ICRAT 2014, 28.05.2014

slide-24
SLIDE 24
  • Detrimental Effect on Situational Awareness

− High delays in noticing EF associated with decreases in performance ranking (Systems Awareness) − High fixation times on ATC-display associated with decreases in

Discussion

Arenius et al, ICRAT 2014, 28.05.2014

performance ranking (Systems Awareness) − „Bank Angle“-Warnings (>30°; „out-of-the-loop“)

  • Positioning ATC-Display

− Vicinity of PFD,E/WD und NAV − Issue: Blending/Overlapping of tasks

  • Further research
slide-25
SLIDE 25

6.

Arenius et al, ICRAT 2014, 28.05.2014

The big picture. (VA)

slide-26
SLIDE 26

What are they doing? Gaze strategies & Coping

Arenius et al, ICRAT 2014, 28.05.2014

Different strategies

  • Triangulation (ET/expert ratings)
  • Visual inspection
  • […]

Psychological coping mechanisms (Sträter, 2005)

  • Fixation ATC-display (P 8)
  • Goal Elaboration (P 4 PFD) ->Fixation
  • > Define human tasks/functions
slide-27
SLIDE 27

What are they doing? Global NMDS Representation

Correlations of AoI

  • Distance preserving

Arenius et al, ICRAT 2014, 28.05.2014

  • Distance preserving
  • riginal ordinal scale
  • Reflecting visual focus
  • ver time period

Disregards dynamics of behavior!

slide-28
SLIDE 28

F1/S1 F2/S2 F3/S3

Zooming in: ET-Dynamics, Coping and Functions

Functions & coping strategies:

Arenius et al, ICRAT 2014, 28.05.2014 Indentified functions & coping strategies

strategies:

  • Best time?
  • Best player?

Aggregated evaluation Fit Strat. <-> Techn. HMI-Function allocation

slide-29
SLIDE 29

Performance Shaping Factor Quantity Distraction 45 Irregularities 44 Work experience on job 22 Cooperation 9

Task

Adaptive Cognitive System

Action Task

Technic

Outcome

Feedback techn. system Feedback on activity level

Which factors should be evaluated? (HRA & HF)

Arenius et al, ICRAT 2014, 28.05.2014

Cooperation 9 Stress 7 Time-pressure 5 Authority 5

Cognitive Couplings Cognitive Processing Loop Task type and demand Experience-driven, iterative determination of goals and actions

Resilience

nical system

Outcome

Contextual Conditions (Psf-> mod. HEP)

  • Queries in event databases for specific scenarios
  • Translate psf into multifactorial designs
slide-30
SLIDE 30
  • Integration of ET-data
  • Analysis of Dynamics (Aviation, Medicine, Control rooms, …)
  • Associated coping strategies ->Functions
  • Linking to HRA data

− Database (~500 events, ~100 aviation)

Further steps

Arenius et al, ICRAT 2014, 28.05.2014

Database (~500 events, ~100 aviation) − Coping strategies − Demands, Coping Strategies & Psf − Design of (complex) HF studies

slide-31
SLIDE 31

Arenius et al, ICRAT 2014, 28.05.2014

Contact information Marcus Arenius arenius@ifa.uni-kassel.de

slide-32
SLIDE 32

− Endsley, M. R., & Garland, D. J. (Eds.). (2001). Situation Awareness

Analysis and Measurement. Atlanta, GA: CRC Press.

− Schneider, M. (2014). Entwicklung eines Zusatzinformationssystems für

Piloten und dessen Untersuchung hinsichtlich Auswirkungen auf das Verhalten von Piloten in kritischen Flugsituationen [Development and Evaluation of a Display for Airborne Separation] (Master Thesis).

Literature

Arenius et al, ICRAT 2014, 28.05.2014

Evaluation of a Display for Airborne Separation] (Master Thesis). University of Kassel, Department of Human and Organisational Engineering & Systemic Design, Kassel.

− Sträter, O. (2005). Cognition and safety: an integrated approach to systems

design and assessment. Aldershot: Ashgate Publishing, Ltd.

− Wickens, C. D. (2002). Situation Awareness and Workload in Aviation.

Current Directions in Psychological Science, 11(4), 128–133.