Eyes are never quiet Towards Eye Tracking as a Practical Training - - PowerPoint PPT Presentation

▶

Dec 26, 2022 206 likes •516 views

Eyes are never quiet Towards Eye Tracking as a Practical Training Tool IASS 2018 Capt. Mark Cameron, HF Specialist - Emirates November 12-14 Pat Nolan, GM Aviation - Seeing Machines Seattle, USA After Dublin IASS 2017 A330 APT to A380 &

SLIDE 1

Eyes are never quiet

Towards Eye Tracking as a Practical Training Tool

Capt. Mark Cameron, HF Specialist - Emirates

Pat Nolan, GM Aviation - Seeing Machines IASS 2018 November 12-14 Seattle, USA

SLIDE 2

After Dublin IASS 2017

SLIDE 3

A330 APT to A380 & B737 FFS

SLIDE 4

At the critical moment… wouldn’t you like to know what

these pilots were scanning?

SLIDE 5

FLT DIR

ILS

BARO

460

HL7742 San Francisco 2013

“Checked” “On glide path sir”

NTSB/AAR-14/01, p 179

SLIDE 6

EC-HFP Madrid 2008

FLAPS SLATS

UP 5 11 20 15 24 28 40

QTY

QTS

“Flaps 11”

CIAIAC Report A-032/2008, p 166

SLIDE 7

G-WNSB Sumburgh 2013

“Just watch your airspeed now” “Oh yeah”

UKAAIB Report 1/2016, p 212

SLIDE 8

These all happened here first

SLIDE 9

Technology / innovation
How to move from 'interesting' to ‘useful'
How to make data easy to consume

From Academic Curiosity to Product

SLIDE 10

The right data at the right time

SLIDE 11

A380 FFS Scenario Construction:

SLIDE 12

Profiles for Proof of Concept

Visual Circuit CM1 & CM2
Engine failure V1-10kts
Home base STAR with three sub-events:

– No Altitude Capture 8000 ft. – ATC vector through localizer – Wind shift below 200’ agl – potential long landing.

SLIDE 13

MASTER WARN MASTER CAUT MASTER CAUT

ENG 1 FAIL ☐ AUTO RELIGHT IN PROGRESS

THR LEVER 1. . . . . . . . . . . . . . . . . . . . . . . . IDLE

.IF NO ENG RELIGHT AFTER 30 S ☐ CONFIRM NO ENG RELIGHT

ENG 1 MASTER . . . . . . . . . . . . . . . . . . .

.IF ENG 1 DAMAGED : ☐ CONFIRM ENG 1 DAMAGED .IF ENG 1 NOT DAMAGED : ☐ CONFIRM ENG 1 NOT DAMAGED ☐ ☐ ON DISCH OFF PUSH ENG 1 FIRE P/B . . . . . . . . . . . . . . . . . . APU BLEED : DO NOT USE AGENT 1 AFTER 10 S . . . . . . . . . . . . . EMER OUTER TK XFR . . . . . . . . . . . .. . . EXPECT FEED TKs IMBALANCE FUEL MAN BALANCING PROC . . .

CONSIDER

ENG RELIGHT PROC. . . . . . . . . .

CONSIDER

CLEAR ☐ ☐ ☐

SLIDE 14

(Courtesy of the schedulers)

Random Line Crew Selection

SLIDE 15

Data Gathering

SLIDE 16

Analysis

SLIDE 17

Approach Analysis

VUTEB GITBO ULASO VELAR SEDPO GIRGO

[ATC: Descend Altitude 6000ft.] [ATC: Turn Right Heading 210°] [ATC: Maintain Heading 210°] [Rad Alt 200ft.]

SLIDE 18

A380 FFS, Results - real time

SLIDE 19

Results – Regions of Interest

SLIDE 20

Results – ‘Candybar’ examples

SLIDE 21

A380 Landing, Focus – end of runway

SLIDE 22

A380 Low Visibility Operations

SLIDE 23

B737 HGS (HUD) Proof of Concept

SLIDE 24

Product Integration

EYE TRACKING AUDIO CAPTURE SOQA

SLIDE 25

Debriefing Tool, Attention Classifier

Macro (Cockpit) Micro (PFD or HUD)

SLIDE 26

Where is this going?

Corrective training
SOP Compliance
Testing of procedural change
Measuring and defining “Competent”…
…therefore getting live ‘gap analysis’ of trainee to

“competent”.

EBT data – trend analysis, making training more

efficient.

SLIDE 27

“Low hanging fruit”

Sequence Focus / Scenario Detail SOP or Technique 1a. FMA Mode Change SOP 1b. FMA ‘Checked’ SOP 2. Configuration Flaps, Gear, SPD BRK SOP 3a. Inside / Outside PF / PM, less than 200’ Technique 3b. Flare – TDZ or EoR PF / PM, less than 100’ Technique 4. Autoland PM, less than 200’ Technique - PM 5. Go Around G/A Sequence SOP 6. Take Off T/O Sequence SOP 7. Stabilisation SOP Criteria, FL, Speed, Config SOP 8. Taxi Navigation PF / PM Onboard Nav System Technique 9. Flight Director FD Fixation Technique

SLIDE 28

The future… Simulator ‘hot’ debriefing tool

FLAP OUT Conf FMA FD V/S SPD RA ALT THR +rate FMA Conf Gear FLAP +rate FMA Conf Gear

Baseline Trainees

SLIDE 29