Eyes are never quiet Towards Eye Tracking as a Practical Training - PowerPoint PPT Presentation

Eyes are never quiet Towards Eye Tracking as a Practical Training Tool IASS 2018 Capt. Mark Cameron, HF Specialist - Emirates November 12-14 Pat Nolan, GM Aviation - Seeing Machines Seattle, USA

After Dublin IASS 2017

A330 APT to A380 & B737 FFS

At the critical moment… wouldn’t you like to know what these pilots were scanning?

HL7742 San Francisco 2013 “On glide FLT DIR ILS path sir” BARO 4 60 “Checked” NTSB/AAR-14/01, p 179

EC-HFP Madrid 2008 QTY QTS “Flaps 11” FLAPS SLATS UP 5 11 15 20 24 28 40 CIAIAC Report A-032/2008, p 166

G-WNSB Sumburgh 2013 “Just watch your airspeed now” “Oh yeah” UKAAIB Report 1/2016, p 212

These all happened here first

From Academic Curiosity to Product • Technology / innovation • How to move from 'interesting' to ‘useful' • How to make data easy to consume

The right data at the right time

A380 FFS Scenario Construction:

Profiles for Proof of Concept • Visual Circuit CM1 & CM2 • Engine failure V 1 -10kts • Home base STAR with three sub-events: – No Altitude Capture 8000 ft. – ATC vector through localizer – Wind shift below 200’ agl – potential long landing.

MASTER MASTER MASTER WARN CAUT CAUT ENG 1 FAIL ☐ AUTO RELIGHT IN PROGRESS - THR LEVER 1. . . . . . . . . . . . . . . . . . . . . . . . IDLE .IF NO ENG RELIGHT AFTER 30 S ☐ CONFIRM NO ENG RELIGHT - ENG 1 MASTER . . . . . . . . . . . . . . . . . . . OFF .IF ENG 1 DAMAGED : ☐ CONFIRM ENG 1 DAMAGED - ENG 1 FIRE P/B . . . . . . . . . . . . . . . . . . PUSH ☐ APU BLEED : DO NOT USE - AGENT 1 AFTER 10 S . . . . . . . . . . . . . DISCH - EMER OUTER TK XFR . . . . . . . . . . . .. . . ON ☐ EXPECT FEED TKs IMBALANCE ☐ FUEL MAN BALANCING PROC . . . CONSIDER .IF ENG 1 NOT DAMAGED : ☐ CONFIRM ENG 1 NOT DAMAGED - ☐ ENG RELIGHT PROC. . . . . . . . . . CONSIDER ☐ CLEAR

Random Line Crew Selection (Courtesy of the schedulers)

Data Gathering

Analysis

Approach Analysis VUTEB GITBO [ATC: Descend Altitude 6000ft.] ULASO GIRGO [ATC: Turn Right Heading 210°] SEDPO [Rad Alt 200ft.] VELAR [ATC: Maintain Heading 210°]

A380 FFS, Results - real time

Results – Regions of Interest

Results – ‘Candybar’ examples

A380 Landing, Focus – end of runway

A380 Low Visibility Operations

B737 HGS (HUD) Proof of Concept

Product Integration EYE AUDIO TRACKING CAPTURE SOQA

Debriefing Tool, Attention Classifier Macro (Cockpit) Micro (PFD or HUD)

Where is this going? • Corrective training • SOP Compliance • Testing of procedural change • Measuring and defining “Competent”… • …therefore getting live ‘gap analysis’ of trainee to “competent”. • EBT data – trend analysis, making training more efficient.

“Low hanging fruit” Sequence Focus / Scenario Detail SOP or Technique 1a. FMA Mode Change SOP 1b. FMA ‘Checked’ SOP 2. Configuration Flaps, Gear, SPD BRK SOP 3a. Inside / Outside PF / PM, less than 200’ Technique 3b. Flare – TDZ or EoR PF / PM, less than 100’ Technique 4. Autoland PM, less than 200’ Technique - PM 5. Go Around G/A Sequence SOP 6. Take Off T/O Sequence SOP 7. Stabilisation SOP Criteria, FL, Speed, Config SOP 8. Taxi Navigation PF / PM Onboard Nav System Technique 9. Flight Director FD Fixation Technique

The future… Simulator ‘hot’ debriefing tool THR V/S SPD RA ALT OUT Conf FMA FD FLAP Conf FMA +rate Gear Baseline Gear FLAP +rate Conf FMA Trainees

Thank you!