Cognitive Workload and Visual Attention Analyses of the Air Traffic - - PowerPoint PPT Presentation

▶
cognitive workload and visual attention
SMART_READER_LITE
LIVE PREVIEW

Cognitive Workload and Visual Attention Analyses of the Air Traffic - - PowerPoint PPT Presentation

Nov 09, 2023 173 likes •446 views

Cognitive Workload and Visual Attention Analyses of the Air Traffic Control Tower Flight Data Manager (TFDM) Prototype Demonstration* Kiran Lokhande & Hayley J. Davison Reynolds MIT Lincoln Laboratory HFES 56 th Annual Meeting 26 October,

slide-1
SLIDE 1

Vis Attn & Cog Workload1 Lokhande/Reynolds 10/1/2012

MIT Lincoln Laboratory

Cognitive Workload and Visual Attention Analyses of the Air Traffic Control Tower Flight Data Manager (TFDM) Prototype Demonstration*

Kiran Lokhande & Hayley J. Davison Reynolds MIT Lincoln Laboratory HFES 56th Annual Meeting 26 October, 2012

*This work was sponsored by the Federal Aviation Administration under Air Force Contract No. FA8721-05-C-0002. Opinions, interpretations, conclusions, and recommendations are those of the authors and are not necessarily endorsed by the United States Government.

slide-2
SLIDE 2

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-2 Lokhande/Reynolds 10/1/2012

Motivation

  • Multiple display technologies currently

used at major US airports:

– Paper flight strips – ASDE-X (Airport Surface Detection Equipment, Model X) – RACD (Remote Arts Control Display) – IDS (Integrated Display System) – etc.

  • Desired from NextGen ATC tower:

– System integration – Increased efficiency

Decision support tools Automation

– Safety & cost reduction

ASDE-X Display RACD Display

slide-3
SLIDE 3

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-3 Lokhande/Reynolds 10/1/2012

Tower Flight Data Manager Prototype

Message broker

Airline Operation Centers Other ATC Facilities Airport Authority

External Stakeholders Surveillance & Data Fusion Common Services

Archive Message broker

Information Bus Data Sources

Surveillance Flight Plan Traffic Constraints Weather Obs and Forecasts

Controller Interfaces Decision Support Algorithms

slide-4
SLIDE 4

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-4 Lokhande/Reynolds 10/1/2012

Tower Flight Data Management (TFDM) Human Machine Interfaces

Tower Information Display System (TIDS) Flight Data Manager (FDM) Scanning COHU Camera

Ground and air surveillance data Electronic processing and distribution of flight data Fixed and tracking camera views for surveillance

Supervisor (SUP) Display

Flight sequencing and scheduling support

slide-5
SLIDE 5

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-5 Lokhande/Reynolds 10/1/2012

Tower Flight Data Management (TFDM) Human Machine Interfaces Analyzed in Study

Tower Information Display System (TIDS) Flight Data Manager (FDM) Scanning COHU Camera

Ground and air surveillance data Electronic processing and distribution of flight data Fixed and tracking camera views for surveillance

Supervisor (SUP) Display

Flight sequencing and scheduling support

slide-6
SLIDE 6

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-6 Lokhande/Reynolds 10/1/2012

TFDM Testing at Dallas-Fort Worth (DFW)

  • DFW-1: 8/24-9/3 in 2010, focus was on

surveillance validation and initial user feedback on interfaces

  • DFW-2: 4/26-5/5 in 2011, focus on

incorporation of decision support tools and camera usage

– Participants:

Each day 2 controllers switched off between Ground Control (GC) and Local Control (LC) positions Total: 12 ground, 12 local

– Shadow operation of East Tower – Data collected:

Human performance data (audio, video) Questionnaires (not reported here) Technical performance data (not reported here) TFDM system at DFW airport Center tower and East tower locations at DFW

slide-7
SLIDE 7

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-7 Lokhande/Reynolds 10/1/2012

Human Performance Data

  • Video/audio of participants and East

Tower Controllers (ETC) was compiled into one seamless video playback system Measurements

  • Verbal Command Analysis

– Verbal control commands

Participant vs. ETC (control group)

– Gap time & response rate

Causes of longest gap times

  • Visual Dwell Analysis

– Manual gaze evaluation – Individual dwell time & total dwell time

Causes of longest dwells Video playback system for data analysis

slide-8
SLIDE 8

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-8 Lokhande/Reynolds 10/1/2012

Verbal Command Analysis Results

  • Appx. 72% of the time, GC and LC

issued instructions before or within

  • ne second (neutral to) ETCs
  • LC issued commands first more

frequently than GC, t(9) = 3.30, p < 0.01

  • Discarded from analyses:

– Interacting with an observer – Incongruous operational strategy (2%

  • f GC cases, 10% of LC cases)
  • When issuing commands after ETC,

participant controllers appeared to be distracted by operating the TFDM display

10 20 30 40 50 60 70 80 90 100 Percentage Response Rate (%) Before Neutral (<1 s gap time) After Ground Local 44% 23% 46% 30% 25% 31%

slide-9
SLIDE 9

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-9 Lokhande/Reynolds 10/1/2012

Gap Time Charts

  • Gap time plots created to investigate causes of high gap times for purposes
  • f prototype design improvement

2 4 6 8 10 12 14 16 Gap Time (sec) Time instruction was issued Before Neutral After Ground Controller 6

slide-10
SLIDE 10

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-10 Lokhande/Reynolds 10/1/2012

Gap Time Charts

  • Gap time plots created to investigate causes of high gap times for purposes
  • f prototype design improvement

2 4 6 8 10 12 14 16 Gap Time (sec) Time instruction was issued Before Neutral After Ground Controller 6 Highlighting & editing flight strip on FDM

slide-11
SLIDE 11

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-11 Lokhande/Reynolds 10/1/2012

Gap Time Charts

  • Gap time plots created to investigate causes of high gap times for purposes
  • f prototype design improvement

2 4 6 8 10 12 14 16 Gap Time (sec) Time instruction was issued Before Neutral After Ground Controller 6 Highlighting & editing flight strip on FDM Editing FDE and passing it through appropriate bays to hand over to LC

slide-12
SLIDE 12

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-12 Lokhande/Reynolds 10/1/2012

Gap Time Charts

  • Gap time plots created to investigate causes of high gap times for purposes
  • f prototype design improvement

2 4 6 8 10 12 14 16 Gap Time (sec) Time instruction was issued Before Neutral After Ground Controller 6 Highlighting & editing flight strip on FDM Editing FDE and passing it through appropriate bays to hand over to LC Distracted by observer

slide-13
SLIDE 13

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-13 Lokhande/Reynolds 10/1/2012

Design Implications of Verbal Command Analysis

  • Specific issues found:

– FDM field highlighting feature / FDM text changes – Confusion when transferring electronic flight strips to different controllers – ATIS code change

Ground Control (# of instances) Local Control (# of instances) Issued command after hearing ETC 7 12 Interacting with flight strip: Moving flight strip 7 2 Interacting with flight strip: Editing flight strip 4 1 Looking for flight strip 10 2 Using Search to find flight strip 2 Looked at RACD 3 FDE not sent in time by GC N/A 3 Tracking flight on TIDS 1 2 TOTAL (all gap times over 3 sec) 54 37

slide-14
SLIDE 14

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-14 Lokhande/Reynolds 10/1/2012

Visual Dwell Analysis Results

Percent Total Dwell Time

  • More time spent head-down

(M = 81.9, SD = 12.8) than head-

up (M = 17.2, SD = 12.4), t(43) =

17.12, p < .001

  • More time looking head-up
  • ut the window over “Other”

dwell areas (M = 2.3, SD = 1.9), t(43) = -7.87, p < .001

10 20 30 40 50 60 70 80 90 100

Ground Local Ground Local Ground Local Head Down Head Up Other

Percent Total Dwell Time (%)

FDM TIDS COHU Other displays Head Up Observer Misc

40% 38% 39% 25% 15% 18%

slide-15
SLIDE 15

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-15 Lokhande/Reynolds 10/1/2012

Design Implications of Visual Dwell Analysis

FDM

  • Ground Control

– Forgetting to update FDE – Searching for flight strip – Editing flight strip

  • Local Control

– Confusion over flight strip not sent

  • ver to local control

TIDS

  • Viewing/Monitoring
  • Using Picture in Picture camera

view inside TIDS

# of dwells over 15 sec Ground (#) Local (#) Ground (%) Local (%) FDM 104 28 52 26.2 TIDS 81 56 40.5 52.3 Up 12 8 6 7.5 COHU 3 5 1.5 4.7 RACD 8 7.5 Misc 2 1.9 Total 200 107 100 100 % of dwells over 15 sec Ground (%) Local (%) 52 26.2 40.5 52.3 6 7.5 1.5 4.7 7.5 1.9 100 100

slide-16
SLIDE 16

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-16 Lokhande/Reynolds 10/1/2012

Conclusion

  • Development of a quantified and non-intrusive behavioral measure of

workload and gross visual attention in a field environment

  • TFDM features requiring significant focused attention and resulting in spikes

in workload identified for improvement Issues Discovered Through: Verbal Instructions Visual Attention Manually searching for flight strips on FDM X X Editing & updating flight strips X X Moving flight strips X Difficulty using “Search” function X Tracking flight on TIDS X Forgetting to update a flight strip X Slow when using FDM keyboard X Adjusting TIDS camera view X Inconclusive cause X X

slide-17
SLIDE 17

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-17 Lokhande/Reynolds 10/1/2012

10 20 30 40 50 60 70 80 First Second Neutral 5 10 15 20 25 30 Gap Time (sec) First Second Neutral

* * * * * * *

Local Controller 11 Local Controller 6

* * * *

Gap Time (sec)

* Asterisk indicates difference in operational strategy

Additional Gap Time Plots

slide-18
SLIDE 18

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-18 Lokhande/Reynolds 10/1/2012

10 20 30 40 50 60 70 80 First Second Neutral 5 10 15 20 25 30 Gap Time (sec) First Second Neutral

LC seems to disagree with live controller commands, but repeats them

Local Controller 11 Local Controller 6

Gap Time (sec)

* * * * * * * * * * * * Asterisk indicates difference in operational strategy

Additional Gap Time Plots

slide-19
SLIDE 19

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-19 Lokhande/Reynolds 10/1/2012

10 20 30 40 50 60 70 80 First Second Neutral 5 10 15 20 25 30 Gap Time (sec) First Second Neutral

LC adjusting time on FDE LC seems to disagree with live controller commands, but repeats them

Local Controller 11 Local Controller 6

Gap Time (sec)

* * * * * * * * * * * * Asterisk indicates difference in operational strategy

Additional Gap Time Plots

slide-20
SLIDE 20

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-20 Lokhande/Reynolds 10/1/2012

10 20 30 40 50 60 70 80 First Second Neutral 5 10 15 20 25 30 Gap Time (sec) First Second Neutral

Large gaps due to difference in operational strategy

LC adjusting time on FDE LC seems to disagree with live controller commands, but repeats them

Local Controller 11 Local Controller 6

Gap Time (sec)

* * * * * * * * * * * * Asterisk indicates difference in operational strategy

Additional Gap Time Plots

slide-21
SLIDE 21

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-21 Lokhande/Reynolds 10/1/2012

10 20 30 40 50 60 70 80 First Second Neutral 5 10 15 20 25 30 Gap Time (sec) First Second Neutral

Large gaps due to difference in operational strategy

LC adjusting time on FDE LC seems to disagree with live controller commands, but repeats them

Local Controller 11 Local Controller 6

LC busy moving FDEs around to appropriate bays

Gap Time (sec)

* * * * * * * * * * * * Asterisk indicates difference in operational strategy

Additional Gap Time Plots

slide-22
SLIDE 22

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-22 Lokhande/Reynolds 10/1/2012

Tower Information Display System (TIDS)

slide-23
SLIDE 23

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-23 Lokhande/Reynolds 10/1/2012

Flight Data Manager (FDM)

Ground FDM Display Local FDM Display Flight Data Entry (FDE)

slide-24
SLIDE 24

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-24 Lokhande/Reynolds 10/1/2012

Supervisor (SUP) Display

slide-25
SLIDE 25

MIT Lincoln Laboratory

Vis Attn. & Cog Workload-25 Lokhande/Reynolds 10/1/2012

COHU camera

Fixed view Fixed view Tracking view