The Effect of Increasing Levels of Automation in Demand-Capacity - - PowerPoint PPT Presentation

▶
the effect of increasing levels of
SMART_READER_LITE
LIVE PREVIEW

The Effect of Increasing Levels of Automation in Demand-Capacity - - PowerPoint PPT Presentation

Jan 14, 2023 361 likes •685 views

The Effect of Increasing Levels of Automation in Demand-Capacity Balancing processes on Human Actors and their Roles and Responsibilities A Gaming Assessment Rosana Casar Second SESAR Innovation Days Braunschweig, 27 29NOV 2012

slide-1
SLIDE 1

Assessment of degree of automation on human roles Assessment of degree of automation on human roles

The Effect of Increasing Levels of Automation in Demand-Capacity Balancing processes on Human Actors and their Roles and Responsibilities

A Gaming Assessment

Rosana Casar Second SESAR Innovation Days Braunschweig, 27– 29NOV 2012

slide-2
SLIDE 2

Assessment of degree of automation on human roles

Martijn Koolloos, David Escribano Reiner Suikat, Meike Jipp Alan Groskreutz, Raquel Garcia Rolf Zon, Tanja Bos

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 1

Consortium Martijn Koolloos, David Escribano Reiner Suikat, Meike Jipp Alan Groskreutz, Raquel Garcia Rolf Zon, Tanja Bos

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 1

slide-3
SLIDE 3

Assessment of degree of automation on human roles

Objective The assessment’s approach Gaming Technique Gaming Sessions Results Conclusions and Research Lines

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 2

Outline

slide-4
SLIDE 4

Assessment of degree of automation on human roles

3 2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012

Objective The assessment’s approach Gaming Technique Gaming Sessions Results Conclusions and Research Lines

slide-5
SLIDE 5

Assessment of degree of automation on human roles

2nd SESAR Innovation Days, Braunschweig, 27– 29/11/2012 4

General Objective

Assessment of the behaviour of ATM human roles in a highly automated environment

Airspace Organization and Management

Impact of automation on the interaction between human actors Impact of automation on the new roles and responsibilities Tools that support the ATM actors’ duties

slide-6
SLIDE 6

Assessment of degree of automation on human roles

5 2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012

Objective The assessment’s approach Gaming Technique Gaming Sessions Results Conclusions and Research Lines

slide-7
SLIDE 7

Assessment of degree of automation on human roles

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 6

Approach

Roles & Responsibilities 2020 Roles & Responsibilities 2035, 2050

VGA dimension, location, timing slot, two possible lobes
  • rientations
Mission Typology Exercise Director Mission Typology Exercise Director Subregional Manager Exercise Director Civil Airspace Manager Military Airspace Manager Subregional Manager Exercise Director Civil Airspace Manager Military Airspace Manager Subregional/AMC Manager Commercial Airline #1 Low Cost Airline Commercial Airline #2 Exercise Director Military User GAME: CDM PROCESSES: ONE to ONE vs. ALL TOGETHER GAME: TIMING OF THE PROCESS Subregional/AMC Manager Commercial Airline #1 Low Cost Airline Commercial Airline #2 Exercise Director Military User GAME: CDM PROCESSES: ONE to ONE vs. ALL TOGETHER GAME: TIMING OF THE PROCESS Commercial Airline #1 Low Cost Airline Commercial Airline #2 Exercise Director Military User GAME: CDM PROCESSES: ONE to ONE vs. ALL TOGETHER GAME: TIMING OF THE PROCESS Day before
  • peration
Day D Day before
  • peration
Day D VGA lobes
  • rientation
Publication in the NOP VGA lobes
  • rientation
Publication in the NOP Commercial Airline Low Cost Airline Subregional/AMC Manager Commercial Airline Low Cost Airline Subregional/AMC Manager A B Core Area A B Core Area

Scenario Gaming

Personal Game Goal 1 Your mission is to provide your preferred trajectories according to the different lobes orientations to the Sub- Regional Manager. Your trajectories preference are dependant on the rules of your company. Role Name (Ex: AOC) Main interactions with Sub-Regional/Air Space Manager AOCs Available Tools Trajectories predictor/What-if tool SWIM Your priotities are: the quality service to passenger is your first priority but the cost of your operation (extra flight time and extra fuel consumption) is also important. Every time that you are requested to provide your new trajectories you can use a what-if tool that will give you some information which help you to take decisions. Personal Game Mission General Responsabilities You are in charge of the maintenement of Trajectories and they give their consent before any demand adjustment. You will adapt their intentions and trajectories according to their strategies and possible imbalances in the network

Paper-based Platform-based

slide-8
SLIDE 8

Assessment of degree of automation on human roles

7 2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012

Objective The assessment’s approach Gaming Technique Gaming Sessions Results Conclusions and Research Lines

slide-9
SLIDE 9

Assessment of degree of automation on human roles

More than pure entertainment Low-cost human in the loop activity Simulate decision making processes Experts are ‘around a table’ playing different roles as they were living real processes

1st SESAR Innovation Days, Toulouse, 29/11 – 01/12/2011 8

What is Gaming?

slide-10
SLIDE 10

Assessment of degree of automation on human roles

Paper-Based

  • Relatively easy and low-cost (use of basic office material)
  • First assessment
  • Support the platform-based games

Platform- Based

  • Use of a platform (more realistic context)
  • Close link with different levels of automation
  • Complete assessment

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 10

Paper-Based & Platform-Based Gaming

slide-11
SLIDE 11

Assessment of degree of automation on human roles

Paper-Based

Gaming session activities

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 11

Preparation Play Analysis

Platform-Based

Preparation Play Analysis

TIME

slide-12
SLIDE 12

Assessment of degree of automation on human roles

CHILL

  • Collaborative Human-In-The-Loop

Laboratory

  • Used in Airspace Organization and

Management Gaming (DCB)

  • Different categories of actors work together
  • Suite of interoperable modelling services

and components

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 12

Platform-based Gaming

slide-13
SLIDE 13

Assessment of degree of automation on human roles

13 2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201

Objective The assessment’s approach Gaming Technique Gaming Sessions Results Conclusions and Research Lines

slide-14
SLIDE 14

Assessment of degree of automation on human roles

Paper-Based

  • Suitability of the assumed LoA
  • Pre-selection of solutions to be assessed
  • Preliminary analysis of the impact of automation on

human roles

Platform- Based

  • Complete assessment of the impact of automation on

human roles

  • Impact on teamwork
  • Needs of possible future support tools

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 14

Paper-Based and Platform-Based Gaming Objectives

slide-15
SLIDE 15

Assessment of degree of automation on human roles

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 15

Metrics

Impact of Automation

  • n Human

Roles

Acceptance Confidence Situation Awareness Workload Trust

slide-16
SLIDE 16

Assessment of degree of automation on human roles

  • Over the shoulder observations
  • Questionnaires
  • Debriefings
  • System Data Collection (only platform-based)

Qualitative Results (mainly):

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 16

Collection and analysis methods

slide-17
SLIDE 17

Assessment of degree of automation on human roles

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 17

Scenario – Demand and Capacity Imbalance

Refine/Build Reference Traffic Demand Detect Airspace Demand and Capacity Imbalance Select/Refine a demand and capacity imbalance Assess the impact of the solution at network level Start UDPP process on SBTs Negative impact Local Traffic Manager Network Manager Airport CDM/ASM Airspace User

slide-18
SLIDE 18

Assessment of degree of automation on human roles

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 18

Games performance - Runs

Runs in 2020 time frame (Baseline) Runs in 2035 time frame Runs in 2050 time frame

slide-19
SLIDE 19

Assessment of degree of automation on human roles

19 2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201

Objective The assessment’s approach Gaming Technique Gaming Sessions Results Conclusions and Research Lines

slide-20
SLIDE 20

Assessment of degree of automation on human roles

  • 2050

2020 and 2035 Suitability of Levels of Automation

  • Decreases with higher levels of automation

Interaction between roles

  • Positively assessed
  • Human performance improves with increasing LoA

Substitution of human tasks

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 20

Paper-based Gaming Results

slide-21
SLIDE 21

Assessment of degree of automation on human roles

  • 2050, 2020 2035

Level of frustration

  • Two of them considered high level of SA with higher LoA
  • One of them with low SA with the 2050 scenario

Situational Awareness

  • Flexibility, better managed by the humans

Other results

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 21

Paper-based Gaming Results

slide-22
SLIDE 22

Assessment of degree of automation on human roles

  • LoA proposed were accepted
  • Level of trust is maintained

LoA and Trust

  • Sufficient with the traffic density and the LoA shown
  • Some proposals to improve it

Situational Awareness

  • System more helpful when increasing LoA
  • The interactions decreases but not missed

Teamwork

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 22

Platform-based Gaming Results

slide-23
SLIDE 23

Assessment of degree of automation on human roles

  • acceptable LTM NM

Workload

  • Chat was appropriate
  • Tool to visualize different solution scenarios

Needs for additional tools

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 23

Platform-based Gaming Results

slide-24
SLIDE 24

Assessment of degree of automation on human roles

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 24

About Gaming Technique

slide-25
SLIDE 25

Assessment of degree of automation on human roles

25 2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201

Objective The assessment’s approach Gaming Technique Gaming Sessions Results Conclusions and Research Lines

slide-26
SLIDE 26

Assessment of degree of automation on human roles

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 26

Conclusions

  • Broadly fully automated environment is well-accepted:
  • Level of trust, acceptance
  • Workload, performance
  • Teamwork decreased
  • NM could assume some activities of LTM role
  • Flexibility, mainly a human aspect

About the impact of automation in roles

slide-27
SLIDE 27

Assessment of degree of automation on human roles

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 27

Conclusions

  • Gaming sessions met the expectations of the actors
  • Combination of the technique was positively

assessed

  • Include the same actors in both sessions improved

their adaptation to the platform environment About the gaming technique

slide-28
SLIDE 28

Assessment of degree of automation on human roles

  • Possibility to review and check the final solution
  • Assess the workload of the NM in case of assuming

LTM activities

  • New tools to support:
  • Visualization of multiple scenario data

About the impact of automation in roles

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 28

Recommendations

slide-29
SLIDE 29

Assessment of degree of automation on human roles

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 29

Research lines

  • Assess operational procedures in execution phase
  • Assess UDPP process
  • Assess the impact of increasing LoA when system

fails. About the impact of automation in roles

slide-30
SLIDE 30

Assessment of degree of automation on human roles

2nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 30

More info

More in next Gaming Sessions – Airport Environment

slide-31
SLIDE 31

The Effect of Increasing Levels of Automation in Demand-Capacity Balancing processes on Human Actors and their Roles and Responsibilities