Aerospace Medical Association 2009
Content
Data Communications Integration in En Route Air Traffic Control Human Factors Implications
Presented to: Aerospace Medical Association By: Ben Willems Date: May 7, 2009
Federal Aviation Administration
Overview • Human Factors Team Atlantic City • National Airspace System Enterprise Architecture • En Route Data Communications Experimental Human Factors Evaluation
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
2
2
Human Factors Team-Atlantic City
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
3
3
Human Factors Team-Atlantic City Human Factors Team – designs and conducts human factors laboratory and field projects • 12 Federal Engineering Research Psychologists • 1 Supervisory Air Traffic Controller (1-year detail) • 1 Computer Scientist • 15 Contract Psychologists, Subject Matter Experts, and Lab Support
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
4
4
Human Factors- relating humans to technology • Applying what is known about human capabilities and limitations to products, processes, systems, and work environments • Improve: – safety, efficiency, effectiveness, system performance, reliability, ease of use, and user satisfaction,
• Reduce: – errors, operator stress, training requirements, workload, user fatigue, and product liability
• Provides the data for data-driven decision making
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
5
5
Human Factors Methods Cognitive Walkthroughs Usability Assessments of Existing Systems Human-Computer Interface Design & Evaluation Rapid Prototyping Workstation and Work Space Design Human-in-the-Loop Simulations In the Laboratory and Distributed Field Observations & Operational Evaluations Lab and Field Surveys Heuristic Evaluations DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
6
6
Simulation Measures
Efficiency Measures Safety Measures Controller Actions Visual Scanning Situation Awareness Workload Ratings Questionnaires Observer Ratings Audio-Video Recordings
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
7
7
NextGen research support Operations Concept Human Factors Focuses on integration/harmonization of concepts • ATC & Tech Ops Concept Studies and Simulations • ATC & Tech Ops Metrics Development • Guidelines and Standards Development
System Development Human Factors Focuses on specific system or concept (e.g. DataComm) • Evaluation and Selection of Existing Systems • Development of New Systems and Facilities • Validation of System Design and Redesign DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
8
8
National Airspace System Enterprise Architecture
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
9
9
Infrastructure Roadmaps - January 2009 • • • • • • • • • • • • •
Aircraft Air / Ground Airspace and Procedures Automation Communication Enterprise Services Facility Information Systems Security Navigation Human Systems Integration Safety Surveillance Weather
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
10
10
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
11
11
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
12
12
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
13
13
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
14
14
En Route Data Communications: Experimental Human Factors Evaluation
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
15
15
Experiment Preparation • Cognitive walkthrough • Early User Involvement Event/Demonstration • Target Generation Facility (TGF) – Build simulation pilot interface to monitor/interact with simulated DataComm system – Extend the DataComm message set that TGF supports
• Distributed Environment for SImulation, Rapid Engineering, and Experimentation (DESIREE) – Extend the En Route Automation Modernization emulation to include • Data entry capabilities to support the DataComm message set • Data display capabilities to support the DataComm message set DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
16
16
Experiment Overview • • • •
24 en route certified professional controllers High fidelity air traffic control simulations Data collection June – August, 2009 Controllers participate for 6 days in teams of two controllers
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
17
17
Research questions • Equipage levels – 0, 10, 50, 100%
• FMS integration – 0, 50, 100%
• Human Machine Interface – Keyboard, template, graphical, combined
• Data Communications message delays – Segment 1 vs. Segment 2 (shorter) delays
• Failure modes – Individual aircraft, part of the airspace, full system
• Service mode – Best-equipped, best-served vs. first-come, first-served
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
18
18
Equipage Levels • • • •
0 10 50 100
Current voice-based environment Equipage early after implementation No majority of aircraft with certain capabilities High performance airspace
• Potential Issues – – – –
Voice channel congestion Performance improvement at low equipage levels Mistaking voice-based aircraft as DataComm equipped Use of voice for tactical operations in high performance airspace
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
19
19
Flight Management System Integration • 0 None of the aircraft can preload messages • 50 Half of the DataComm aircraft can preload messages • 100 All of the DataComm aircraft can preload messages • Potential issues – Longer pilot delays – Manual entry of instructions may lead to more errors – Confusion about what messages are appropriate for an aircraft with or without FMS integration
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
20
20
Human Machine Interface • • • •
Keyboard Template Graphical Combined
Text-based keyboard entry Message composition template Point-and-click Keyboard, template and graphical available
• Potential issues – Data entry errors – Duration of message composition – Reduced uniform visual scan of traffic patterns (tunnel vision)
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
21
21
Data Communications message delays • Technological improvements may reduce the technical delay • Pilots may become more familiar with DataComm and respond to messages more quickly • Potential issues – At longer delays, controllers may revert to voice – At longer delays, more controller-pilot transactions may stay open simultaneously
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
22
22
Failure modes • Individual aircraft • part of the airspace • full system
(e.g. a transceiver fails)
• Potential issues – Awareness of DataComm failure for individual aircraft – Change in workload as a result of DataComm failures – Recovery from DataComm failures
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
23
23
Service mode • First-come, first-served (FCFS) • Best-equipped, best-served (BEBS) • Potential issues – Changes in workload when providing improved service to bestequipped aircraft – Awareness of applicable procedures based on aircraft equipage – Maintaining safety and efficiency while providing BEBS
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
24
24
Summary • DataComm will – reduce controller workload related to voice communications – Potentially change the way controllers work – Bring human factors issues related to human machine interface design, procedures, and training – Form one of the cornerstones that will drive the Next Generation Air Transportation System
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
25
25
Human Factors Team – Atlantic City http://hf.tc.faa.gov
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
26
26
Backup slides
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
27
27
Capabilities
En Route
TRACON DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
28
28
Capabilities
Tower DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
29
29
Capabilities
Traffic Flow Management DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
30
30
Virtual Reality Modeling
VR Model
Prototype Field Site
En Route Supervisor Work Space DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
31
31
Human Factors Design Standard Contains human factors design criteria Used for: requirements definition, procurement, heuristic evaluation, interface & system design, test and evaluation, safety audits Used to reduce risk, save money NextGen Integrated Work Plan Research and Development Activities (D-1710, D-2159, D-2155, D2157)
Available in hard copy, on CD ROM, and on-line
DataComm Integration in En Route ATC: HF Implications May 7, 2009
http://hf.tc.faa.gov/hfds/default.htm
Federal Aviation Administration
32
32
Presented to: Aerospace Medical Association By: Ben Willems Date: May 7, 2009
Federal Aviation Administration
Overview • Human Factors Team Atlantic City • National Airspace System Enterprise Architecture • En Route Data Communications Experimental Human Factors Evaluation
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
2
2
Human Factors Team-Atlantic City
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
3
3
Human Factors Team-Atlantic City Human Factors Team – designs and conducts human factors laboratory and field projects • 12 Federal Engineering Research Psychologists • 1 Supervisory Air Traffic Controller (1-year detail) • 1 Computer Scientist • 15 Contract Psychologists, Subject Matter Experts, and Lab Support
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
4
4
Human Factors- relating humans to technology • Applying what is known about human capabilities and limitations to products, processes, systems, and work environments • Improve: – safety, efficiency, effectiveness, system performance, reliability, ease of use, and user satisfaction,
• Reduce: – errors, operator stress, training requirements, workload, user fatigue, and product liability
• Provides the data for data-driven decision making
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
5
5
Human Factors Methods Cognitive Walkthroughs Usability Assessments of Existing Systems Human-Computer Interface Design & Evaluation Rapid Prototyping Workstation and Work Space Design Human-in-the-Loop Simulations In the Laboratory and Distributed Field Observations & Operational Evaluations Lab and Field Surveys Heuristic Evaluations DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
6
6
Simulation Measures
Efficiency Measures Safety Measures Controller Actions Visual Scanning Situation Awareness Workload Ratings Questionnaires Observer Ratings Audio-Video Recordings
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
7
7
NextGen research support Operations Concept Human Factors Focuses on integration/harmonization of concepts • ATC & Tech Ops Concept Studies and Simulations • ATC & Tech Ops Metrics Development • Guidelines and Standards Development
System Development Human Factors Focuses on specific system or concept (e.g. DataComm) • Evaluation and Selection of Existing Systems • Development of New Systems and Facilities • Validation of System Design and Redesign DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
8
8
National Airspace System Enterprise Architecture
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
9
9
Infrastructure Roadmaps - January 2009 • • • • • • • • • • • • •
Aircraft Air / Ground Airspace and Procedures Automation Communication Enterprise Services Facility Information Systems Security Navigation Human Systems Integration Safety Surveillance Weather
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
10
10
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
11
11
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
12
12
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
13
13
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
14
14
En Route Data Communications: Experimental Human Factors Evaluation
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
15
15
Experiment Preparation • Cognitive walkthrough • Early User Involvement Event/Demonstration • Target Generation Facility (TGF) – Build simulation pilot interface to monitor/interact with simulated DataComm system – Extend the DataComm message set that TGF supports
• Distributed Environment for SImulation, Rapid Engineering, and Experimentation (DESIREE) – Extend the En Route Automation Modernization emulation to include • Data entry capabilities to support the DataComm message set • Data display capabilities to support the DataComm message set DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
16
16
Experiment Overview • • • •
24 en route certified professional controllers High fidelity air traffic control simulations Data collection June – August, 2009 Controllers participate for 6 days in teams of two controllers
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
17
17
Research questions • Equipage levels – 0, 10, 50, 100%
• FMS integration – 0, 50, 100%
• Human Machine Interface – Keyboard, template, graphical, combined
• Data Communications message delays – Segment 1 vs. Segment 2 (shorter) delays
• Failure modes – Individual aircraft, part of the airspace, full system
• Service mode – Best-equipped, best-served vs. first-come, first-served
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
18
18
Equipage Levels • • • •
0 10 50 100
Current voice-based environment Equipage early after implementation No majority of aircraft with certain capabilities High performance airspace
• Potential Issues – – – –
Voice channel congestion Performance improvement at low equipage levels Mistaking voice-based aircraft as DataComm equipped Use of voice for tactical operations in high performance airspace
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
19
19
Flight Management System Integration • 0 None of the aircraft can preload messages • 50 Half of the DataComm aircraft can preload messages • 100 All of the DataComm aircraft can preload messages • Potential issues – Longer pilot delays – Manual entry of instructions may lead to more errors – Confusion about what messages are appropriate for an aircraft with or without FMS integration
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
20
20
Human Machine Interface • • • •
Keyboard Template Graphical Combined
Text-based keyboard entry Message composition template Point-and-click Keyboard, template and graphical available
• Potential issues – Data entry errors – Duration of message composition – Reduced uniform visual scan of traffic patterns (tunnel vision)
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
21
21
Data Communications message delays • Technological improvements may reduce the technical delay • Pilots may become more familiar with DataComm and respond to messages more quickly • Potential issues – At longer delays, controllers may revert to voice – At longer delays, more controller-pilot transactions may stay open simultaneously
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
22
22
Failure modes • Individual aircraft • part of the airspace • full system
(e.g. a transceiver fails)
• Potential issues – Awareness of DataComm failure for individual aircraft – Change in workload as a result of DataComm failures – Recovery from DataComm failures
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
23
23
Service mode • First-come, first-served (FCFS) • Best-equipped, best-served (BEBS) • Potential issues – Changes in workload when providing improved service to bestequipped aircraft – Awareness of applicable procedures based on aircraft equipage – Maintaining safety and efficiency while providing BEBS
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
24
24
Summary • DataComm will – reduce controller workload related to voice communications – Potentially change the way controllers work – Bring human factors issues related to human machine interface design, procedures, and training – Form one of the cornerstones that will drive the Next Generation Air Transportation System
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
25
25
Human Factors Team – Atlantic City http://hf.tc.faa.gov
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
26
26
Backup slides
DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
27
27
Capabilities
En Route
TRACON DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
28
28
Capabilities
Tower DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
29
29
Capabilities
Traffic Flow Management DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
30
30
Virtual Reality Modeling
VR Model
Prototype Field Site
En Route Supervisor Work Space DataComm Integration in En Route ATC: HF Implications May 7, 2009
Federal Aviation Administration
31
31
Human Factors Design Standard Contains human factors design criteria Used for: requirements definition, procurement, heuristic evaluation, interface & system design, test and evaluation, safety audits Used to reduce risk, save money NextGen Integrated Work Plan Research and Development Activities (D-1710, D-2159, D-2155, D2157)
Available in hard copy, on CD ROM, and on-line
DataComm Integration in En Route ATC: HF Implications May 7, 2009
http://hf.tc.faa.gov/hfds/default.htm
Federal Aviation Administration
32
32
