Technologies de Visualisation

Philippe Coni
Thales Avionics – Display Expert
SID – Program committee
[email protected]
2 //
2 Programme des cours

Module 1 : Les écrans de Cockpits

 Introduction aux systèmes de cockpits
 Panorama des produits de visualisation
 Généralités sur les contraintes avioniques
Module 2 : Système Avionique et spécifications
 Système: Suite avionique
 Produit (LRU): Visualisation
 Sous ensemble (SRU): Module affichage
Module 3 : Les conditions d’environnement
 Contraintes d’installation et d’utilisation
 Conditions d’environnement: DO160
Module 4 : Performances optique
 Performances & Mesures optiques
 Recommandations avionique: ARP4256
Module 5 : Performance tactile
 Rappel des technologies tactiles
 Performances des ecrans capacitifs
 Recommandation avionique: ARP 60494
3 //
3 Les écrans de cockpit

‘’The cockpit design aims at simplifying the crew’s task by enhancing situational
and aircraft status awareness’’

‘’The use of new technologies and implementation of new functionalities are dictated by:
. Significant safety benefits
. Obvious operational advantages
. A clear response to a pilot’s needs’’
4 //
4 Cockpit History

At the beginning 1918 1969

No Cockpit… 10 instruments to cross Atlantic Ocean 600 instruments to cross Atlantic Ocean

1970 Boeing 747 1976 Concorde

One instrument = 1 parameter
…

Crew had to manage

thousands of instruments

More and more instruments to cross Atlantic Ocean

5 //
5 Cockpit History

1978 A310 1988 A320 2007 A380

Introduction of Multifunctions Displays Full Displays Cockpit, electric flight controls AMLCD Displays, Interaction Means,
Integrated Modular Avionics

2015 A350 2030? Odicis

Cockpit designed to:

• Simplify crew’s task

• Enhance situational
awareness

Large Displays, 2018: Introduction of One free form and multitouch Display
touchscreen
6 //
6 CDS : Contraintes Fonctionelles

- Operational functions

Operational - Concept of cockpit

Needs - Human Factors

Main actor : Customer

- Display BB : display
units, graphic generator,
… Cockpit Architecture - Cost
- Control panels BB: - KPI (weight, vol,
interactive media Power, MTBF, nb
(CCD/KBD), existing LRU/PN, …)
control panels …
Architecture
Performance - Display
- Computing & Graphic (Building Blocks) Performance (CPU,
SW BB : Plateforme SW mem, latencies, …)
(incl. OS), graphic server,
existing operational - Dispatch /
functions, … Maintenability
- SW framework - Evolutivity
Main actors : Thales CKT Main Actor : Thales
or COTS
- Safety / certif

- Environmental conditions
Airborne
« Constrainst » - Installation on A/C or H/C

Main Actors : Certif. Authorities,

Customer
7 //
7 Human Factors

System complexity Operational

Needs
Human Machine
◆ Consume cognitive ressources Performance
Cognitive resources
◆ Reduce HMI Performance onboard

Cognitive Engineering
“Behind Next Generation
◆ Cognitive load shall be kept in AV2020 Cockpit Display”
Sylvain Hourlier – Thales
comfort zone Avionics
SAE AeroTech, 21-25 sept 2015,
Seattle

◆ Spare the cognitive resources

Pro-action
Anticipate
Preparation of action
Behavior Routinize
Reflexes

Abstraction
To Human Schematize
Delegate Refinement
To System
8 //
8 Concept of Cockpit

EFIS Capt EFIS F/O

PFD ND EWD E ND PFD

C
A
M
SD
MB
A320

A350

Cross Crew Qualification in mind

9 //
9 Cockpit Functions

Operational
Needs

Fly

Navigate

Communicate

Manage Aircraft System

10/ /
10 HMI Functions

Primary Flight Display Enhanced Vision System PFD / Synthetic Vision System
Building
Piloting HMI

Blocks

Navigation Display Digital Map Airport Navigation E-Charts Mission HSI

Mission HMI

Piloting: To provide the flight deck crew

Virtual Overhead
Systems Display iSD with the information necessary for the
Control Panel
short term control of the aircraft and its
System HMI

trajectory
Mission: To provide the flight deck crew
with the information necessary for the
mid- to long-term control of the aircraft
and its mission
System: To provide the man-machine
interface to control and / or configure the
several aircraft systems
11/ /
11 Cockpit Display

Head Up
Displays

Stand-by
Display

Head
Mounted
Displays

Head Down
Displays
Display &
Interaction
Means
Interactive
Means
12/ /
12 Head Mounted Displays

Building
Blocks
PROD

Trends

Digital Night vision

Next Gen Head tracking
New imagers
Waveguide optics
Composite material
Wireless
13/ /
13 Head Up Displays

Building
Blocks

Trends

Wide field of view

Large Eye Box
Reduced Cockpit footprint
Dual / Full color
Sunlight readability
14/ /
14 Stand-by displays

Several Instrument in one

Integrate multiple Sensors: Building
• Pressure (Total / Static) Blocks
• 3 axis Accelerometers
• Gyrometers (3 axis)

Availability &
Integrity of
flight critical
primary data
• Dissimilar
display
• Dissimilar
software
• Dissimilar
sensors
15/ /
15 Head Down Displays

Building
Blocks

IO
Housing
AMLCD Processing

Power Supply Trends

Graphic
Wide Screen
Borderless / Seamless / Freeform
Low power consumption
Backlight Smart (Processing inside)
Interactivity (Multitouch)

Bezel
16/ /
16 Interactivity in cockpit

Operational
1988 Needs

A320: Introduction of Glass Cockpit

Control panels / Overhead panels
Soft keys around the display
Multifunction Keyboard
17/ /
17 Interactivity in cockpit

1990

APPLE bring a new paradigm:

• Direct interaction on the screen

2007

THALES build the first touchscreen cockpit Operational

Needs
• Introduction of Projected Capacitive Technology
• Multifunction Displays
• Control Display Unit
18/ /
18 Interactivity: ARINC661

2007 Operational
Needs

Interactive Widget on A380

• Virtual control panel
• Cursor Control Device

Widget library (Courtesy of Esterel Technology)

WIMP based GUI

• Use of Control Cursor Device

Windows
Icons
Menu
Pointer
19/ /
19 Interactivity in cockpit

2010
Operational
Needs

A350 Cockpit
Interactivity introduction on outer displays and center-down
display witch are connected to both open world interactivity
(Electronic Flight Bag) and main avionics system.
20/ /
20 Touchscreen technology

IR Matrix (Garmin) Resistive (Rockwell Collins)

Operational
Needs

Several technologies
A frame is needed for a
homogeneous user
Experience

IR Matrix (BARCO) PCAP (THALES)

21/ /
21 Safety

The Swiss Cheese model

Airborne
Constrainst

Hole ➔ Opportunities for a process to fail Increase the Design Assurance

Level (DAL) increase the slice
number
Reducing the hole number reduce
Cheese slice ➔ defensive layers in the the hazards occurrence
Dissimilarity avoid hole alignment
process
22/ /
22 Safety

Airborne
For each aircraft system performing a critical function, Constrainst
no single failure shall lead to an undetected
erroneous failure
Failure Conditions (Integrity) Hazard
Several severity class, quantified by failure rate per class.
hour of flight:
Misleading display of primary flight parameters (altitude, CAT
Catastrophic : 10-9 airspeed, altitude) on both primary displays
Unsafe flight take-off or landing
Misleading display of primary flight parameters (altitude, HAZ
airspeed, altitude) on one primary display
Hazardous : 10-7
Large reduction in safety margin Misleading display of stabilized heading on primary displays HAZ

Major : 10-5 Misleading display of flight path vector on one primary MAJ
Significant reduction in safety display
margin
Misleading Display of Nav / Position information (*) MAJ to HAZ
Minor : 10-3 Loss of / Misleading display of crew alerting CAS messages MAJ
Slight reduction in safety margin
Misleading Display of flight crew procedures MAJ to CAT

Misleading display of any required engine indications CAT

for more than one engine (**)

Availability ➔ Redundancy & Reversion

Catastrophic ➔ no single failure & dissimilarity

23/ /
23 FMEA

Failure Modes and Effects Analysis: Airborne

Constrainst

◆ A systematic bottom-up method of identifying the failure modes of an

item and determining their effects on the next higher level.
◆ Analysis performed at component level, and at functional level for FPGA,
SOC, ASIC, that mean that IC supplier must share their internal design
and software,
Failure mode Failure rate Failure effect analysis Failure detection
FAILURE MODES AND EFFECTS ANALYSIS (FMEA)
Aicraft: Future Aircraft FMEA-N°: Issue: Issue: 00
System: Avionics 2020 Prepared by: CB Date: Date:
Component: Multitouchscreen Display
Failure description Reliability Failure effect Detection Monitoring action
P-BIT C-BIT IBIT ATE SW

Com ponent Com ponent before sanction at board

Failure Com ponent Com ponent Failure Mode Com ponent FR of before sanction at block level (output to oper before sanction at nios Before sanction, after sanction at after sanction at after sanction at After sanction,
Block Nam e Num ber Ref Com ponent Failure Mode FR (1E-9) Distribution (%) failure m ode (1E-9) level softw are) softw are level Code effect block level board level equipm ent level Code effect Test ID Test ID Test ID Test ID Test ID

Loss of measurement signal Floated signal => saturation Loss of line or Loss of line or
MUX touches 01:02:01 R104 Open circuit 3,00E+01 95,00% 2,85E+01
to lines or column
Loss of line or column
at ADC input column column detected
AS MD - SW x Checking of measured data inside a valid
range

Ex. for a Touchscreen

Failure effect Functional Failure
block Failure Mode rate Local effect Effect at PCT level
(AFE) (10-9)
Functional Block Failure % of Erroneous / Loss of No effect
One MUX output
rate Failure spurious touches always active:
Erroneous measurement on Erroneous touch detection on
one line/column one line/column
(10-9) touches shorted with another
one
Erroneous output Erroneous measurement on Erroneous touch detection on
Touch Processing 2560 30.7 1128 1310 350 Multiplexer selection 2630 one line/column one line/column
… … …
Analog Front End 5760 69.1 2340 2790 629 One MUX output
always open
Loss of one line/column
measurement
Loss of touch detection on one
line/column
Failure of Multiplexer, DAC/ADC,
Touchscreen 9 0.2 0.36 9 Erroneous
DAC / ADC conversion 3120
Erroneous measurement on
one line/column
Erroneous touch detection on
one line/column touch Sensor: Erroneous touch
FMEA result at functional block level … …
Loss of one line
…
Erroneous touch detection on
Open (cut) line measurement, possible
one line/column
detection of the adjacent line

Touch Open (cut) column

Loss of one column
measurement possible Erroneous touch detection on Need of a dedicated monitoring
9 detection of the adjacent one line/column
Screen column

Touchscreen System Short circuit

between two lines
Erroneous measurement on Erroneous touch detection on
Architecture for or columns
one line/column one line/column

Safety Critical … … …
Applications FMEA abstract for AFE
Philippe Coni/ Thales
24/ /
24 Monitoring

Example of a COM/MON on a Display Chain Airborne

Constrainst

Graphics Instructions Image

Critical
parameter I/O Acq & Graphic Display #1
Processing Generation (F)
Signature COM

I/O Acq & Feedback (F-1)

Display #2
Processing Data Alert

MON

Integrity ➔ Monitoring
25/ /
25 Environmental

Thermal
◆ Operating -40°C to +70°C (85°C)

Electrical
◆ Voltage transient up to 60V/100 ms (28V Network)
◆ Power interrupt up to 200 ms

Electromagnetic
◆ Pulsed field up to 7200 V/m
◆ ESD up to 15 000V
◆ Lightning transient (Up to 1000V)
Airborne
Mechanical Constrainst

◆ Shock up to 20g/20ms
◆ Rapid decompression
Civil > RTCA DO160G
◆ Salt fog
Military > MIL-STD 810/461/462
26/ /
26 Environmental: Example of Turbulences

Test Goal Airborne

Constrainst

◆ De-risk usability of touchscreens in turbulence

◆ Prepare certification
◆ Issue recommendations (HMI & install)

Turbulence
irregular atmospheric motion
characterized by up-and-down
currents
irregular air motion
characterized by winds that
vary in speed and direction

Small frequency / great amplitudes

Not many systems can manage such
movements
Testing Touch Screens
in Realistic
Aeronautical
Turbulent Conditions
(Light to Severe)
Sylvain Hourlier /
Thales
27/ /
27 Environmental: Example of High Intensity Radiated Fields

Airborne
Test Goal for a Touchscreen Constrainst

◆ Comply with most severe HIRF

needs
◆ Fully operational during test
◆ No false touches

A Projected Capacitive
Touchscreen Operating
under High Intensity
Radiated Field Touched
Philippe Coni / Thales

HIRF Issue: A Projected capacitive touchscreen

integrates both measurement field and external field

Untouched
Need a ruggedized CRBM Chamber: Up
controller to 7200 V/m
28/ /
28 Installation

Example of HUD
Airborne
 Need optical / mechanical studies Constrainst
 Keep head clearance

A350 chief engineer (G. Mc Connell) :

« HUD is perfectly integrated in the cockpit »
29/ /
29 Optical Constraints per ARP4102

 SAE ARP 4102 §7.2.3 require a contrast greater than 1.2 under 34,000 Cd/m² of
background luminance:
CR = Display Luminance + Background Luminance) > 1.2
Background Luminance

6800 Cd/m² is needed by regulation

Imager luminance
22600 Cd/m²
Image reflected by the combiner
Required: 6800 Cd/m²

Optical engine efficiency

 (Could be between 0,02 and 0,5)

Ambiant background
34000 Cd/m²

Combiner efficiency
(Reflection & transmission)
Windshield Tr & R
(Transmission)
Tr
By taking into account a global efficiency of 30%,
22600 Cd/m² is needed at Imager level
30/ /
30 Optical Constraints per ARP4256

 ARP4256 Design objectives for LCD displays for Part25 Aircraft

« The display symbology shall be clearly readable throughout the viewing envelope under all ambient
illumination levels ranging from 1.1 lux (0.1 fc) to sun-shafting illumination of 86 100 lux (8000 fc)
incidence on the face of the display. »
Airborne
 Primary field of view (FOV) per AC25-11A Constrainst

35° max primary lateral field of view

-35°
max primary
vertical field of
view
31/ /
31 Example of Civil Cockpit

A340 EC155 Dash 8-Q400

32/ /
32 Examples of Military Cockpit

Rafale C-130

NH90
33/ /
33 Cockpit Trends

Cockpit size Increased display area

Complexity Improve situational awareness

Workload Reduced cognitive load

Safety Reduced risk for human error / training

34/ /
34 The Future of Cockpit Display System
35/ /
35 Future…

Operational capacity
Adapted to aircraft
mission
36/ /
36 HMI Functions

Mission Centric Cockpit

37/ /
37 Building Block
38/ /
38 Cockpit du futur

Nouvelle suite avionique FlytX THALES sur futur

hélicoptère de l'armée « Guépard »