TRLs in ESA
TRLs in ESA
Issue 1 Revision 0
Reason for change Date Pages Paragraph(s)
Page 2/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
Table of contents
1 Scope ............................................................................................................................... 4
2 References ...................................................................................................................... 5
6 Guidelines for the use of TRLs in ESA technology development activities ............ 12
Annex B - Correspondences for the use of TRLs for software in ESA programmes. 17
B.1 Correspondence table for the use of TRL for software in ESA programmes .................... 17
B.2 Comments for the case of SW building block .................................................................. 21
B.3 Examples ........................................................................................................................ 21
Tables
Table 4-1: Comparison of ISO TRL scale and ESA old TRL scale .................................................. 7
Table 5-1: Potential use of TRL assessment in various project phases ........................................... 9
Page 3/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
1
Scope
This document is an addendum to ISO TRL definition document ISO 16920 providing technology
readiness level definitions for space hardware and their assessment.
The document provides:
• A description of ISO scale evolution with respect to the previous scale used in ESA
• General guidelines for TRL use in ESA Programmes
• Additional elements for enabling the use of TRLs for software developments
Page 4/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
2
References
Page 5/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
3
Terms, definitions and abbreviated terms
Page 6/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
4
ISO TRL scale
The ISO TRL Working Group successfully converged to a unified international scale endorsed by
all major space actors, with a common understanding of the associated definitions. ISO TRL scale
should become a standard in space business. ISO TRL scale is slightly different from the previous
ESA, NASA, and US DoD respective TRL scales, which were also different one from each other
and subject to various interpretations.
The evolution with respect to the “old scale” used in ESA affects TRLs 5, 6 and 7, and is further
detailed in Table 4-1:
• TRL 5 (old scale) is split in two levels TRL 5 and TRL 6 in the new ISO scale.
• TRLs 6 and 7 (old scale) are merged in a single level TRL 7, representing qualification
through on-ground or in-orbit validation, as needed.
Table 4-1: Comparison of ISO TRL scale and ESA old TRL scale
TRLs in old ESA scale TRLs in new ISO scale
TRLs 1 to 4 TRLs 1 to 4 are basically unchanged
Same definition as TRL 5 old scale, but
allowing reduced scale breadboard verification.
Critical functions verification in TRL 5 Most useful for the development of large pieces
TRL 5 representative environment with (telescopes, structures) and for launcher
representative scale breadboards developments.
TRL 6 Same as TRL 5 old scale
Qualification through on ground
TRL 6
verifications Qualification level, through validation on
TRL 7
Qualification through in-orbit ground or in orbit, as needed
TRL 7
demonstration
TRLs 8-9 TRLs 8-9 are basically unchanged
Page 7/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
5
Use of TRLs in ESA programmes
Page 8/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
Page 9/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
• The associated uncertainties and the minimum set of verifications have been defined,
• Test vehicles or breadboard models for removing the unknowns have been developed and
successfully verified in the relevant environment that is applicable to the mission.
A reliable development schedule for a spacecraft can be established only when TRL 6 is reached.
Conversely, when a spacecraft element is not at TRL 6, the development schedule still has
uncertainties, since the element can fail in performing in the mission relevant environment. In some
cases, this can lead to a major re-design of the space segment at all levels and jeopardize the whole
mission concept.
TRL 5 is an intermediate readiness level that could also be considered to go for implementation with
acceptable risks. There are however remaining risks related to scaling effects. The effective risk in
starting a Project implementation at TRL 5 will have to be discussed on a case by case basis. As an
illustrative example, Herschel telescope development was decided at TRL 5. Reaching TRL 6 for
this particular case would have required building the full scale primary mirror, which is not far from
the entire telescope in the specific case of Herschel.
NOTE Technology Readiness Levels below TRL 6 are not necessarily implying the
element cannot be developed – a number of things can be done with
unlimited funding and schedule - but imply major uncertainties in the
development schedule.
Page 10/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
Page 11/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
6
Guidelines for the use of TRLs in ESA
technology development activities
R&D programmes can be seen as technology providers with the goal of delivering technologies at a
given level of maturity. The TRP nominally provides Technology up to TRL level 3, although in
some individual cases this may go up to TRL 4 or even higher. Target TRLs in GSTP technology
activities can vary between TRL 3 and TRL 7.
The evaluation of the results achieved by ESA R&D programmes is one of the key elements of the
ESA End-to-End process. In particular, the key issue is the evaluation of the actual TRL achieved
and the comparison with the target TRL envisaged at the beginning of the R&D activity.
It is proposed to maintain a simple procedure in the TRL assessment for basic technology activities
achieved through industrial contracts using TRP or GSTP funding.
For TRL ≤ 4, the Technical Officer involved in the conduct of the R&D activity should lead the
collection, review and verification/validation of the achieved TRL, in accordance with the Table 1
of ISO 16290.
For elements not targeting a specific Project (e.g. technology activity aiming at an equipment for
possible use in several missions) and for TRL ≥ 5, the TRL evaluation should involve the relevant
Technology Domain Responsible (as defined in document STM-277).
Page 12/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
7
Use of TRLs for ESA software developments
Page 13/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
(b) Specific embedded Software: SW that is targeting a specific application and that is
not conceived to be reused in another domain of application (e.g. equipment
embedded software).
NOTE This category includes Hardware Description Language for micro-
electronics (e.g. FPGA, ASICs).
This section clarifies the notion of SW TRL for the SW types 1 and 2.a, For the SW type 2.b, the
TRL ISO classification is applicable as is (the SW is part of the HW TRL assessment).
As for HW TRL, the SW TRL levels are not meant to be applied to the management of a software
development project, for which typically the software engineering standard (e.g. ECSS-E-ST-40 and
ECSS-Q-ST-80) is applied. The SW TRL is then simply a tool for the evaluation of the maturity of
a given software technology (building blocks, tools) within the context of its intended application.
The underlying principles are summarized below:
• TRL 1 to 4 cover the beginning of the development by increasing the level of implemented
functionality, from the mathematical formulation and through prototyping and incremental
enhancement:
For a SW tool, TRL 4 corresponds to the “alpha” version.
For a building block, TRL 4 corresponds to “pre-product prototype”.
• TRL 5 and 6 cover the transformation of the prototype into a product with frozen
requirements. A pre-qualification data package is produced by making use of the ECSS-E-ST-
40 and ECSS-Q-ST-80 standards, giving confidence that the product will perform as expected
in the final environment:
For a SW tool, TRL 5 corresponds to the “beta” version and TRL 6 corresponds to the
first release version.
For a building block, TRL 6 corresponds to the released product verified with a
simulated environment.
• TRL 7 corresponds to the SW qualification for the foreseen application verifying the SW
performance in its intended environment.
For a SW tool, this corresponds to full validation on a representative pilot case.
For a building block, this corresponds to successful qualification as part of the foreseen
application.
Page 14/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
Page 15/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
TRL ISO definition Associated model Performance Representativity Comment and practical use
requirements of environment
& test
1 Basic principles observed and reported Not applicable In elaboration No Seldom considered in ESA developments
2 Technology concept and/or application Not applicable In elaboration No Seldom considered in ESA developments
formulated
3 Analytical and experimental critical function Mathematical models, Partly defined No Use in technology developments for
and/or characteristic proof-of-concept supported e.g. by sample monitoring progress
tests
4 Component and/or breadboard functional Breadboard Partly defined No Use in technology developments for
verification in laboratory environment monitoring progress
5 Component and/or breadboard critical Scaled EM for the Fully defined Yes, for critical Could be used as threshold for enabling the
function verification in a relevant critical functions functions subject start of implementation phase (C/D), subject
environment to scaling effect to risks related to scaling effects
6 Model demonstrating the critical functions of Full scale EM, Fully defined Yes, for critical Critical threshold for enabling the start of
the element in a relevant environment representative for critical functions implementation phase (C/D) with mastered
functions schedule
7 Model demonstrating the element QM Fully defined Yes QM validated, generally during the
performance for the operational environment implementation phase C/D
Note: project may allow EQM or PFM
instead of QM
8 Actual system completed and “flight FM acceptance tested, Fully defined Yes Qualification of ground achieved, last step
qualified” through test and demonstration integrated in the final before launch of most of space developments
system
9 Actual system completed and accepted for FM, flight proven Fully defined Yes Corresponds to mature technology
flight (“flight qualified”)
Page 16/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
B.1 Correspondence table for the use of TRL for software in ESA programmes
TRL Engineering Additional Description Requirements Verification Viability
terms relevant to explanation to
SW cover software
1 MATHEMATICAL Scientific Detailed mathematical Expression of a problem Proven mathematical Feasibility to be
FORMULATION knowledge formulation description. and of a concept of formulation. implemented in software
Publication of research solution. with available computing
results. facilities demonstrated.
2 ALGORITHM Individual Algorithm Practical application Single algorithms are feasibility to build
algorithms or implementation identified. tested resulting in their important functions in a
functions are documented. Results A concrete specification characterization and system architecture
prototyped documented. of a part of the problem. feasibility demonstration. demonstrated.
3 PROTOTYPE Prototype of the Architectural design of Some solutions to a A subset of the overall Feasibility to build an
integrated main important functions is range of problem. functionality is operational system
system documented. Main use cases implemented and tested taking into account
Depending on size and implemented. to allow the performance and
complexity of the demonstration of usability aspects
implementation. performance. demonstrated.
V&V in a simulated
laboratory environment.
Page 17/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
Page 18/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
Page 19/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
Page 20/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
B.3 Examples
Page 21/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
• TRL 3: there is an architecture that shows not only the scheduling algorithm, but also the
interrupt management, the semaphores, the relation to hardware timers, etc. Integrating the
algorithm into an operating system is feasible.
• TRL 4: the operating system has a specified interface for application software users, all
expected functions of an operating system are implemented, but not all are tested (e.g. the
priority inversion protection). The operating system has been validated by running in a
simulator of the target processor, itself being a software running on a standard PC.
• TRL 5: the domain of use of the operating system is defined, in terms of target processors
(e.g. ERC32, Leon, PowerPC), communication capabilities (e.g. SpaceWire driver, 1553
drivers) or operational capability (e.g. maximum number of priority, tasks, semaphores). The
operating system is validated for all the parameters values and hardware environment that are
foreseen in the domain of reuse. The validation environment is a hardware board with a
representative target processor and hardware communication drivers.
• TRL 6: a formal qualification data package (in the meaning of the software standards applied in
the foreseen criticality level) is available and approved by software product assurance. It
constitutes a qualification credit that can be invoked in a project. The process to be used in order
to delta-qualify the operating system in the user project is defined. Support to users is organized
(helpdesk). The operating system can be called a “product” and can be proposed to users.
• TRL 7: a spacecraft project has selected the operating system for its flight software.
Therefore, the parameters for the specific use have been selected: target processor,
communication drivers and maximum sizes and ranges are set. There is a successful
qualification of the operating system with these values, in the intended environment, The
validation environment includes the actual hardware of the project.
• TRL 8: the SW is integrated in the final spacecraft that has been accepted and is ready for
flight.
• TRL 9: the spacecraft has been launched and the operating system is nominally functioning.
Page 22/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013
ESA UNCLASSIFIED – For Official Use
• TRL 5: the Beta version of the compilers has optimized the machine code generation, the
performance and the ergonomy of the man machine interface. A reference test suite of source
code has been established to validate the compiler, and the generated object code runs on the
hardware processor.
• TRL 6: the compiler is a Product with a good documentation and acceptable performances. It
produce error messages which are complete and user friendly. The support is organized, as
well as the product packaging and delivery.
• TRL 7: the compiler is delivered to early adopters for extensive testing. Then, the compiler
robustness is improved following user feedbacks.
• TRL 8 and 9: the compiler is deployed to the complete user community.
Page 23/23
ESSB-HB-E-002 Issue 1 Rev 0
Date 21 August 2013