Science Readiness Levels-SRL Handbook v1.1 Issued External
Science Readiness Levels-SRL Handbook v1.1 Issued External
Page 1/22
Table of contents:
Page 2/22
1 Purpose of the document
This document shall serve as a “Scientific Readiness Level (SRL) Handbook”. Its
purpose is to establish the standard measure of the maturity of evolving science with
respect to a mission concept, satellite mission, or satellite instrument activity (from this
point on referred to as “the mission activity”). This SRL Handbook is intended to provide
definitions of the various SRL levels and of the questions that must be addressed in a
Scientific Readiness Assessment (SRA). In addition, guidance on the required evidence is
provided for the individual SRLs.
The structure of this Handbook and the description of the SRAs follow the
“Technology Readiness Level Handbook” [RD-1].
2 Introduction
2.1 Overview
The ability to make informed, objective decisions concerning the selection of new
mission concepts, implementation decision, and preparatory scientific studies is essential
to respond to growing demands on scientific and technological progress in Earth
Observation (EO) Programmes. Accurate and timely ‘scientific readiness assessments’
(SRAs) are therefore important for the cost-effective and traceable management of
advanced scientific R&D portfolios. Although an approach has been developed to assess the
“Technology Readiness”, no decision support tools exist for the evaluation of the “Scientific
Readiness” through the life cycle of an EO mission, spanning the evolution from pre-Phase
0 to Phase F [RD-2]. A critical step in the process of assessing scientific maturity, however,
is the consistent assessment of the scientific maturity of a mission activity in parallel to its
implementation in, or exploitation of, new mission concepts.
Earth Observation missions that address new scientific objectives inevitably face
four major challenges during implementation and operation:
Page 3/22
1. Developing a theoretical understanding of the relationship between the
measured quantity and the geophysical parameter to be observed;
2. Collecting observational evidence that this relationship between
measurement and geophysical parameter exists;
3. Maturing the readiness of a scientific user community to process and exploit
the measurements obtained from the new observing system;
4. Demonstrating the impact of a new measurement type for science,
applications, and society.
While challenges (1) and (2) should primarily being addressed in the early phases of
an EO satellite mission prior to launch, challenge (3) and (4) can mainly be answered
during and/or after mission implementation, i.e. after launch. However, the readiness of a
user community and the data exploitation shall already be prepared before launch in the
earlier development phases.
The Scientific Readiness Levels (SRLs) defined in this handbook are intended to
provide a metric to support objective evaluation of maturity for a specified Mission Activity
and its specific scientific objectives.
TRLs can be defined for hardware and / or software components and it is possible to
apply a common metric with “hard” evaluation criteria. SRLs can be related to objective
milestones during mission development and implementation. In addition, peer-reviewed
literature provides a reference for scientific developments directly or indirectly related to
the scientific objectives and disciplines – independent of the mission implementation
process.
Page 4/22
Figure 3.1 provides a high-level illustration of the SRL scale in the context of the progression from basic research to
matured science in (operational) applications in relation to the Phases of an EO mission.
Page 5/22
demonstrated through extensive analyses by means of dedicated experiments but at least through
simulations.
1
Measurements could for example be provided through well-defined experiment or as proxy data
from existing measurement systems.
Page 6/22
Table 3.1-1 provides an overview of the Scientific Readiness Levels (SRLs) in a matrix structure, outlining scientific goals related to the Mission Activity.
Targeted
Name Associated
SRL Theory Experiments Users & Requirement Project
(ESA) documents (ESA)
Phase (ESA)
- A scientific challenge is
identified. - The application area is defined.
TBD – not yet - The scientific objective is - Interest of the users is identified.
1 Scientific Idea No observational evidence is required. Pre-Phase 0
available formulated. - Start defining high-level scientific
- A scientific hypothesis is requirements.
established.
- A scientific theory is formulated. - Consolidated scientific requirements
- The physical principle behind the are established.
Consolidation of TBD – not yet hypothesis is outlined (at least - Experimental evidence supporting - A gap analysis with respect to the
2 Pre-Phase 0
Scientific Idea available qualitatively). the scientific hypothesis. uniqueness of measurements and
observations is performed.
- Scientific objective are formulated.
- Initial capability assessment
Scientific / - Quantitative theoretical
Mission proposal performed. - Scientific objective confirmed and
Observation understanding of link between
3 for Phase 0 (Information content analysis) approved. Pre-Phase 0
Requirements measurement and observation (no
- Conceptual measurement technique - Scientific goal formulated.
Definition software required) is established.
is established. - Mission objective(s) formulated.
- First measurement device
- Simulation of measurements
approximating the instrument is
MRD / Report for based on geophysical parameters - Mission objective confirmed and
available in case possible for the
4 Proof of concept Mission (e.g. numerical forward model). translated into mission requirements Phase 0
measurement principle.
Assessment - 1st simulated measurements are and system requirements
- Sensitivity of measurements wrt
available.
observation is demonstrated.
Stable MRD, E2E - Demonstrator (e.g. airborne
End-to-end (End-to-end instruments) provides/simulates
- Consolidated retrieval and draft - First evaluation of observations and
5 performance simulator) / representative measurements with Phase A
ATBDs (+ prototype) are available / or measurements in applications,
simulations Report for error budgets,
- Higher-level products approached.
Mission Selection - Draft calibration strategy available.
6 Consolidated Final ATBD’s, - Operational processor developed - Test data and sampled data - User studies with simulated or pre- Phase B/C/D
Page 7/22
science and DPMs, Cal/Val and implemented (Level 0, Level 1, processing cursor data;
products Plan and Level 2) - Verification data sets collected - AO call to user community for
(End: launch of sat) - Calibration and validation Plan validation
established
- Cal/Val conducted (L1 and L2)
Demonstrated - Early release of first data /
science Commissioning demonstrational data are provided - User feedback collected,
7 - First uncertainty analysis Phase E1
(Commissioning report - Characterisations of measurements - Feedback from beta-users received.
phase) and observations;
- Performance vs. specification
Validated and - Full uncertainty analysis - Systematic validation and quality - Science impact quantification,
Science feedback,
matured science - Enhancing scientific assurance performed - first performance assessment wrt
8 peer reviewed Phase E2
(Satellite declared understanding - Operational / nominal processing of mission objective
publications
operational) measurements and observations - scientific goal evaluation
- User impact quantification,
- Advancing scientific
- Final performance assessment wrt
Science Impact understanding and addressing its - Generation of long-term data sets
9 TBC mission objective Phase F
quantification impact for scientific and societal - Data fusion
- Final performance assessment wrt
applications
science objective
Page 8/22
4 Scientific Readiness Assessment (SRA) Implementation Guidelines
4.1 Overview
4.1.1 Introduction
The following section provides a standard, internally consistent set of guidelines for
the use of the SRLs when conducting Scientific Readiness Assessments (SRAs). A
description of a typical process for conducting SRAs is provided, which is then followed by
a series of detailed guidelines for SRAs, one for each SRL.
• Definition of the terms of reference (ToR) for the assessment (including timing, how
and which inputs for the SRA are provided, the detailed criteria for the SRA,
establish qualification criteria for SRL, etc.).
• Identification of key supporting documents and data.
• Identification of SRA participants (appropriate involvement of scientists).
• Invitation and appointment of SRA Review Board.
• Development and delivery of scientific material for the SRA to the Review Board.
• Implementation of the SRA itself (often involving one or more meetings of a formal
review committee).
• Development of the SRA qualification report by the Board, including SRA
recommendation.
Specific qualification criteria for the SRLs are used when conducting a formal scientific
readiness assessment that conform to the SMART approach:
Page 9/22
A given SRL is only achieved (and thus progressing to the next SRL level) after all of the
qualification criteria are addressed for that SRL level - and not before.
Figure 4.1.2 indicates a linear process for a generic scientific readiness assessment, including four elements for the SRA. Throughout
this process, similar types of information should be examined to establish that a given SRL has / has not been achieved.
Page 10/22
4.1.3 Independent Review and Validation of SRA Results
As science maturation continues, it becomes increasingly important to implement an
independent review and to validate the results presented for a scientific readiness
assessment. As a general guideline, the demonstrated scientific competence of the a review
board shall allow a thorough scientific review of the inputs for the SRA, namely the
“Description” and the “Problem Understanding”. Depending on the SRL under
consideration, a different level of detailed understanding can be required.
Page 11/22
4.2 SRL 1: Initial Scientific Idea
An idea combined with a general scientific objective is stated and a scientific hypothesis is
presented. An interest from the (scientific community) users has been expressed and high-
level user requirements are created. The idea can still be decoupled from specific mission
activity objective or a specific measurement concept. The scientific idea can also be based
on a problem statement.
Targeted at Pre-Phase 0.
Page 12/22
4.3 SRL 2: Consolidation of Scientific Idea
Scientific evidence and supporting scientific theories are established answering one or
more scientific ideas. This could for example be done based on theoretical grounds or
through laboratory experiments. Observations and theories are linked to the consolidated
user requirements and / or the problem statement. The scientific strategy to address the
scientific challenge is defined
Targeted at Pre-Phase 0.
Page 13/22
4.4 SRL 3: Scientific and Observation Requirements
A first iteration on top-level scientific and observation requirements, e.g. product accuracy
and temporal and spatial sampling, is performed and mapped against the user
requirements. During this process a justified selection of the conceptual measurement
technique(s) is developed based upon derived observational requirements.
Page 14/22
4.5 SRL 4: Proof of concept
The measurement concept is validated. A model linking geophysical parameters and
measurements is established. Sensitivity of the measurements to the targeted geophysical
parameter is demonstrated through extensive analyses by means of dedicated experiments
but at least through simulations.
Page 15/22
4.6 SRL 5: End-to-End Performance simulations
An end-to-end measurement performance simulator is developed, tested and validated
using realistic and / or actual measurements 2. The performance model used is applicable to
a predefined range of conditions (including realistic uncertainties of natural and
observational nature) and can be used to address the needs originating from the science
requirements in an end-to-end manner. Retrieval algorithms applicable for a realistic range
of error sources (both geophysical and technical) are demonstrated against a pre-defined
performance metric reflecting observation and measurement requirements.
2
Measurements could for example be provided through well-defined experiment or as proxy data
from existing measurement systems.
Page 16/22
4.7 SRL 6: Consolidated Science and Products
Consolidated geophysical retrievals are established and implemented. These are Level 1,
Level 2, and higher order algorithms providing measurements, observations and
uncertainty estimates that directly respond to the Mission Activity measurement and
observation requirements.
Page 17/22
4.8 SRL 7: Demonstrated Science
Retrieval algorithms verified using real mission activity measurements. Retrieval
uncertainties are provided and mapped against the measurement and observation
requirements of the Mission Activity.
Page 18/22
4.9 SRL 8: Validated and Matured Science
Data products have been systematically generated and disseminated. The Mission Activity
scientific goals and objective are tested and evaluated. The scientific aim is tested. Science
linked to the Mission Activity is advancing leading to a growing scientific community, new
applications, and new scientific insights.
Page 19/22
4.10 SRL 9: Science Impact Quantification
The measurements and observations have been re-processed ensuring high quality data sets. The
scientific aim and objective of the Mission Activity are evaluated. The end-to-end scientific impact
across the Mission Activity with respect to the user requirements is assessed and quantified. The
requirements have been revised and based on the outcome future strategies are being discussed.
5 References
RD-1 Technology Readiness Levels Handbook for Space Applications, TEC-SHS, TEC-
SHS/5551/MG/ap, Version 1, revision 6, September 2008
RD-2 ECSS-M-ST-10C, available under https://www.skatelescope.org/public/2011-11-
18_WBS-SOW_Development_Reference_Documents/ECSS-M-ST-
10C_Rev.1%286March2009%29.pdf
Page 20/22
6 Appendix A
Definitions:
Algorithm Theoretical Baseline Documents refer to the Level 0, 1 and 2
ATBDs processors.
Derived geophysical variables (e. g., ocean wave height, soil moisture, ice
Level 2 concentration) at the same resolution and location as Level 1 source data.
Page 21/22
Observation Data at level 2 and higher, i.e. geophysical parameters.
Observation A requirement related to a geophysical parameter at level 1,2 (or higher)
requirement needed to address a science requirement.
Science A requirement related to a scientific question and a scientific objective.
requirement
System A requirement related to any hardware or software of the Observation or
requirement Processing System.
Page 22/22