How Do Companies Report Sustainaility
How Do Companies Report Sustainaility
Ortiz-de-Mandojana, N.
Antolín-López, R.
2023
This publication is a report by the Joint Research Centre (JRC), the European Commission’s science and knowledge service. It aims to provide
evidence-based scientific support to the European policymaking process. The contents of this publication do not necessarily reflect the
position or opinion of the European Commission. Neither the European Commission nor any person acting on behalf of the Commission is
responsible for the use that might be made of this publication. For information on the methodology and quality underlying the data used
in this publication for which the source is neither Eurostat nor other Commission services, users should contact the referenced source. The
designations employed and the presentation of material on the maps do not imply the expression of any opinion whatsoever on the part
of the European Union concerning the legal status of any country, territory, city or area or of its authorities, or concerning the delimitation
of its frontiers or boundaries.
Contact information
Name: Natalia Ortiz-de-Mandojana
Address: Campus de la Cartuja, s/n. Facultad de Ciencias Económicas y Empresariales. Universidad de Granada, Spain.
Email: [email protected]
EU Science Hub
https://joint-research-centre.ec.europa.eu
JRC132579
The reuse policy of the European Commission documents is implemented by the Commission Decision 2011/833/EU of 12 December 2011
on the reuse of Commission documents (OJ L 330, 14.12.2011, p. 39). Unless otherwise noted, the reuse of this document is authorised
under the Creative Commons Attribution 4.0 International (CC BY 4.0) licence (https://creativecommons.org/licenses/by/4.0/). This means
that reuse is allowed provided appropriate credit is given and any changes are indicated. For any use or reproduction of photos or other
material that is not owned by the European Union, permission must be sought directly from the copyright holders.
How to cite this report: Ortiz-de-Mandojana, N., Antolín-López, R., How do companies measure and report corporate sustainability? A
comparison among the most innovative European companies, Publications Office of the European Union, Luxembourg, 2023,
doi:10.2760/935191, JRC132579
Contents
i
Abstract
The field of measuring and reporting corporate sustainability (CS) practices currently faces relevant challenges.
First, although important steps have been taken towards transparency in reporting CS practices, there is still
significant flexibility in terms of the international sustainability frameworks that guide the reporting, the key
performance indicators (KPIs) that need to be included, and even the specific aspects that must be reported.
Second, there is a wide range of CS metrics rooted in different methodologies and assumptions that still lack
standardization and convergence. These two challenges make it difficult to compare companies and understand
their evolution towards greater sustainability. Based on these challenges in measuring and reporting CS
practices, this study has two objectives: (1) analysing companies’ CS reporting to determine the trends in terms
of the terminology, EU regulations, international sustainability frameworks, ratings and indices, KPIs, and
materiality approaches used, and (2) comparing the CS metrics of some of the most relevant rating agencies
to identify their similarities and differences. To achieve these objectives, we collected data on the 250 EU
companies ranked better in the 2021 EU Industrial R&D Investment Scoreboard. Overall, this work aims to
contribute to advancing greater homogenisation in the measurement and reporting of CS.
1
Acknowledgements
The authors would like to thank the team of the Directorate Growth and Innovation of the Joint Research Centre
(JRC) of the European Commission based in Sevilla, especially Nicola Grassano and Clemens Domnick.
Authors
Natalia Ortiz-de-Mandojana, University of Granada
Raquel Antolín-López, University of Almería
2
Executive summary
Aim of the study
The field of measuring and reporting Corporate Sustainability (CS) practices currently faces relevant challenges.
The previous JRC report “Measuring and disclosing environmental, social and governance (ESG) information and
performance” by Antolín-López and Ortiz-de-Mandojana (2023) highlighted two main issues. First, although
important steps have been taken towards transparency in reporting CS practices, there is still significant
flexibility in terms of the international sustainability frameworks that guide the reporting, the key performance
indicators (KPIs) that need to be included, and even the specific aspects that must be reported. Second, there is
a wide range of CS metrics rooted in different methodologies and assumptions that still lack standardization
and convergence. These two challenges make it difficult to compare companies and understand their evolution
towards greater sustainability.
Based on these challenges in measuring and reporting CS practices, this study has two objectives. First, we aim
to identify and understand current trends in CS reporting among the most innovative companies in the European
Union (EU). Specifically, we perform text analyses to identify trends in terms of the use of terminology to refer
to CS issues, EU regulations acknowledged, most cited international sustainability frameworks, environmental,
social, and governance (ESG) ratings and indices mentioned, the ESG key performance indicators (KPIs) used,
and the CS materiality approaches adopted. Second, we analyse the most popular metricsto measure CS
performance to discern similarities and incongruencies and contribute to a greater understanding of the state
of the art in CS measurement. Our comparative analysis of the Refinitiv ESG Scores, Sustainalytics’ ESG Risk
Ratings, S&P Global Sustainability Yearbook, RepRisk Index (RRI), Global 100 Index, and the Top 100 World’s
Most Ethical Companies enabled us to draw interesting conclusions about the high diversity and incongruencies
that currently exist in CS metrics. To achieve both goals, this study focused on the most innovative EU companies
that were extracted from the top ranked companies of the EU Industrial R&D (Research & Development)
Investment Scoreboard developed by the European Commission in 2021. Innovative companies are a good
context for analysis, as they are attentive to the environment and change.
With the development of these two objectives, this work aims to contribute to advancing greater
homogenisation in the measurement and reporting of CS.
Policy context
The EU has demonstrated a strong commitment to sustainable growth by committing to the Sustainable
Development Goals (SDGs) on the United Nations and climate-related goals of the Paris Agreement, and
incorporating them into the European Green Deal and Action Plan on Financing Sustainable Growth. European
regulations are currently in full swing, with new regulations coming into full force by 2022 and 2023.
Among previous main milestones, we can highlight the Non-financial Reporting Directive (NFRD), which has
been enforced since 2018 on large public-interest companies that requires companies to disclose non-financial
information such as measures taken regarding environmental and social matters, treatment of employees
(Directive 2014/95/EU). Another milestone is the Sustainable Finance Disclosure Regulation (SFDR), established
in 2021 to set sustainability-related disclosure requirements for financial market participants, financial
advisers, and financial products (Regulation EU 2019/20881). Additionally, we can mention the proposal of the
Corporate Sustainability Reporting Directive (CSRD), which is enforced on all large companies and all companies
listed on regulated markets (except listed micro companies) and introduces more detailed reporting
requirements and mandatory reporting. Finally, we highlight the EU Taxonomy Regulation (Regulation (EU)
2020/852) and the EU Taxonomy Climate Delegated Act, which are related to a classification system based on
scientific criteria establishing a list of environmentally sustainable economic activities.
Main findings
This study delivers interesting trends in CS reporting and identifies relevant CS measurement divergencies
among a sample of the most EU innovative companies.
With regards to CS reporting, our results revealed important trends related to a lack of homogeneity in how CS
reports are coined, the type of information included, and how CS information is disclosed. Such divergencies
could be solved by establishing clearer recommendations and global standards which would enable
stakeholders to locate this information more easily, thereby improving access and transparency in terms of CS
reporting and the benchmark of companies. KPIs are a key aspect in advancing reporting quality and should be
more standardised, at least the most relevant ones. Additionally, it is important to differentiate between the
levels of different KPIs and make KPIs more actionable for measurement (for example, emissions vs. climate
3
change). EU regulations such as the EU Taxonomy will help achieve this goal. Finally, we identified that the
references to materiality are still very limited. Companies must understand and clarify the double materiality
of their activities, i.e. their CS reporting and measurement must allow for the identification of not just the
impacts social and environmental issues may have on their financial aspects, but also the impact the company
has on global sustainability.
Concerning the analysis of the CS metrics of the most innovative EU companies, our results revealed that the
analysed rating agencies differ in how their metrics evaluate the CS performance of companies, existing great
differences in the companies placed in top positions by their rankings. The rankings divergencies can be
explained by the fact that the different CS metrics deeply differ in their conceptualization and purpose.
Therefore, the value of the CS metrics depends on whether the stakeholder uses them to gain a thorough
understanding of the assumptions on which each CS measure is built and what each measure represents.
Indeed, some CS metrics can be used in a supplementary manner, given that the approach and focus of existing
CS metrics differ considerably.
We hope that in the future greater clarity and standardisation will be developed in CS reporting and
measurement to allow for a more effective comparison among companies and the improvement of their
monitorisation and evolution. Eventually, it could ensure greater sustainability in companies, and overall, global
sustainability.
4
1 Introduction
Measuring and reporting corporate sustainability (CS) practices are central to advancing global sustainable
development. Companies should align their strategies, and measure and communicate their contributions to
global sustainability (SDG Compass, 2015). Many different stakeholders also need instruments to evaluate and
compare CS practices. For example, financial market players may evaluate where to invest responsibly and
NGOs may offer their support to the most sustainable companies and collaborate to help spread change.
Despite the importance of measuring and reporting CS practices, currently, this field has relevant challenges. In
the European context, important steps have been taken towards transparency in reporting CS practices, such as
with the Non-financial Reporting Directive (NFRD) (Directive 2014/95/EU) and the European Union (EU)
Taxonomy Regulation (Regulation (EU) 2020/852). However, European regulations for reporting CS information
still offer significant flexibility to companies in terms of international frameworks that guide the report, key
performance indicators (KPIs) that need to be included, and even the specific aspects that must be reported.
This flexibility, while enabling companies to tailor their reporting to their idiosyncratic conditions, also makes it
more difficult to compare companies and understand their evolution towards greater sustainability. In fact,
linked to the flexibility in company CS reporting, there is a challenge related to the wide range of proposed CS
measures, with a lack of standardisation among these instruments. Antolín-López and Ortiz-de-Mandojana
(2023) concluded that CS metrics and the rating market are dominated by a few big clusters of rating agencies,
such as Moody’s ESG Solutions, London Stock Exchange Group (LSEG) (which integrated Refinitiv), Morningstar
Group (Sustainalytics), and Standard & Poors (S&P). Although the rating market is concentrated, these rating
agencies use different methodologies and assumptions and their resulting CS measures do not always converge
(Berg et al., 2019; Chatterji et al., 2016; Christensen et al., 2022).
Considering these two major challenges in measuring and reporting CS practices, this study has two objectives.
First, we analyse companies’ CS reporting to determine the trends in terms of the terminology used to refer to
CS issues, the EU regulations acknowledged, the most cited international sustainability frameworks, the
environmental, social, and governance (ESG) ratings and indices followed, the KPIs used, and the approach to
the materiality of the CS aspects adopted. Second, we compare CS measurement instruments including the
metrics of some of the most relevant rating agencies, such as Refinitiv ESG Scores, Sustainalytics’ ESG Risk
Ratings, and the S&P Global Sustainability Yearbook, and a measure of ESG risk exposure on the media, such
as the RepRisk Index (RRI), along with important indices such as the Global 100 Index and the 100 World’s Most
Ethical Companies ranking to identify their similarities and differences. With the development of these two
objectives, this work aims to contribute to advancing greater homogenisation in the measurement and reporting
of CS.
To achieve these objectives, we have focused on the most innovative EU companies. The EU has demonstrated
a strong commitment towards sustainable growth by committing to the sustainable development goals (SDGs)
and climate-related goals of the Paris Agreement and translating them into the European Green Deal and Action
Plan on Financing Sustainable Growth. While Europe is a pioneer in promoting CS reporting, countries such as
the United States are currently in a phase of intense debate regarding what type of information should be
required from companies in their mandatory reports (Jebe, 2019; Securities and Exchange Commission, 2022).
Among all the EU companies, we analysed only those ranked at the top of the EU Industrial R&D (Research &
Development) Investment Scoreboard (hereinafter the EU R&D Scoreboard), developed by the European
Commission, in 2021. Innovative companies are a good context for analysis, as they are attentive to the
environment and change.
The remainder of this paper is structured as follows. Section 2 details the methodology used to achieve the
objectives. In Section 3, we discuss the analyses related to CS reporting. In Section 4, we illustrate the analyses
related to the comparison of different CS metrics. Finally, Section 5 presents a discussion of the results and the
derived conclusions.
5
2 Methods
Table 1. Country distribution in the 250 EU R&D Scoreboard and both sub-samples
The country with the highest number of companies included in both subsamples is Germany, with 78 cases in
the CS reporting analysis sample and 51 in the CS metrics analysis sample. This corresponds to the fact that
32.80% of the top 250 companies in the EU R&D Scoreboard are German. The next most represented countries
are France with 39 and 36 companies and the Netherlands with 25 and 21 companies in the CS reporting
analysis sample and the CS metrics analysis sample, respectively. Again, these two countries are ranked second
and third in terms of the number of companies positioned among the top 250 in the EU R&D Scoreboard.
Regarding the industry distribution, we have described the sub-samples based on NACE Rev. 2 classification
available for the analysed companies in Bureau van Dijk's Orbis database. Among the most frequently occurring
industries, we find companies from the following sectors: services (NACE 70–74, NACE 82, and NACE 93),
pharmaceuticals (NACE 21), manufacturing of computers, electronics, and optical products (NACE 26), and
manufacturing of motor vehicles and other transport (NACE 29 and NACE 30). We note that many service
companies present missing values in the CS metrics analysis subsample, which could be due to these companies
receiving less attention than industrial firms do, as they have less of an environmental impact.
6
Table 2. Industry distribution of the 250 top-ranked companies in the EU R&D Scoreboard and the two sub-samples
CS reporting CS metrics
Industries EU R&D
sample sample
Denomination NACE Freq. % Freq. % Freq. %
Rubber, plastics, and other non-metallic minerals 22–23 7 2.80 6 2.52 5 2.72
To collect information about CS reporting, we first identified where each company had published information
about their CS practices in 2021 (except for six companies, for which we used the 2020 report, as it was the
most recent one available). We found a lack of homogeneity in CS reporting, specifically, in how companies
publish CS information (i.e. integrated with financial information versus published in a separate report) and in
the titles of reports. Table 3 illustrates the differences in CS reporting. First, we found that 61.35% of the
companies published CS information in specific CS reports, separated from financial information, whereas only
38.66% integrated CS and financial information in a single report. However, some companies among the
61.35% that published separate reports also published an integrated report with CS and financial performance
information. In these cases, we selected the specific CS reports if they were more detailed and complete than
the integrated report. On the contrary, when the companies developed only partial reports about a particular CS
aspect (e.g. biodiversity report or climate change report), we used the integrated report instead because it
provided a more holistic picture of all the activities executed in terms of sustainability. After searching for CS
information, 12 companies were removed from the sample because no report with CS information was found.
Thus, our sample was reduced to 238 EU companies.
Second, in addition to differences in terms of integrating CS with financial information, we found great
heterogeneity in the names used to coin reports. For example, for CS-related reports, we found the most
7
common title to be ‘Sustainability Report’, used in 29.41% of the cases. Approximately 7.56% of the companies
titled these as ‘Non-financial Reports’, using the nomenclature of the NFRD. Other alternatives include the ‘ESG
report’ and ‘CSR report’ (Corporate Social Responsibility report). The different nomenclatures of CSR, ESG, and
sustainability demonstrate the lack of homogeneity when referring to these topics; similar concepts exist but
have different connotations (Antolín-López and Ortiz-de-Mandojana, 2023). We also found a few companies
coining their CS-related report as ‘People and Planet Report’, ‘Tomorrow Report’, or ‘Sustainability Day Report’,
among others.
We also identified many variations in the naming of integrated reports. The most commonly employed terms
were ‘Integrated Annual Report’ and ‘Annual Report’, used by 11.76% and 12.61% of the companies in the
sample, respectively. ‘Universal Registration Document’ was used by 4.52% of the companies. We found other
companies using names such as ‘Annual and Sustainability Report’ or other less intuitive names such as ‘Group
Report’ or ‘Consolidated Management Report’. In these cases, we checked whether the company also included
information on sustainability, even though it was not referred to in the name of the report.
Others (e.g. People and planet report, sustainability day report, etc.). 30 12.61
Regarding the CS metrics, we searched the companies in the Refinitiv ESG Scores database, Sustainalytics’ ESG
Risk Ratings, and S&P Global Sustainability Yearbook. We supplemented the sample with information from the
RRI, 2021 Global 100 Index, and Top 100 World’s Most Ethical Companies in 2021. The lack of information
about CS metrics for some companies reduced the initial sample size of 250 to 184 European companies.
Except for the RRI, all other data are currently available free of charge on the websites of rating agencies and
other providers. In the case of the RRI, the data were obtained from Bureau van Dijk's Orbis database belonging
to Moody's analytics.
The Refinitiv ESG database covers over 12,000 public and private companies globally. The Refinitiv ESG Score
results are from the collection of over 630 ESG indicators by independent analysts, which represent 10 key
sustainability aspects, such as resource use, emission, human rights, and product responsibility. Companies'
scores are contrasted with those of their industry peers.
8
Sustainalytics’ ESG Risk Ratings comprise a universe of more than 14,000 publicly listed companies. The ESG
Risk Ratings are created with publicly reported data covering approximately 350 indicators that represent 30
ESG criteria. The ratings consist of a quantitative aggregated score that serves to group companies into five
risk categories according to the risk that key ESG factors pose for companies, from negligible (enterprise value
has a Negligible Risk of material financial impacts driven by ESG factors) to severe.
Being listed in the S&P Global Sustainability Yearbook is a distinction earned by companies that excel in
sustainability performance, assessed using the S&P Global ESG score tool, among a range of approximately
8,000 publicly listed companies. Companies with the best ESG scores are distinguished within the Gold, Silver,
and Bronze classes. The remaining companies that do not receive a medal distinction are still listed as
sustainability yearbook members if they are among the top 15 in their industry (S&P Global, 2022).
The RRI dataset includes more than 210,000 companies associated with risk incidents. The RRI captures
company-specific reputational risks related to ESG issues. The RRI of a company depends only on its risk
incidents; thus, it reflects a company’s actual risk management instead of its communicated goals and policies.
The RRI ranges from zero (lowest) to 100 (highest), with higher values indicating higher risk exposure (RepRisk,
2022).
The Global 100 Index, developed by Corporate Knights, ranks the world’s 100 most sustainable corporations
annually. Their assessment included nearly 7,000 public companies, with revenues of over 1 billion US dollars.
The assessment is based on data for 23 KPIs, such as clean investment, representation of female directors, and
carbon emissions.
The Top 100 World’s Most Ethical Companies is a list developed yearly by Ethisphere. The rating system is
rooted in more than 100 multiple-choice and text questions aimed at capturing a company’s performance,
grouped into five categories: governance, leadership and reputation, culture of ethics, ethics and compliance
programs, and environmental and societal impacts. Companies with the best results are included as honourees
for the corresponding year.
9
3 Text analysis of CS reporting
In this section, we present and discuss the results of the text analysis performed using the statistical software
Nvivo. Specifically, we analysed the differences in terms of (1) the types of terms used to refer to CS activities,
(2) EU regulations, (3) international sustainability frameworks, (4) ESG ratings and indices reported, (5) KPIs
included, and (6) the types of materiality approaches.
A complete set of goals that needs to be Environmental, social, Highlight urgent global sustainability
SDGs achieved to ensure sustainable development at economic, and challenges and ensure a sustainable future
a global level. governance for all.
Source: Antolín-López and Ortiz-de-Mandojana (2023)
Table 5 presents the frequency of use of these terms in the reports we analysed of the European companies.
The results of our text analysis illustrated that the term 'SDG' was used most frequently in the 2021 reports,
followed by the term 'ESG', as 87.82% and 83.19% of the documents referred to the two terms, respectively.
Surprisingly, the most traditional term, 'CS', was mentioned in only 41.60% of the documents. These terms
seem to confirm the increasing popularity of SDGs as the main framework of action to integrate sustainability
at the firm level (Delgado-Ceballos et al., 2023, Montiel et al., 2021). This also indicates the prominence gained
by the term 'ESG', which was originally coined by finance academics and practitioners, the use of which has
recently extended to the business field to refer to sustainability actions and performance (Antolín-López and
Ortiz-de-Mandojana, 2023).
10
although Antolín-López and Ortiz-de-Mandojana (2023) identified a few key milestones of vital importance.
Specifically, among these milestones, we can highlight the NFRD, which has been enforced since 2018 on large
public-interest companies with more than 500 employees, including listed companies, banks, insurance
companies, and other companies designated by national authorities as public-interest entities. This regulation
requires companies to disclose non-financial information such as measures taken regarding environmental and
social matters, treatment of employees, respect for human rights, anti-corruption and bribery, and diversity on
company boards (Directive 2014/95/EU). Another milestone is the sustainable finance disclosure regulation
(SFDR), which was established in 2021 as sustainability-related disclosure requirements for financial market
participants, financial advisers, and financial products (Regulation EU 2019/20881). This regulation is completed
with the regulatory technical standards set out in the Delegated Regulation to be used by financial market
participants when disclosing under the SFDR. Additionally, we can mention the proposal of the Corporate
Sustainability Reporting Directive (CSRD), which is enforced on all large companies and all companies listed on
regulated markets (except listed micro companies). This newly proposed directive is a response to some of the
problems detected in the NFRD in its extension of the scope of its application and introduction of more detailed
reporting requirements and mandatory reporting. Finally, we highlight the EU Taxonomy Regulation (Regulation
(EU) 2020/852) and the EU Taxonomy Climate Delegated Act, which are related to a classification system based
on scientific criteria establishing a list of environmentally sustainable economic activities. The aim is to provide
companies, investors, and policymakers with appropriate and clear definitions of the economic activities that
can be considered environmentally sustainable.
We focus on the text analyses of these EU regulatory milestones. Table 6 shows the frequency with which the
companies refer to each regulation. The EU Taxonomy is receiving special attention in CS reporting, with 66.39%
of the companies including references to it in their 2021 reports. For the text analysis, we searched for ‘EU
taxonomy’ and ‘taxonomy’, as it is sometimes referred to in this simplified way, but in reference to EU regulation.
It is also noteworthy that 14.29% of the companies named the CSRD, as this is still at the proposal stage. This
shows the proactivity of some companies in the sample.
11
reference the United Nations Global Compact (UNGC), and 47.90%, the Sustainability Accounting Standards
Board (SASB) standard.
IRIS+ 13 5.46 32
OECD Guidelines Organisation for Economic Co-operation and Development Guidelines 93 39.08 172
Therefore, this text analysis draws attention to the fact that although there is a lot of freedom in the frameworks
to be used in reporting, most companies focus on a few international frameworks (i.e. SDGs, GRI, UNGC, and
SASB). Additionally, we found that specific environmental frameworks were more commonly used than social
frameworks.
Regarding the specific frameworks, Table 7 shows that those related to the environment were cited much more
frequently than those related to the social dimension. Frameworks related to the environment were referenced
at a similar level, with approximately 65% of the companies using each framework. Regarding the social
dimension, references to the Universal Declaration of Human Rights (UDHR) (37.39%) far exceeded references
to the International Labour Organization (ILO) (4.20%). These results might indicate that many companies still
associate sustainability with environmental issues and not so much with social issues, which have been
traditionally more associated with CSR.
12
Among the ESG ratings, the most referenced was Moody’s ESG (or Vigeo-Eiris) but only 12.61% of the analysed
companies cited it. The most referenced indices are FTSE4Good with 23% of companies referencing it in their
reporting followed by the ‘Dow Jones Sustainability Indices’ (or DJSI) with 7.14% and the ‘STOXX Global ESG
Leaders’ with 5.46%.
13
3.5 KPIs included in CS reporting
The inclusion of KPIs in CS is of particular significance. In fact, the Guidelines on Non-Financial Reporting, which
specify the methodology for reporting non-financial information, highlight that companies can improve their
comparability by disclosing high-quality and broadly recognised KPIs, such as metrics that are widely used in a
sector or for specific thematic issues (European Commission, 2017). The importance of KPIs is illustrated by the
fact that this document introduces many examples of KPIs along with the guidelines.
To analyse the most frequently used KPIs, we first developed a dictionary of possible KPIs and then analysed
the occurrence frequency of these indicators. This dictionary was compiled after an extensive review of the
literature, although we recognise that other frequent indicators may not be included in this analysis. We divided
the analysis into indicators or concepts related to ESG issues.
Table 9 lists the environmental KPIs. The most frequently mentioned KPIs are those related to ‘emissions’, with
96.64% of the documents mentioning the general term, 62.18% mentioning ‘carbon emissions’, and 78.57%
referring to ‘GHG emissions’. Additionally, there is a predominance of indicators related to ‘energy’, such as
‘energy efficiency’ (84.45% of the documents) and ‘renewable energy’ (86.55%). ‘Climate change’ has also been
indicated multiple times, with 95.80% of companies including references to this term. These figures might be
explained by the prominence these terms have gained in the media and institutional environments worldwide
with regard to other environmental aspects in recent years. In fact, these are the main indicators addressed by
the environmental agendas of EU governments. While both emissions and energy use are clear and highly
representative indicators of the company's impact on the environment, we recognise that the reference to
climate change is much more global and difficult to judge since this term represents a category of indicators
(i.e. those related to the company's impact on climate change) rather than an indicator or KPI.
14
Source: Elaborated by the authors
In relation to the least frequently occurring KPIs, it is worth noting the negligible presence of innovation-related
indicators, such as ‘environmental innovation’, ‘environmental products’, ‘green products’, ‘product stewardship’,
and ‘sustainable innovation’. Since these are among the top 250 companies in the EU R&D Scoreboard, we
expected to find more indicators related to proactive CS practices. Finally, we note the infrequency with which
the CS reports allude to negative events related to environmental management, such as environmental incidents
and environmental fines, with only 11.34% and 3.36%, respectively, of the documents mentioning them. These
results align with scholars' claims of companies reporting only positive actions related to the natural
environment while omitting their negative environmental impacts, which is termed as greenwashing (e.g. Wang
et al., 2018).
Table 10 lists the social KPIs. In this case, the most common KPIs are those related to employees, such as
‘health’ (99.58%), ‘health and safety’ (91.60%), ‘working conditions’ (73.53%), and ‘diversity’ (97.06%).
Furthermore, references to ‘human rights’ (92.86%) are very common, which is reasonable, as this reflects the
company's respect towards all stakeholders.
Finally, Table 11 includes corporate governance KPIs. Of the KPIs analysed, the most frequently occurring one
is ‘risk management’, with 92.02% of the companies including this expression in their reports. This indicates the
general inclination of companies to pay attention to those ESG aspects that have a particular risk of impact on
the company. References to ‘anti-corruption’ (83.61%) and ‘ethics’ (90.34%) are also very common in the
analysed reports.
Citing documents
Terms Number of citations
N %
Anti-corruption 199 83.61 1,787
Tax transparency 25 10.50 44
Corporate governance 200 84.03 7,435
Risk management 219 92.02 6,698
Ethics 215 90.34 5,659
Source: Elaborated by the authors
15
Greater standardisation in the use of KPIs would be beneficial in advancing the quality of CS reporting. Although
we detected a clear trend in the presence of important indicators such as those related to a company's impact
on climate change, health, diversity, and human rights, there is still too much diversity in CS reporting. In the
following years, thanks to EU Taxonomy, it will probably become easier to find more general and homogeneous
indicators, which will enable comparability among companies in terms of their CS actions and performance.
Financial materiality
16
Financial materiality 13 5.44 27
Financially material 18 7.53 21
Economic materiality 1 0.42 3
Material sustainability risk or ‘material risk’ or ‘material environmental risk’ or
29 12.13 48
‘material social risk’ or ‘material ESG risk’
Total number of documents citing any form of sustainable financial
51 21.34 99
materiality
Double materiality
Clear references to double-materiality CS should be made in reporting. Using SDGs as a reporting framework
can help cover sustainability materiality by connecting the activities of companies with specific global
sustainability goals (Delgado-Ceballos et al., 2023). However, using only the sustainability materiality approach
is insufficient, as it is also important that companies connect their CS measurement and reporting with financial
materiality because this approach helps ensure that social and environmental issues are not considered
ancillary to company activities, but as part of its main valuation (Jebe, 2019). Therefore, the use of a double
materiality approach is required in CS reporting since it can ensure that companies pay attention to and
communicate those aspects of CS that could affect the company financially and also consider and communicate
their roles in global sustainability.
17
4 Analysis of the divergences in measuring CS
In this section, we describe the comparison results of different CS metrics from a sample of the top 250
companies in the EU R&D Scoreboard. Specifically, we analysed two different quantitative ESG ratings: the
Refinitiv ESG Scores and the Sustainalytics’ ESG Risk Ratings. We also analysed listing in the S&P Global
Sustainability Yearbook, a distinction granted to companies with the best performance in each industry, and the
RRI, a measure of ESG risk exposure in the media. Finally, we supplemented the analyses with two corporate
sustainability indices: the Global 100 Index and the Top 100 World’s Most Ethical Companies. The following
analyses are mostly descriptive, paying special attention to the best-positioned companies in each case and
describing some basic descriptive measures, such as means, standard deviations, and comparison tests
conducted using Stata statistical software.
Table 13. ESG metrics and other indicators levels and qualitative meanings
Extremely
40 to 100 Severe Risk 75 to 100 High Risk
Exposure
Source: Adapted from Refinitiv (2022), Sustainalytics’ ESG Risk Rating (2022), S&P Global (2022), and RepRisk (2022)
The Refinitiv ESG Score comprises a subset of 186 metrics (from more than 630 company-level ESG metrics)
used to create an ESG assessment for a company. The selected metrics are stated as the most comparable and
material per industry. A materiality matrix was built for environmental and social factors based on the relative
proportion of a particular sector's contribution to the overall gross number of this factor in the complete ESG
universe. This methodology enables Refinitiv to produce an ESG score between 0 and 100, with high values
indicating a good ESG situation.
18
Sustainalytics’ ESG Risk Ratings are underpinned by three main dimensions known as the building blocks:
corporate governance, material ESG issues (MEIs), and idiosyncratic ESG issues. The final ESG risk rating is
created as the aggregation of the unmanaged risk scores of individual material ESG issues (the difference
between a company’s exposure and its managed risks). Sustainalytics’ ESG Risk Ratings are exclusively rooted
in financial materiality, as an issue is regarded as being material when it has a potentially significant impact
on the economic value of a company. This methodology enables Sustainalytics to produce risk ratings between
0 and 100, with high values indicating bad ESG risk situations.
Listing in the S&P Global Sustainability Yearbook is a distinction achieved by companies that stand out for their
sustainability performance, determined using the S&P Global ESG score tool, which ranges from 0 to 100. The
S&P Global Sustainability Yearbook evaluates the best-performing companies in each industry and
simultaneously requires a minimum level of performance to assign different distinctions (Gold, Silver, and
Bronze) or at least consider the company a member of the sustainable yearbook.
The RRI reflects the current level of media and stakeholder attention on companies' ESG performance on ESG
(RepRisk, 2022). RepRisk bases its analysis on media exposure, not on performance analysis, unlike previously
described metrics. RepRisk analyses documents for relevancy and sentiment scoring as well as entity detection
and issue classification, based on proprietary machine-learning models. The RRI requires no weighting of ESG
issues (e.g. by sector or country), and it does not change depending on whether an issue is an environmental,
social, or governance issue (RepRisk, 2022). The RRI produces an ESG score between 0 and 100, with low values
indicating a good ESG situation.
The Global 100 assessment is an index based on data for 23 KPIs, such as clean investment, female directors'
representation, and carbon emissions. In short, 12 possible categories are identified, from the best companies,
with scores of up to 75 points, to the worst, with 25–30 points. However, for this analysis, we focus only on
whether the company is included in the Global 100.
Finally, the rating system of the Top 100 World’s Most Ethical Companies is an index rooted in more than 100
multiple-choice and text questions aimed at capturing a company’s performance. These questions are grouped
into five distinct categories: governance (15 of the weight), leadership and reputation (10), culture of ethics
(20), ethics and compliance program (35), and environmental and societal impact (25). Companies with the best
results are included as honourees for the corresponding year.
As this study aims to understand the differences in CS metrics for the companies ranked best in the 2021 EU
R&D Scoreboard, Table 14 lists the CS metrics for the top 10 companies in this ranking.
19
Table 14. ESG indicators of the 10 best ranked European companies in the 2021 EU R&D Investment Scoreboard
20
Table 14 illustrates that the Refinitiv ESG Scores are very high for the top 10 ranked companies in the EU R&D
Scoreboard. In fact, excluding Robert Bosch, to which Refinitiv assigns a rating of ‘good’, all the companies are
evaluated as having excellent relative ESG performance and a high degree of transparency in publicly reporting
material ESG data. Regarding the Sustainalytics’ metric, the ESG Risk Rating of all top-ranked companies ranged
between low and medium risk. Notably, none of the best-positioned companies had a rating of ‘negligible’, which
would be the best evaluation. The RRI ranges between medium and high for the top 10 companies; this is not a
significantly positive evaluation. Finally, only five of these companies are included in the S&P Global Sustainability
Yearbook, four in the Global 100 Index, and none among the World’s Most Ethical Companies. Therefore, although
these companies have received high Refinitiv ESG Scores, their evaluations with regard to the other metrics are not
significantly positive.
As a representative example, we can focus on Volkswagen, a top R&D investment company. Table 14 shows that
while Refinitiv evaluates the company as having excellent performance and transparency in their reporting,
Sustainalytics evaluates the company as having a medium risk level and issues it an intermediate rating on its
financial risk scale (see Table 13). S&P Global does not evaluate Volkswagen as one of the best-performing
companies in its industry, as it has been excluded from the Sustainability Yearbook. Meanwhile, in terms of the RRI,
the company receives a high-risk exposure rating owing to ESG factors. Finally, neither of the two analysed indices,
the Global 100 Index and the World’s Most Ethical Companies, includes Volkswagen in their rankings. Therefore,
Volkswagen's final position with regard to these CS metrics is not easy the following sections, we try to better
understand the differences between CS metrics.
4.2 Comparison between the Refinitiv ESG Score and Sustainalytics’ ESG Risk
Ratings
In this section, we compare the two quantitative CS metrics included in this analysis: the Refinitiv ESG Score and
Sustainalytics’ ESG Risk Ratings. First, for each CS metric, we explain which of the 250 top-ranked companies in
the 2021 EU R&D Scoreboard are ranked best by each rating agency and how alternative ESG rankings rate the
same companies. Second, we compare both metrics based on percentiles to draw more generalisable conclusions
about the differences between the two CS metrics.
Table 15 shows the companies ranked best within the sample according to the Refinitiv ESG Scores. Most of these
top-ranked firms coincide with the top-ranked companies in the EU R&D Scoreboard. In fact, excluding the Italian
company Snam, all the top-ranked companies according to Refinitiv ESG Score are among the top 100 in the EU
R&D Scoreboard (of the 250 included in the initial sample).
2–4 Intesa Sanpaolo Italy 6419 Financial and insurance 93 48/250 15.4
21
Source: Elaborated by the authors
Additionally, the top seven companies are also companies that have been evaluated as low risk by Sustainalytics’
ESG Risk Rating. However, companies such as Basf and Volvo are considered medium risk in Sustainalytics’ ESG
Risk Ratings but are evaluated very positively by Refinitiv, specifically, as have excellent relative ESG performance
and a high degree of transparency in reporting material ESG data publicly.
Table 16 shows the best-ranked companies in Sustainalytics’ ESG Risk Ratings (i.e. those with the lowest risk). As
shown in this table, there is less overlap with the best-positioned companies in the EU innovation ranking. A clear
case of divergence is seen with the company Cimpress, ranked 241 out of 250 in the 2021 EU R&D Scoreboard.
Sustainalytics evaluates this company very positively, considering it negligible risk, while Refinitiv considers its
situation only as satisfactory relative to ESG performance and moderate relative to transparency in reporting
material ESG data publicly.
Although Tables 15 and 16 show some illustrative examples of divergences between these two CS metrics, we
present some descriptive statistics considering the entire sample to draw more generalisable conclusions about
the differences between these metrics. Tables 17 and 18 present the primary statistics. In Table 17, it can be seen
that the range of Refinitiv ESG Scores for the companies in the sample is between 30 (the worst) and 94 (the best).
Sustainalytics’ ESG Risk Ratings range between 42 (the worst) and 8.20 (the best). These metrics also differ widely
in mean value and standard deviation, with a mean of 73.58 for the Refinitiv ESG Scores versus 21.11 for
Sustainalytics’ ESG Risk Ratings. Therefore, according to Refinitiv, on average, companies are in a good (almost
excellent) position. However, in terms of Sustainalytics’ ESG Risk Ratings, companies are, on average, at an
intermediate-risk position.
Considering that both indicators differ in terms of methodology and interpretation of values, we can complete the
comparison between these two quantitative CS metrics based on percentile scores calculated as:
Number of companies with a worse value + (number of companies with the same value/2)
Number of companies with a value
We need to consider that, according to the interpretation of Sustainalytics’ ESG Risk Ratings, companies with low-
risk values are positioned as the best, while in terms of the Refinitiv ESG Scores, lower values indicate companies
with lower performance and less transparency. Therefore, to improve compatibility, we assign the best positions to
companies with the lowest risk scores when calculating the percentile positions for Sustainalytics’ ESG Risk Ratings.
With Refinitiv, higher values denote better positions; consequently, we assigned the highest percentiles to
22
companies with the highest score. Once the percentiles were constructed, we calculated the divergence measure
as the difference in the absolute value of a company's position in each ranking. Thus, we ensured a more
homogeneous comparison. Overall, there was a 29.14 percentile difference in the percentile positions of Refinitiv
ESG Scores and Sustainalytics’ ESG Risk Ratings.
Table 18 summarises the correlations between the top 250 EU R&D Scoreboard, the two CS metrics, and the
variable created to capture the divergence. Companies better positioned in the EU R&D Scoreboard have
significantly higher values according to Refinitiv (negative correlation, as in the R&D ranking; 1 refers to the best
position and 250, the worst). However, there does not appear to be a significant correlation between the R&D
Scoreboard and Sustainalytics’ ESG Risk Ratings, nor does there seem to be a correlation between the position of
a company in the EU R&D Scoreboard and the existence of greater divergences between the CS measures of
Sustainalytics and Refinitiv.
Table 18. Correlations among the 250 top-ranked companies in the EU R&D Scoreboard, CS measures, and divergence
We also analysed whether there are greater divergences between Refinitiv ESG Scores and Sustainalytics’ ESG Risk
Ratings for companies in some industries. Table 19 shows the means of the divergences and average percentile
positions of the companies by industry.
23
Other manufacturing 2 51.77 42.08 39.68 69.43
Water supply 2 12.91 0.20 45.66 45.51
Wood and paper 3 37.49 52.55 31.43 59.15
Source: Elaborated by the authors
As we can see in this table, according to Sustainalytics’ ESG Risk Ratings, agriculture is the most financially risky
industry, although only two companies from this industry are included in our sample. In terms of Refinitiv ESG
Scores, inferior companies in terms of ESG performance and transparency are those in professional and other
services, followed by agriculture. According to Sustainalytics’ ESG Risk Ratings, the less risky companies are those
in textiles, leather, and footwear; the Refinitiv ESG Scores suggest that the companies with better ESG performance
and transparency are those in the mining industry. However, only three companies represent this industry in our
sample. Therefore, these data should be interpreted with caution, as there are only a small number of companies
representing each industry. Regarding the analysis of the differences between the two metrics, if we focus on the
industries most represented in the sample (at least 10 companies in the sample), we see that the greatest
differences are for motor vehicles and other transportation because companies in these industries vary on average
by 38 in percentile positions between measures.
Finally, Table 20 includes the companies with the largest divergence in their percentile positions between Refinitiv
ESG Scores and Sustainalytics’ ESG Risk Ratings. As can be seen, the largest difference is for the company Cimpress,
which is at the top in terms of possible positive evaluations showing negligible risk (percentile 99.18) according to
Sustainalytics’ ESG Risk Ratings but is among the inferior companies in terms of its Refinitiv ESG Score, showing
only a satisfactory level of performance and transparency (percentile 1.3). In contrast, Bayer is relatively well
ranked in Refinitiv (percentile 93.48) but is poorly ranked in Sustainalytics’ ESG Risk Ratings (percentile 10).
These differences are unsurprising since Refinitiv ESG Scores aim to measure a firm's ESG performance and degree
of transparency in reporting material ESG data publicly, while Sustainalytics’ ESG Risk Ratings are created as the
aggregation of the unmanaged risk scores of individual material ESG issues with a potentially significant impact
on the economic value of a company. Therefore, while the Refinitiv ESG score focuses on ESG performance (the
impact of the company on the natural environment and society), Sustainalytics is centred on the impact of ESG
issues on the company's economic performance. The two metrics are very different in their conceptualisation and
the aim they pursue, so the differences in the positioning of the companies analysed are logical.
24
Table 20. Largest divergences in relative positions between Refinitiv ESG Scores and Sustainalytics’ ESG Risk Ratings
Cimpress Ireland 1812 Paper 97.82 34 1.36 Satisfactory 8.5 99.18 Negligible 241/250
Hexagon Sweden 4690 Retail 82.88 53 10.33 Good 11.7 93.21 Low 63/250
Bayer Germany 2120 Pharmaceuticals 82.88 90 93.48 Excellent 29.9 10.6 Medium 3/250
CD Projekt Poland 3240 Other manufacturing 81.52 40 2.99 Satisfactory 14.1 84.51 Low 220/250
Basf Germany 2059 Chemicals 79.62 91 95.65 Excellent 28.3 16.03 Medium 18/250
Information and
Ubisoft Entertainment France 6201 72.55 56 13.32 Good 13.8 85.87 Low 33/250
communication
Machinery and
Siemens Germany 2811 72.02 86 82.07 Excellent 30.1 10.05 High 7/250
equipment
Motor vehicles and
Faurecia France 2932 71.74 66 22.83 Good 10.9 94.57 Low 31/250
other transport
Financial and
KBC Groep Belgium 6420 72.20 63 19.02 Good 12.8 91.03 Low 111/250
insurance
Computers,
Barco Belgium 2630 electronics, and 72.20 62 17.66 Good 13.2 89.67 Low 227/250
opticals
Source: Elaborated by the authors
25
4.3 Divergences and other CS metrics
Having detected the differences between the two quantitative CS metrics (Refinitiv ESG Scores and
Sustainalytics’ ESG Risk Ratings), in this section, we analyse the extent to which these two quantitative measures
converge with other CS metrics. Specifically, on one hand, we examined how these two CS metrics relate to
media exposure of ESG issues measured with the RRI. On the other hand, we checked if the companies included
in the S&P Global Sustainability Yearbook, Global 100, and World’s Most Ethical Companies (for 2021) had
better Refinitiv ESG Scores and Sustainalytics’ ESG Risk Ratings than those excluded from these indicators and
indices.
First, focusing on RRI media exposure, Table 21 presents the top 10 companies with greater ESG risk exposure
according to the RRI and their position in the 2021 EU R&D Scoreboard. We can highlight that most of the
companies with a higher risk of media exposure are among the top 100 companies in the EU R&D Scoreboard,
including Volkswagen, which is ranked first, and Bayer, which is ranked third.
By analysing the Refinitiv ESG Scores, it is possible to notice in this table that the companies with higher ESG
risk exposure in the media are evaluated as excellent by Refinitiv. This trend can be rationalised if we consider
that companies that receive more ESG attention are also those that pay more attention to their ESG
performance and reporting transparency. In fact, the probability of the financial impact of ESG factors is greater
for these companies; in other words, the financial materiality of the ESG factors is higher. This finding aligns
with previous studies showing a positive correlation between media or stakeholders’ exposure and CS
performance and disclosure (e.g. Michelon, 2011).
Finally, Table 21 illustrates that the top-ranked companies according to the RRI coincide with those that have a
medium risk of ESG issues according to Sustainalytics’ ESG Risk Ratings.
Financial and
3–4 Deutsche Bank Germany 6419 59 41/250 82 28.6
insurance
Motor vehicles and
5 Volkswagen Germany 2910 58 1/250 85 29.7
other transport
Motor vehicles and
6 Stellantis Netherl. 2910 56 10/250 90 24
other transport
Electricity, gas, and
7 Iberdrola Spain 3511 55 103/250 86 20.5
steam
Table 22 presents the bivariate correlations for a more general difference analysis. The positive and significant
correlation between the CS metrics of Refinitiv and Sustainalytics and the RRI confirms that companies with a
higher ESG performance score and higher level of risk coincide with those that receive more media risk exposure.
In addition, the divergence between the two metrics was greater for companies that received more media
exposure. We also found an interesting relationship between the RRI and the position of companies in the 2021
EU R&D Scoreboard; specifically, we noticed that media exposure was higher for companies ranked at the top
of the R&D Scoreboard (first positions in the rankings).
26
Table 22. Correlations between RRI and other CS metrics
Finally, we checked whether the companies included in the S&P Global Sustainability Yearbook, Global 100, and
the World’s Most Ethical Companies received consistently better evaluations according to their Refinitiv ESG
Scores and Sustainalytics’ ESG Risk Ratings. We used the Kruskal-Wallis test, which provides a nonparametric
alternative to one-way ANOVA, as the variables analysed do not validate the assumption of equal variances.
The Kruskal-Wallis test checks the null hypothesis of equal population medians (Hamilton, 2006). Table 23
summarises the means and sum rank used to perform the Kruskal-Wallis tests for the included and excluded
companies.
Regarding the S&P Global Sustainability Yearbook, 54 of the 184 companies in the sample were included in the
yearbook. Both the Refinitiv ESG Scores and Sustainalytics’ ESG Risk Ratings show congruent average values
for the companies included in the S&P Global Sustainability Yearbook. Specifically, companies included in the
S&P Global Sustainability Yearbook have higher performance and transparency scores in Refinitiv (81.05 for
included companies vs. 70.48 for excluded companies) and lower financial risk (18.78 for included companies
vs. 22.07 for excluded companies). In both cases, the Kruskal-Wallis test indicated that the difference in
medians between the companies included and excluded in these indices was significant.
Table 23. Refinitiv ESG Score, Sustainalytics’ ESG Risk Ratings, S&P Global Sustainability Yearbook, Global 100, and the
World’s Most Ethical Companies
In the case of the Global 100 Index, only 23 of the 184 companies were included in the ranking. Like with the
companies included in the S&P Global Yearbook, the evaluation in terms of both the Refinitiv ESG Scores and
Sustainalytics’ ESG Risk Ratings of companies included in the Global 100 shows congruence, as companies
included in the Global index have better performance and transparency and less financial risk associated with
ESG. In both cases, the Kruskal-Wallis test indicated that the difference in medians between the companies
included and excluded in these indices was significant.
Finally, the World’s Most Ethical Companies shows little similarity in terms of the ranking of the top-ranked
European companies in R&D, as it includes only eight out of the 184 companies analysed. Although very few of
the top EU R&D companies were included in this index, there is congruence with both measures, as companies
27
included in this index show higher performance and transparency and less financial risk. However, in this case,
the differences in medians between the included and excluded firms are not significant for the Refinitiv ESG
Scores and have less significance than the other index for Sustainalytics’ ESG Risk Ratings.
Therefore, we can conclude that for the sample, both the Refinitiv ESG Scores and Sustainalytics’ ESG Risk
Ratings show consistency in their valuations with the S&P Global Sustainability Yearbook, the Global 100 Index,
and the World’s Most Ethical Companies. Such consistency might be explained by the fact that the indices
consider good performance and transparency in ESG factors, as does Refinitiv, as well as the company’s level
of risk, which is the main measurement factor of Sustainalytics’ ESG Risk Ratings.
28
5 Discussion and conclusions
This study aimed to contribute to greater homogenisation in the measurement and reporting of CS practices.
First, we attempted to understand the current trend in CS reporting among the most innovative companies in
the EU. Specifically, we performed text analyses to identify trends in terms of the use of terminology to refer
to CS issues, EU regulations acknowledged, most cited international sustainability frameworks, ESG ratings and
indices mentioned, the ESG KPIs used, and the CS materiality approaches adopted. Furthermore, we analysed
the most popular metrics to measure CS performance by assessing their similarities and differences for the
most innovative EU companies. The comparative analysis of the Refinitiv ESG Scores, Sustainalytics’ ESG Risk
Ratings, S&P Global Sustainability Yearbook, RRI, Global 100 Index, and the Top 100 World’s Most Ethical
Companies enabled us to draw interesting conclusions about the diversity and incongruencies that currently
exist in CS metrics.
First, focusing on the most interesting aspects related to trends in CS reporting, we can draw the following
conclusions:
• In 2021, there was great diversity in terms of how companies reported their CS information (integrated
with financial information, in separate documents, or both) and how companies named these reports.
Our text analysis illustrates that CS information is most commonly presented in a separate document.
The most commonly used title for this document is ‘sustainability report’, although it was only used by
29.41% of the companies, which indicates great levels of heterogeneity.
• SDGs was the most common term used in the 2021 reports to refer to CS aspects, followed by the
term ESG. Surprisingly, the most traditional and academic term, CS, was not referenced as much. This
trend seems to confirm the increasing popularity of SDGs as the main framework of action to integrate
sustainability at the firm level (Delgado-Ceballos et al., 2023; Montiel et al., 2021). It also indicates
the prominence gained by the term ESG, which was originally coined by finance academics and
practitioners and later extended to the general business field to refer to sustainability actions and
performance (Antolín-López and Ortiz-de-Mandojana, 2023).
• Among EU regulations, the EU Taxonomy is receiving significant attention in the CS of companies, with
66.39% of the companies including references to it in their 2021 report. Notably, 14.29% of the
companies mentioned the CSRD. This finding foresees great relevance of the EU Taxonomy in the
business field, given that it is still a proposal in the development stage. This finding also shows the
proactivity of some of the companies in the sample.
• Regarding the general international sustainability frameworks, we observe a similar trend with regard
to the CS terminology, since SDGs were the most referenced framework in the analysed CS reports of
the companies. The GRI was the second most frequently referenced framework, which is
understandable since it is an international standard specifically developed for corporate reporting and
disclosure of companies’ sustainability actions. The other two frameworks with a notable presence in
the CS reports were the UNGC and SASB. Hence, although there is much freedom in the selection of
sustainability frameworks to disclose CS information, most companies focus only on a few
international frameworks (i.e. SDGs, GRI, UNGC, and SASB). Regarding specific sustainability
frameworks, those related to the environment (i.e. CDP, GHG, SBTi, and TCFD) are cited more frequently
than frameworks related to the social dimension. The number of references among sustainability
frameworks related to the environment was very similar. Regarding the social dimension, references
to the UDHR exceed references to the ILO in number.
• Unexpectedly, although rating agencies have played a very relevant role in the development of CS
measures, references to rating agencies and their metrics and indices are scarce in companies’ CS
reporting.
• Among the most used environmental KPIs, the most common are the references to ‘emissions’.
Additionally, indicators related to energy, such as ‘energy efficiency’ and ‘renewable energy’, are
referenced frequently. There are also numerous allusions to the broader but related concept of ‘climate
change’. However, considering our sample of innovative firms, it is worth noting the negligible presence
of innovation-related indicators, such as ‘environmental/sustainable innovation’ and ‘green products’.
Regarding the social KPIs, the most common indicators are those related to employees, such as ‘health’,
‘health and safety’, ‘working conditions’, and ‘diversity’. This might be explained by the importance
health and well-being has gained recently owing to the Covid-19 pandemic. References to ‘human
rights’ are also very common, which is reasonable because they reflect a general perspective of the
29
company's respect for all stakeholders, and it is one of the most deeply rooted CSR aims. Finally, of
the governance KPIs analysed, the most frequently occurring one is ‘risk management’, which indicates
the general inclination of companies to pay attention to ESG aspects that have a particular risk of
impact on the company. This finding aligns with the growing presence of financial materiality in both
finance and business fields (Antolín-López & Ortiz-de-Mandojana, 2023). References to more
traditional governance terms, such as ‘anti-corruption’ and ‘ethics’, are also very common in CS
reporting.
• Although references to materiality are still limited, companies reference ‘financial materiality’ more
than ‘sustainable materiality’ (21.34% vs. 12.97%). This finding is supported by the fact that the
concept of materiality first appeared in the finance field (Jebe, 2019). The expression ‘double
materiality’ only appears in 15.90% of the documents, which is striking, given the prominence and
urgency granted to double materiality in the Guidelines on Reporting Climate-Related Information
(2019) to clarify the application of the NFRD.
Second, with respect to the analysis of the CS metrics for top-ranked companies in the EU R&D Scoreboard, we
can draw the following conclusions:
• Companies better positioned in the EU R&D Scoreboard are evaluated significantly higher according to
their Refinitiv ESG Scores. However, there does not seem to be a significant correlation between the
top 250 companies in the EU R&D Scoreboard and Sustainalytics’ ESG Risk Ratings.
• The metrics, Refinitiv ESG Scores and Sustainalytics’ ESG Risk Ratings differ in how they evaluate
companies and their CS performance. Therefore, each rating agency places different companies in the
top positions, i.e. the best ranked companies according to these two CS metrics differ greatly. This
result might be explained by the fact that while the Refinitiv ESG Score evaluates ESG performance
and the degree of transparency in reporting material ESG data publicly, Sustainalytics’ ESG Risk Ratings
only focus on the evaluation of the financial risk associated with the company's ESG factors. Both
measures are very different in their conceptualisation; therefore, the differences in positioning are
reasonable. These differences are not greater for companies that are better or worse positioned in the
EU R&D Scoreboard.
• Companies most exposed to the media, as measured by the RRI, are evaluated as excellent by Refinitiv
(the highest score category). This may be because companies that receive more ESG attention are
under major public scrutiny and care more about their ESG performance and the transparency of their
ESG reporting. Using correlations, we confirmed that companies with a higher Refinitiv ESG Score and
a higher Sustainalytics’ ESG Risk Rating coincide with those that receive more media exposure. We also
found a very interesting relationship between companies’ RRI and their position in the 2021 EU R&D
Scoreboard. Companies ranked at the top of the R&D Scoreboard faced greater media exposure.
• Not many of the top-ranked companies in the EU R&D Scoreboard are included in the S&P Global
Sustainability Yearbook, the Global 100, or the World's Most Ethical Companies.
• Although there are divergences between Refinitiv ESG Scores and Sustainalytics’ ESG Risk Ratings,
these two metrics separately show congruence with the three indices analysed (S&P Global
Sustainability Yearbook, the Global 100, and the World's Most Ethical Companies). This finding can be
explained by the fact that these indices are constructed based on companies' ESG performance and
their level of transparency in ESG reporting (the two measurement pillars of Refinitiv) as well as their
level of risk (the main aim of Sustainalytics’ ESG Risk Ratings).
This study has some limitations. First, the sub-samples included only 238 and 184 companies. This is because
part of the analysis required a manual and detailed data search. We focused on highly innovative companies
that can present a good image in terms of openness to the environment and change. However, future work
could include larger sample sizes, including less recognised or less scrutinised companies. In addition, together
with EU companies that can be considered pioneers in the field of measuring and reporting CS, companies from
other geographical contexts could be incorporated to obtain a more global picture of the situation. Second, the
objective of this work was mainly descriptive, and more complex methodologies should be designed and applied
to investigate the causality of many of the results, trends, and other uncovered effects found in this report.
Furthermore, this study focused on the year 2021. However, in the coming years, we expect important advances
in terms of CS measurement and reporting, given the global changes occurring in terms of regulations, ratings,
and so on. Therefore, these analyses should be repeated in the future to evaluate progress.
30
Despite these limitations, we believe that this study has enabled us to learn about some of the current trends
in corporate reporting and to identify and justify some of the divergences that occur when measuring CS.
However, the most important trends detected refer to the lack of homogeneity in the naming of the documents
that present and integrate CS information, which can easily be solved by establishing clearer recommendations
and global standards. This would enable stakeholders to locate this information more easily, thereby improving
access and transparency in terms of CS reporting and the benchmark of companies. We also believe that despite
great flexibility, only a few international sustainability framework standards have significant prominence, as
they favour standardisation. KPIs are a key aspect in advancing quality in reporting and should be more
standardised, at least the most relevant ones. Additionally, it is important to differentiate between the levels of
different KPIs and make KPIs more actionable for measurement (for example, emissions vs. climate change).
EU regulations such as the EU Taxonomy will help achieve this goal. Companies must understand and clarify
the double materiality of their activities, i.e. their CS measurement and reporting must allow for the
identification of not just the impacts social and environmental issues may have on their financial aspects, but
also the impact the company has on global sustainability. Finally, there are many measures for assessing the
CS performance of companies, each constructed using a different methodology and set of assumptions. The
value of these tools depends on whether the stakeholder uses them to gain a thorough understanding of the
assumptions on which each CS measure is built and what each measure represents. Some CS metrics can be
used in a supplementary manner, given that the approach and focus of existing CS metrics differ considerably.
We hope that in the future, greater standardisation will be developed in measurement and reporting. This could
translate into greater clarity and standardisation in CS measurements, allowing for more effective comparison
between companies and improvement of their monitorisation and evolution. Eventually, it could ensure greater
sustainability in companies.
31
References
Antolín-López. R., Delgado-Ceballos. J., & Montiel. I. (2016). Deconstructing corporate sustainability: A
comparison of different stakeholder metrics. Journal of Cleaner Production, 136, 5-17.
Antolín-López & Ortiz-de-Mandojana (2023). Measuring and disclosing ESG information and performance.
European Commission Technical Report. Luxembourg: Publications Office of the European Union.
Berg, F., Koelbel, J. F., & Rigobon, R. (2019). Aggregate confusion: The divergence of ESG ratings (pp. 1-42).
Cambridge, MA, USA: MIT Sloan School of Management.
Chatterji, A., Durand, R., Levine, D., & Touboul, S. (2016). Do ratings of firms converge? Implications for managers,
investors and strategy researchers, Strategic Management Journal, 37(8), 1597-1614.
Christensen, D. M., Serafeim, G., & Sikochi, A. (2022). Why is corporate virtue in the eye of the beholder? The
case of ESG ratings. The Accounting Review, 97(1), 147-175.
Delgado-Ceballos, J., Ortiz-de-Mandojana, N., López-Antolín, R & Montiel, I. (2023). Connecting the Sustainable
Development Goals to firm-level sustainability and ESG factors: The need for double materiality. BRQ Business
Research Quaterly.
Directive 2004/39/EC. Directive 2004 on markets in financial instruments. Retrieved from: https://eur-
lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32004L0039&from=EN (Accessed on October 27th, 2022).
Directive 2014/95/EU. The Non-Financial Reporting Directive (NFRD). Retrieved from: https://eur-
lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A32014L0095 (Accessed on October 27th, 2022).
European Commission (2017). Guidelines on non-financial reporting (methodology for reporting non-financial
information). Retrieved from: https://eur-lex.europa.eu/legal-
content/EN/TXT/PDF/?uri=CELEX:52017XC0705(01)&from=EN (Accessed on October 27th, 2022).
European Commission (2019). Guidelines on reporting climate-related information. Retrieved from:
https://ec.europa.eu/finance/docs/policy/190618-climate-related-information-reporting-guidelines_en.pdf
(Accessed on October 27th, 2022).
Eccles, R. G., Lee, L. E., & Stroehle, J. C. (2020). The social origins of ESG: An analysis of Innovest and KLD.
Organization & Environment, 33(4), 575-596.
Escrig-Olmedo, E., Muñoz-Torres, M. J., & Fernández-Izquierdo, M. A. (2010). Socially responsible investing:
Sustainability indices, ESG rating and information provider agencies. International Journal of Sustainable
Economy, 2(4), 442-461.
Hamilton. L (2006). Statistic with Stata. Canada: Thomson Brooks/Cole.
Jebe, R. (2019). The convergence of financial and ESG materiality: Taking sustainability mainstream. American
Business Law Journal, 56(3), 645-702.
Michelon, G. (2011). Sustainability disclosure and reputation: A comparative study. Corporate Reputation Review,
14(2), 79-96.
Montiel. I., Cuervo-Cazurra. A., Park. J., Antolín-López. R., & Husted. B. W. (2021). Implementing the United
Nations’ sustainable development goals in international business. Journal of International Business Studies,
52(5), 999-1030.
QSR International. (2022). Nvivo Qualitative data analysis. Retrieved from:
https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/about/nvivo (Accessed on October
27th, 2022).
Refinitiv (2022). ESG data. Retrieved from: https://solutions.refinitiv.com/esg-
data?utm_content=Refinitiv%20Brand%20Product-ES-EMEA-G-EN-
Exact&utm_medium=cpc&utm_source=google&utm_campaign=596226_PaidSearchInvestmentSolutionsBAU
&elqCampaignId=16987&utm_term=refinitiv%20esg%20&gclid=Cj0KCQjwgYSTBhDKARIsAB8Kukv8d_PTj3Ju
o2ZwKUNZ2atzFRGusRbcwLDV69nHaLAbJuUXm4_mcYcaAvw3EALw_wcB&gclsrc=aw.ds (Accessed on October
9th, 2022).
Regulation (EU) 2019/2088. Sustainable Finance Disclosures Regulation (SFDR). Retrieved from: https://eur-
lex.europa.eu/legal-content/EN/TXT/?uri=celex%3A32019R2088 (Accessed on October 27th, 2022).
32
Regulation (EU) 2020/852. The ‘EU Taxonomy Regulation. Retrieved from: https://eur-lex.europa.eu/legal-
content/EN/TXT/PDF/?uri=CELEX:32020R0852&from=EN (Accessed on October 27th, 2022).
RepRisk. (2022) RepRisk methodology overview. Retrieved from: https://www.reprisk.com/news-
research/resources/methodology#a-what-are-the-various-steps-of-the-research-nbsp-process (Accessed on
October 27th, 2022).
Securities and Exchange Commission (2022). SEC Proposes rules to enhance and standardize climate-related
disclosures for investors. Retrieved from: https://www.sec.gov/news/press-release/2022-46 (Accessed on
October 27th, 2022).
Siew, R. Y. (2015). A review of corporate sustainability reporting tools (SRTs). Journal of Environmental
Management, 164, 180-195.
SDG Compass (2015). The guide for business action on the SDGs, Global Compact, GRI y WBCSD.Retrieved from:
https://sdgcompass.org/wp-content/uploads/2015/12/019104_SDG_Compass_Guide_2015.pdf (Accessed on
October 27th, 2022).
S&P Global (2022). ESG Scores. Retrieved from: https://www.spglobal.com/esg/solutions/data-intelligence-esg-
scores (Accessed on October 27th, 2022).
Sustainalytics ESG Risk Ratings (2022). Methodology Abstract. Retrieved from:
https://www.sustainalytics.com/esg-rating/sap-se/1008004721 (Accessed on October 5th, 2022).
Van Duuren, E., Plantinga, A., & Scholtens, B. (2016). ESG integration and the investment management process:
Fundamental investing reinvented. Journal of Business Ethics, 138(3), 525-533.
Wang, Z., Hsieh, T. S., & Sarkis, J. (2018). CSR performance and the readability of CSR reports: Too good to be
true?. Corporate Social Responsibility and Environmental Management, 25(1), 66-79.
33
List of abbreviations and definitions
CS Corporate Sustainability
CSR Corporate Social Responsibility
CSRD Corporate Sustainability Reporting Directive
DJSI Dow Jones Sustainability Indices
ESG Environmental, Social, and Governance
EU European Union
GRI Global Reporting Initiative
KPIs Key Performance Indicators
ILO International Labour Organization
MEIs Material ESG Issues (MEIs),
NFRD Non-Financial Reporting Directive
RRI RepRisk Index
SASB Sustainability Accounting Standards Board
SDGs Sustainable Development Goals
SFDR Sustainable Finance Disclosures Regulation
S&P Standard & Poors
UNGC United Nations Global Compact
34
List of tables
Table 1. Country distribution in the 250 EU R&D Scoreboard and both sub-samples ..........................................................6
Table 2. Industry distribution of the 250 top-ranked companies in the EU R&D Scoreboard and the two sub-
samples .....................................................................................................................................................................................................................................7
Table 3. Name heterogeneity in CS-related reports....................................................................................................................................8
Table 4. CS terminology frequency counts ................................................................................................................................................... 10
Table 5. Frequency counts of most commonly used CS terms ........................................................................................................ 10
Table 6. Frequency counts of types of EU regulations .......................................................................................................................... 11
Table 7. Frequency counts of international sustainability frameworks...................................................................................... 12
Table 8. Frequency counts of ESG ratings and indices ......................................................................................................................... 13
Table 9. Frequency counts of environmental KPIs in CS reporting ................................................................................................ 14
Table 10. Frequency counts of social KPIs in CS reporting ................................................................................................................ 15
Table 11. Frequency counts of corporate governance KPIs in CS reporting ............................................................................ 15
Table 12. Frequency counts of materiality terms .................................................................................................................................... 16
Table 13. ESG metrics and other indicators levels and qualitative meanings ....................................................................... 18
Table 14. ESG indicators of the 10 best ranked European companies in the 2021 EU R&D Investment
Scoreboard .......................................................................................................................................................................................................................... 20
Table 15. Refinitiv ESG Best Companies ........................................................................................................................................................ 21
Table 16. Best firms in Sustainalytics’ ESG Risk Ratings .................................................................................................................... 22
Table 17. Basic statistics of CS measures and divergence ................................................................................................................ 23
Table 18. Correlations among the 250 top-ranked companies in the EU R&D Scoreboard, CS measures, and
divergence............................................................................................................................................................................................................................ 23
Table 19. Percentiles and divergences by industry ................................................................................................................................. 23
Table 20. Largest divergences in relative positions between Refinitiv ESG Scores and Sustainalytics’ ESG Risk
Ratings ................................................................................................................................................................................................................................... 25
Table 21. Top-ESG attention, RRI (higher risk)............................................................................................................................................ 26
Table 22. Correlations between RRI and other CS metrics ................................................................................................................. 27
Table 23. Refinitiv ESG Score, Sustainalytics’ ESG Risk Ratings, S&P Global Sustainability Yearbook, Global
100, and the World’s Most Ethical Companies............................................................................................................................................. 27
35
GETTING IN TOUCH WITH THE EU
In person
All over the European Union there are hundreds of Europe Direct centres. You can find the address of the centre nearest you online
(european-union.europa.eu/contact-eu/meet-us_en).
On the phone or in writing
Europe Direct is a service that answers your questions about the European Union. You can contact this service:
— by freephone: 00 800 6 7 8 9 10 11 (certain operators may charge for these calls),
— at the following standard number: +32 22999696,
— via the following form: european-union.europa.eu/contact-eu/write-us_en.
Online
Information about the European Union in all the official languages of the EU is available on the Europa website (european-
union.europa.eu).
EU publications
You can view or order EU publications at op.europa.eu/en/publications. Multiple copies of free publications can be obtained by
contacting Europe Direct or your local documentation centre (european-union.europa.eu/contact-eu/meet-us_en).
EU law and related documents
For access to legal information from the EU, including all EU law since 1951 in all the official language versions, go to EUR-Lex (eur-
lex.europa.eu).
Open data from the EU
The portal data.europa.eu provides access to open datasets from the EU institutions, bodies and agencies. These can be downloaded
and reused for free, for both commercial and non-commercial purposes. The portal also provides access to a wealth of datasets
from European countries.