Developing A Scoring Credit Model Based On The Methodology of International Credit Rating Agencies
Developing A Scoring Credit Model Based On The Methodology of International Credit Rating Agencies
Developing A Scoring Credit Model Based On The Methodology of International Credit Rating Agencies
net/publication/370602716
Article in Journal of Corporate Finance Research / Корпоративные Финансы | ISSN 2073-0438 · April 2023
CITATIONS READS
0 72
3 authors, including:
Sergei Grishunin
National Research University Higher School of Economics
39 PUBLICATIONS 127 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
ESG, non-financial and integrated reporting: theory and practice View project
All content following this page was uploaded by Sergei Grishunin on 08 May 2023.
DOI: https://doi.org/10.17323/j.jcfr.2073-0438.17.1.2023.5-16
JEL classification: G20, G24, G32
Sergei Grishunin
Managing Director, National Rating Agency (NRA) LLC,
Researcher of Joint ESG Laboratory between NRA LLC and Moscow State University, Doctorate Research Associate,
Peter the Great St. Petersburg Polytechnic University, Moscow, Russia,
[email protected], ORCID
Gennady Pomortsev
Research Analyst, National Rating Agency (NRA) LLC, Moscow, Russia,
[email protected], ORCID
Abstract
The purpose of this work is to examine the relationship of various financial and non-financial (qualitative) factors of per-
formance of non-financial companies and their credit ratings.
We developed the scoring model which was based on the methodologies of international and Russian rating agencies.
The modelled ratings of non-financial companies for 2018–2020 were compared with actual ratings assigned by the rating
agencies and discrepancies were explained. The sample includes companies from retail, protein and agriculture, steel, oil
and gas sectors from Russia, USA, Luxembourg, England, Canada, India, Ukraine and Brazil.
The paper proved that addition of business and environmental, social and governance factors improved the quality of
scoring models in comparison to those including only financial metrics. There are strong patterns in the resulting ratings
of companies for some industries. Retail industry companies are associated with high sales indicators, while steel indus-
try companies have high interest expenses coverage ratios. Oil and gas industry companies mostly show high results in
reserves coefficients.
The study developed a credit rating forecasting tool that emulates the work of analysts of rating agencies and therefore has
a high predictive power. The developed model can be used by financial market practitioners to predict the credit ratings of
Russian companies in the face of the refusal of international rating agencies to rate Russian issuers.
Keywords: credit default prediction, credit rating modelling, credit rating system, ESG rating
For citation: Astakhova, A., Grishunin, S. , Pomortsev, G. Developing a Scoring Credit Model Based on the Methodology of
International Credit Rating Agencies. Journal of Corporate Finance Research. 2023;17(1): 5-16. https://doi.org/10.17323/j.
jcfr.2073-0438.17.1.2023.5-16
The journal is an open access journal which means that everybody can read, download, copy, distribute, print, search, or link to the full texts of these
articles in accordance with CC Licence type: Attribution 4.0 International (CC BY 4.0 http://creativecommons.org/licenses/by/4.0/).
concludes that the changes in credit ratings are reflected in tors affect the probability of default, which is lowered, for
stock prices and the corresponding investors’ reaction, and instance, when the CEO of a company is also its co-owner
thus affect a company’s financial performance. and increases when a company becomes a subsidiary. The
An important part of the paper is related to qualitative second finding is significant for current research when the
factors. Several research studies agree that the incorpora- results are compared with an adjustment for being a part
tion of qualitative and non-financial variables in the model of a group, which traditionally has a positive effect on the
could improve the accuracy of credit rating prediction. The credit rating. Therefore, using different variables to assess
papers by B. Lehmann [5] and J. Grunert et al. [6] investi- credit ratings for companies in different industries is theo-
gate the impact of qualitative factors on the credit rating retically reasonable.
assessment, therefore, this study accommodates for the Since not only the company itself affects its credit quality, a
non-financial qualitative factors to improve model accu- deep investigation into adjustments to its stand-alone cred-
racy. itworthiness assessment is required. Karminsky’s paper
Another important point is the distinction between devel- [10] highlights the applicability of ratings and their distri-
oped and emerging countries. The paper by A.M. Karmin- bution in today’s financial world and shows the importance
sky entitled “Corporate rating models for emerging mar- of using external support factors on a par with internal
kets” [10] presents several financial, macroeconomic, and factors, both quantitative and qualitative, in evaluating a
qualitative indicators and their effect on the credit rating of company’s financial stability in one way or another. But
a company using econometric models that use these coef- it is important to mention the adjustment for the overall
ficients in different proportions. This study also examines sovereign rating. The paper by A.M. Karminsky and A.A
the important question of how results differ for companies Polozov – “Handbook of ratings” [14] notes that a compa-
from emerging markets and what the key differences and ny’s credit rating rarely exceeds the the sovereign rating.
specifics are in assessing their credit ratings. These findings A company’s stand-alone rating is measured in a “bubble”,
have a key value in current research, and help to interpret but there are macroeconomic risks that the company does
results and make the correct conclusions for companies not control: political stability, competitive environment,
from emerging markets. Thus, companies from emerging strength of invention protection. However, there are exam-
countries are more exposed to macroeconomic factors, ples of companies that refute this rule. Such companies are
which are considered qualitative variables, or an adjust- assigned a rating higher than the sovereign rating because,
ment for the sovereign rating. due to certain circumstances, it is possible to exclude nega-
tive factors affecting credit quality from consideration (un-
In addition, most studies involve the use of different ex-
like in the calculation of the sovereign rating), or simply
ternal factors and specific indicators for each non-finan-
because other strongly positive features are present.
cial industry to assess credit risks. A.M. Karminsky’s paper
“Credit ratings and their modelling” [11] completely cov- Reconciling the results obtained by using methodolo-
ers the issues of credit quality assessment and their emer- gies with different scales is important. The paper by N.F.
gence. The study discusses the classification of ratings and Dyachkova “Comparison of rating scales of Russian and
conducts an analysis of existing methodologies and princi- foreign agencies: industrial and financial companies” [15]
ples of credit rating formation used by the most recognised reveals the importance of correct conversion of Russian
rating agencies. Moreover, B. H. Bergrem’s paper “An em- rating scales to international ones. The study examines the
pirical study of the relationship between credit ratings and relationships between rating scales used by different rating
financial ratios in the E&P industry” [12] examines the key agencies, and it is mostly valuable for current purposes,
indicators that are unusual for other methodologies, and since several companies have not been assigned a rating by
are important in the E&P (Exploration and Production) Moody’s. This paper presents a method of forming numer-
sector of the oil and gas industry. The cost of discovery ic rating scores. These scores are used in empirical mod-
and development is one of the vital keys to understanding els to study relationships between ratings and explanatory
the operating efficiency of a company, and one of the fun- factors.
damental indicators in assessing the scale of a company’s Highlighting the patterns for specific industries could be
unproven reserves. In this case, the stable replenishment complicated due to various difficulties and a dissimilarity
of reserves, their volume and geographic diversification, of the companies. However, there are research studies that
unlike company revenue, can serve as the best indicator draw almost the same conclusions about the most impor-
of long-term stability. Finally, A.I. Rybalka [13] demon- tant factors for a specific industry. The scale-related factors
strates how different specific indicators of non-financial generate many advantages for a retail company over its
companies could affect the probability of default using competitors, such as market power and price leadership.
logit regressions. The author determines the importance These advantages can lead to greater investor attractive-
of including qualitative indicators and their effect on the ness compared to smaller companies. Such a strong effect
results. The results reveal the difference when several cor- of the scale is confirmed by several studies. For instance,
porate governance coefficients are included, and are also A.B. Curtis et al. [16] argue that the revenue variable is
valuable for current research since the paper investigates the main component in the retail companies’ financial
companies’ ESG ratings and specifically, their governance performance forecast. As for the steel industry, profitabil-
components. It has been established that governance fac- ity-related variables, particularly that of financial perfor-
In addition, there is a clear pattern in the steel indus- funds from operating activities. This indicator is impor-
try, with the “EBIT/Interest Expense” coefficient being tant as it directly reflects the amount of cash that the
the most successful for 4 out of 5 companies (Table 3). company generates from its income. Also, 2 companies
It can indicate a company’s positive net profits and low have an equally unsuccessful sales indicator (Table 3),
interest expenses on short-term and long-term debts. which may be caused by the lack of demand for goods
While the worst indicators differ, 2 companies have in the years under consideration or hint to at a weak
almost the same deficiency in the CFO/Debt indicator position in the markets where the company carries out
(Table 3), which may indicate a small amount of free its activities.
Table 3. Model ratings with adjustments for companies in the steel industry
Company Agency rating With adjustments Best coefficient Worst coefficient
MMK Baa2 Baa3 EBIT / Interest Expense Sales
The oil and gas industry, especially the exploration and cash flow. This would be a negative signal for investors, as
production sector, is directly related to the reserves and this indicator is used to determine the company’s ability to
volumes of daily production. Therefore, the most success- repay its debts from cash generated from operations, i.e.,
ful results in this industry are revealed by the Debt / PD sales, after dividend payments. Notably, the only compa-
reserves indicator, and this is the case for each company ny with a different least successful indicator is Russneft,
(Table 4). Hence, it is possible to state that in this industry whose possible bankruptcy has been discussed in the
reserve indicators are important for companies and even news. It has the least successful results in the Average Daily
despite the crisis years, the management board monitors Production coefficient that indicates poor sales estimates,
and maintains this indicator at the proper level. The least which would negatively affect all financial results and, im-
successful indicator results for 4 out of 5 companies are portantly, the company’s lack of willingness to compete in
reflected in RCF/Debt coefficient (Table 4), which may the market and shows little impact on the development of
be due to the companies’ high debt ratio or low retained the industry.
Table 4. Model ratings with adjustments of companies from the oil and gas (E&P sector) industry
Company Agency rating With adjustments Best coefficient Worst coefficient
Oil India Baa3 Baa3 Debt / Reserves RCF / Debt
insolvent companies in this industry. The least successful suggesting that the metric that measures a company’s total
performers differ even more, although the two companies outstanding debt as a percentage of total company capitali-
have similarly lagged Debt/Book Capitalization (Table 5), zation is lagging and requires work in the future.
Table 5. Model ratings with adjustments of companies from the protein and agriculture industry
The model’s ability to predict and indicate weaknesses in The ratings obtained by the model and the rating agencies
companies, which can be adjusted by substituting different for PIK, AK BARS, GLAVSTROY, GTLK and TRINFICO
values, as well as to point out the line of effort, together apparently coincide (Table 6), since the Expert RA meth-
with the resulting patterns in the relationship between the odology was taken as the foundation when forming the
credit rating and the financial indicator values can help to ESG rating in the model, which is very similar to the NRA
identify a company’s strengths and predict its level of credit methodology for the majority of coefficients. However, in
risk. the case of X5, the obtained result is different: the rating
calculated using the model is higher than the agency rating,
ESG Rating results which may be due to a different approach to evaluation and
different views on environmental, social and corporate gov-
The ESG rating is built into the model as an independent
ernance issues. The MSCI methodology is a guide to rating
tool for calculating the rating of possible environmental
indicators on a broader scale. Each indicator is assessed on
and social damages, as well as corporate governance risks
a scale of 0 to 10, adding more detail to the actions, while
in the company. When calculating the main credit rating of
increasing the subjectivity of the assessment, as the user is
a company, the potential user of the model can introduce
given an opportunity in advance to assess the company’s
corrections and proceed to the calculation of the ESG rat-
actions on a positive-negative spectrum, even though all
ing with the average variance between actual and modelled
the necessary data is publicly available, and it is easy to find
rating of about 0.5 notches.
relevant answers to all questions in each of the three areas.
1. Zaidi D. The indisputable role of credit ratings 13. Rybalka А.I. Modeling the probability of default
agencies in the 2008 collapse, and why nothing has in the construction sector: Factors of corporate
changed. Truthout. Mar. 19, 2016. URL: https://truth- governance. Korporativnye finansy = Journal of
out.org/articles/the-indisputable-role-of-credit-rat- Corporate Finance Research. 2017;11(3):79-99.
ings-agencies-in-the-2008-collapse-and-why-noth- (In Russ.). https://doi.org/10.17323/j.jcfr.2073-
ing-has-changed/ (accessed on 10.07.2021). 0438.11.3.2017.79-99
Appendix 1
Table A1. Retail industry
Appendix 2
Table A2. Oil and Gas industry
Profitability and efficiency 25.00 Leveraged Full-Cycle Ratio (EBIT Margin) 25.00
Appendix 3
Table A3. Steel industry
Appendix 4
Table A4. Protein and agriculture industry
Appendix 5
Table A5. Adjustment for support from the state or other shareholders
Degree of relationship
Very strong Strong Moderate Weak Very weak
Not higher than Not higher than
Supporting institution category
Appendix 6
Table A6. Adjustment for state and shareholder support
SCA + 3 SCA + 1
Source: ACRA.