Guidelines Economic Analysis Projects
Guidelines Economic Analysis Projects
ECONOMIC ANALYSIS
OF PROJECTS
ECONOMICS OFFICE
August 1987
FOREWORD
During the past five years, the Economics Office has prepared and cir-
culated various guidelines on specific aspects of the economic analysis of proj-
ects. These guidelines were prepared in pursuance of the recommendations con-
tained in the Board Paper entitled "Economic and Financial Appraisal of Proj-
ects". Since most of the work in refining and improving the approach to these
major aspects has been completed, it is desirable that these guidelines be now
consolidated in one volume which can serve as a manual.
During the progress of the above work, it was also found necessary to
substantially revise and update the general guidelines pn economic analysis of
projects which were inti ally prepared in 1970. This volume therefore begins
with general guidelines; specific guidelines follow as annexes to the general
guidelines.
~~~ A. T. BAMBAWALE
Vice President, Operations
May 1983
PREFACE
The publication of the second edition of the Guidelines has been necessitated
by the unusually heavy demand for the first edition whose supply has been ex-
hausted. In its continuing effort to improve, update and simplify the Guidelines,
the Economics Office has added, deleted, and sharpened the material as well
as further edited it to improve the presentation.
The major revisions and additions made in the second edition are the follow-
ing: (i) The sections dealing with the depletion premium and sensitivity analysis
have been considerably reformulated to make them more rigorous. (ii) Reference
to the foreign exchange earning capacity rate has been deleted as it does not
provide any additional insight than what is already contained in the economic
internal rate of return. (iii) Two new appendixes - Guidelines for the Treat-
ment of Price Changes in the Economic Analysis of Projects and Guidelines
for the Economic Analysis of Education Projects - have been added. The former
suggests (a) use of World Bank Commodity Price Projections in valuing benefit
and cost streams in the base case, unless there are compelling reasons to use
other price estimates; and (b) use of base year prices in the sensitivity analysis.
The Guidelines on Education provide an extension of the general guidelines
to a sector specific context.
~.
-.
K. N. KOHLI
Chief Economist
August 1987
TABLE OF CONTENTS
Page
I. INTRODUCTION 1
APPENDIXES 25
I. INTRODUCTION
A. Macroeconomic Analysis
4. While each developing member country (DMC) has its own socioeconomic
priorities, all hold some major objectives in common. These include fulfilling
the basic needs of all citizens, providing opportunities for gainful employment,
and achieving both rapid and sustained economic growth and more equitable
distribution of income. Governments adopt various policy instruments for pursu-
ing these objectives, the most important of which relate to fiscal and monetary
policy, and trade, investment, income and pricing policies. The purpose of
macroeconomic analysis is to determine the importance and urgency of a project
or program for which Bank support is sought in relation to national and sectoral
objectives.
2
chapter should describe the sector, subsector or industry to which the project
relates and should assess the importance and urgency of the project to the
national development program. It should assess the impact of the project on
the achievement of sectoral objectives. If constraints exist in this regard, the
measures proposed to remove them should also be described in the relevant sec-
tions of the report. A project may also have other effects such as those relating
to foreign exchange earnings or savings and fiscal revenue; these should likewise
be evaluated.
3
If costs exceed benefits, such a project reduces welfare, and in the interest of
the country concerned such a project should not be supported.
11. The projected financial cost and benefit streams may, where relevant,
be taken as the starting point for economic analysis, though these streams must
be adjusted to reflect true economic costs and benefits. For example, all payments
for wages by the project entity are financial costs. The economic cost of wages
could be substantially lower if there is considerable unemployment in the
economy (see Section IV. D). Similarly, the tariff charged for power or rail
transport may not reflect the economic cost of supply. A project may also in-
volve an economic cost that does not involve a corresponding financial cost.
For instance, a project may impose pollution abatement costs or urban develop-
ment costs on society, but such costs will often not be reflected in the project
accounts. "Shadow prices" are used to take into account all quantifiable ef-
fects of a project and thus its true economic costs and benefits. These prices
are therefore likely to differ from the financial prices relating to the project.
12. A project affects the flow of income not merely in the project entity,
but elsewhere in the system as well; e.g., in private households which provide
labor, in enterprises which supply inputs, and in the government by way of
changes in tax revenues. Many of the corrections to financial cost and benefit
streams necessary to reflect true economic costs and benefits are adjustments
that take into account the effects of a project on net income flows in the overall
economy. These income flows are as real as the income flows to the project
entity, and the "shadow prices" which take these into account are, in this sense,
based on effects observed during project implementation.
14. The next step is to establish whether the proposed project is the least-
cost or the most cost-effective way of attaining the project's objectives. This in-
volves examination of alternatives to the project in terms of design, size, loca-
tion, timing and technology. The interrelationship between the first two steps
4
is obvious: the demand analysis does not have much meaning without reference
to cost and vice versa.
15. The final step is ascertaining whether the net benefits expected from
the use of resources required by the project are in excess of, or at least equal
to, the net benefits to the economy expected from the use of these resources
in the next best available alternative project. This step applies only to projects
for which most of the costs and benefits are quantifiable. In the "efficiency
framework", this is usually done using cost-benefit analysis techniques.
17. The extent to which the economic benefits of a project can be quan-
tified depends on the nature of the project. 2 The benefits of projects in the
agriculture and industrial sectors can usually be quantified, as there generally
is a functioning market for their outputs. When most of the benefits cannot
be quantified as in many social sector projects, those benefits that cannot be
quantified should be explicitly identified as unquantifiable and evaluated in
qualitative terms. For such projects, macroeconomic considerations and cost
effectiveness in relation to assessed needs together with impact analysis should
be the major focus of economic analysis.
18. As indicated earlier, since social equity aspects are not to be incorporated
in cost-benefit calculations, the items listed below should be evaluated to the
extent possible as a supplement to cost-benefit analysis.
5
groups should be clearly defined in the context of the country
and not in the context of the project.
If the project has additional significant economic or social effects, these should
be described separately.
A. General Approach
4 Defined as the number of workers employed per unit of investment or output relative
to the sectoral and national averages.
5 See Appendix 3, "Measurement of Economic Benefits"
6
of industrial or agricultural projects, this is relatively straightforward since the
major benefit is additional output of goods which are widely traded. In transpor-
tation projects, the benefit may be measured in terms of cost savings, and in
public utility projects, in terms of the gain to consumers. In some social sector
projects, benefits may be assessed only in qualitative terms. The benefits expected
from a project will help define its costs. All costs incurred in realizing the benefits
must be taken into account in the analysis, irrespective of whether they form
a part of the financial cost of the project.
23. The project accounts are based on streams of inputs and outputs and
corresponding flows of costs and benefits. The accounts may not reflect fully
all resources required for realizing the project benefits, or all the benefits to
be realized due to the project. Thus, a distinction should be made between
(i) the inclusion or exclusion in the cost-benefit analysis of certain types of inputs
and outputs, and (ii) the valuation of these inputs and outputs. The modifica-
tions to the project accounts required with respect to (i) above are dealt with
in this section. Those relating to (ii) are discussed in the next section.
B. System Costs
7
project can also be considered as viable, provided that it is also the least-cost
alternative for achieving the desired result.
C. Sunk Costs
25. A project may require the use of facilities in existence prior to appraisal
of the project. The cost of such facilities are "sunk costs" and thus should not
be included in the project cost, provided that these facilities have no alternative
use, and their use in the project involves no opportunity cost.
D. Contingencies
6 See Appendix 10, "Guidelines for the Treatment of Price Changes in the Economic
Analysis of Projects".
8
E. Working Capital
F. Transfer Payments
29. Some of the items included in the financial analysis of a project are
not economic costs since they do not increase or decrease the availability of real
resources to the rest of the economy. These items may, however, affect the
distribution of financial costs and benefits between the project entity and other
entities. Taxes, duties and subsidies are examples of transfer payments that
should be excluded from the economic analysis of projects. To the extent that
these are reflected in the unit financial prices of inputs and outputs, they should
be excluded from the procedures for economic pricing discussed in the next
section.
G. Depreciation
9
project's life. The time profile and magnitude of these expenditures does not
generally coincide with the time profile of depreciation in the financial accounts
of the project. Moreover, at the end of the project's life, the assets created may
have some residual value, even though they may be fully depreciated in the
financial accounts. Hence, economic analysis requires that depreciation provi-
sions be excluded and that expenditures for repairs, maintenance and replace-
ment and the salvage value of assets at the end of the project life be taken into
account.
H. Depletion Premium
I. Consumer Surplus
32. Consumer surplus arises when the output of a project leads to a reduc-
tion in the price of the output. A lower price results in a saving to consumers
because of the difference between what they are willing to pay and what they
actually pay. The benefit arises because of the project, but is not reflected in
the project accounts. With an unchanged price, such a situation may also arise
if the price is fixed below the demand price by the government or a government-
controlled enterprise, as may well be the case for public utilities.
8 See Appendix 4, "Guidelines for Pricing Inputs and Outputs in the Economic Analysis
of Projects."
10
33. The theoretical measure of consumer surplus is the difference between
the price that consumers are willing to pay for any given quantity and what
they actually pay. This can be measured if an estimate of the price elasticity
of demand in the relevant range is available, but this is seldom the case. If such
an estimate is available, it should be taken into account. If quantitative analysis
is not possible, then qualitative assessment should be attempted.
J. Externalities
35. The external economic impact on the cost side may, for instance, in-
clude increased pollution resulting from a cement or a chemical plant, or the
adverse effects of an irrigation scheme on health and fisheries. External economic
benefits may include improved recreational or tourist facilities provided by a
water storage dam. While it may not be possible to measure all such effects,
an attempt should be made to identify them, and if they appear to be signifi-
cant, to evaluate them. In some cases it may be helpful to "internalize" exter-
nalities by considering a package of closely related activities as one project. For
instance, in the case of a cement or chemical project where technologies exist
for reducing pollution, an effort should be made to include pollution-control
facilities in the cost of the project.
A. General Considerations
36. After the costs and benefits of a project have been identified and the
size of their flows over the life of the project established, they should be valued
so that they can be aggregated and compared. The costs and benefits should
be valued according to their economic prices, which in many cases will differ
from their market prices.
11
37. Since the main objective of economic analysis is to assess the real con-
tribution that a particular project is expected to make to the national economy,
costs and benefits should be valued in constant prices, i.e., in terms of the prices
prevailing in the year in which the project is appraised. Any expected change
in the general price level during the life of the project should be disregarded,
but anticipated changes in relative prices (e.g., a greater increase in the price
of oil than in other products) must ~e taken into consideration since relative
price variations reflect changes in the claims on real resources of the country.
38. Financial and economic profitability will coincide if market prices are
equal to the marginal social cost of production (the supply price) and the
marginal social value (the demand price) of all inputs and outputs. Decisions
made on the basis of these prices ensure the most efficient allocation of resources.
However, market prices do not always reflect social costs or sod:il values because
of a variety of market imperfections, taxes, subsidies and other interventions.
For purposes of cost-benefit analysis, discrepancies between market prices and
social costs or values should be taken as given, and policies that cause these
discrepancies must be assumed as remaining effective. However, if there is
evidence that these policies are likely to change, these changes should be taken
into account.
9 See Appendix 4, "Guidelines for Pricing Inputs and Outputs in the Economic Analysis
of Projects."
12
restrictions such as import quotas or to prohibitive trade taxes (i.e., taxes that
are so high as to prevent trade from occurring).10 All other goods and services
are "non-traded". The valuation of these two categories of goods and services
is different.
41. In the case of traded goods it can usually be assumed that the country
concerned can buy and sell such goods at prevailing prices. In this case, traded
goods and services are valued at their "border prices," i.e., net of any trade
taxes or subsidies. These are the CIF prices in the case of imports and the FOB
prices in the case of exports. The prices are calculated by using the official ex-
change rate and then are adjusted for local transport and distribution costs,
though trade taxes or subsidies are not included in the prices used in economic
analysis of projects.
42. Production or use of traded goods by a project generally does not af-
fect border prices since the impact on global demand and supply may well be
small. However, in cases where such an assumption is not justified and project
inputs or outputs are likely to influence border prices, the marginal costs of
the inputs or marginal revenues from the output should be used in valuing traded
commodities. Changes in prices due to a project also affect the demand and
supply of goods and services elsewhere in the economy. The effects of these
changes in addition to their effect on foreign trade must also be taken into ac-
count in evaluating a project.
43. The valuation of non-traded goods and services tends to be more com-
plex than the valuation of traded goods and services because production or use
of non-traded goods in a project often affects domestic market prices of these
and hence the use or production of these goods by other users or producers.
The use of non-traded goods as project inputs may be met partly by reducing
10 Commodities which are not at present traded but would be traded in the absence of
government intervention are often classified as "tradeables", especially when there is an
active world market for them. It may therefore be a desirable additional exercise to evaluate
them directly in terms of border prices in order to assess whether their production would
withstand foreign competition in the absence of intervention.
11 See Appendix 4, "Guidelines for Pricing Inputs and Outputs in the Economic Analysis
of Projects."
13
domestic consumption of these goods and partly by increasing domestic
production. If the use of a non-traded input by the project affects only the
amount of use by others, the input's economic price should be derived from
its marginal value to users (its demand price). If the project affects only the
level of production, then the economic cost should be derived from the input's
marginal cost of production (its supply price). If the project affects both
production of the input and use by others, then the economic price of the input
should be derived from the weighted average of the demand and supply prices,
using the shares of production and use by others as weights.
44. In most cases, the supply price or cost of production is used in the
valuation of non-traded goods and services. However, it should be noted that
there are several cases in which the price of non-traded goods and services departs
significantly from its marginal cost. For example, peak load power or power
supply to rural areas may be priced well below marginal cost, railway tariffs
may not fully reflect the transportation costs of goods either by commodity type
or by destination, and road transport rates may not reflect the costs of highway
development and maintenance. It is necessary that such discrepancies between
price and marginal cost be taken into account in the valuation of non-traded
goods and services.
45. Among non-traded goods and services, labor is the single most impor-
tant component. Hence, an appropriate procedure for the valuation of labor
is important for economic analysis of projects. Since the objective is the
maximization of net output or income, the extent to which labor use affects
project costs or results in loss of output elsewhere in the economy must be assessed.
46. Project accounts are determined on the basis of prevailing market wage
rates for the various categories of labor. In general, the market wage for a
particular category of labor determines the level of employment for that category
of labor. If the prevailing market wage is higher than the supply price of a
particular category of labor, then there will be some unemploymen t for that
type of labor. In such a situation, the additional demand for labor for the proj-
ect will be met, at least partly, by a reduction in unemploymen t and, to that
extent, there will be no loss in output elsewhere in the economy. Hence
14
the appropriate valuation for such unemployed labor will be the supply price
which, by assumption, will be lower than the market wage rate.
4 7. The additional demand for labor in one sector may be met by workers
from another sector. Analysis of the impact of additional labor demand through
interlinked labor markets is required to identify sectors in which the adjustments
will take place. The existence or absence of surplus labor in these sectors deter-
mines the nature of adjustments to labor costs required for economic analysis.
49. Although labor is of many types and grades, for purposes of analysis,
labor required for a project may be divided into the three categories of skilled,
semi-skilled and unskilled. Since the level of remuneration for the three types
varies, each category of labor should be treated separately when establishing
shadow prices.
50. The market for skilled labor is generally competitive and such skills are
often in short supply. The market wage for such workers should therefore be
assumed to be the value of output forgone at market prices for this type of labor.
The market wage should include, in addition to the basic wage, allowances,
social security contributions and other benefits.
15
the informal sector. The net loss of output for the society is thus the marginal
product of a worker in the informal sector, i.e., the informal sector wage.
52. The supply of semi-skilled labor relative to demand is likely to vary from
country to country. If there is a clear evidence of oversupply, then the
"unprotected" wage should be adjusted downward, taking into account the ex-
tent of unemployment in the relevant skills, but not below the "unprotected"
wage for the unskilled labor, since the semi-skilled workers have a competitive
edge over unskilled workers in finding unskilled jobs.
53. With regard to unskilled labor, many developing countries have high
levels of unemployment or underemployment in both urban and rural areas.
In determining the value of unskilled labor in such cases, the "unprotected"
wage should be the starting point. Adjustments should then be made to account
for the extent of unemployment or underemployment in the country, particularly
in the project area, at the same time taking into account the "reservation" wage
below which people in the area may be unwilling to offer their labor as
wage-earners.
54. The economic price of labor in urban areas is likely to be higher than
in rural areas and also to vary from region to region. Such differences arise
in part because labor must be compensated for migrating from one place to
another. In determining the economic price of labor, both the level of skills
required and the location of the project should be taken into account.
E. Conversion Factorsl3
55. The previous sections of this chapter have dealt with the valuation of
traded and non-traded commodities and labor. According to the procedure
suggested, traded goods should be valued in terms of border prices, and non-
traded goods and labor in terms of opportunity costs valued in domestic prices.
There remains the task of bringing the two sets of prices into correct align-
ment. Two approaches are possible in this regard. The first is the shadow ex-
change rate approach, which converts the border prices of traded inputs and
outputs into their domestic price equivalents. The second is the conversion factor
approach, which is used to convert the domestic prices of non-traded goods
13 See Appendix 6, "Guidelines for the Use of Conversion Factors in the Economic Analysis
of Projects."
16
and labor into their border price equivalents. The advantage of the conversion
factor approach is that it takes into account distortions in the pricing of non-
traded inputs and outputs that are specific to the project. Since in Bank
projects most of the outputs and a large proportion of inputs are traded, the
use of conversion. factors yields more reliable results than the alternative ap-
proach. It may be noted that the shadow exchange rate and the conversion
factors are not meant to reflect balance of payments disequilibria; they only
reflect differences between border prices and domestic market prices which may
be present even when the balance of payments is in equilibrium.
58. The supply price conversion factor incorporates all of the adjustments
required to ensure that (i) domestically produced goods are valued at marginal
social cost, and (ii) that this marginal social cost is estimated at appropriate
shadow prices for inputs. The first step in estimating the SPCF is analysis of
the costs of production of the commodity concerned. These costs involve both
traded and non-traded inputs. The traded inputs can be directly valued at border
prices, labor at the shadow wage rate, and the non-traded inputs decomposed
and analyzed in terms of their costs of production. In most cases, no more than
three rounds of decomposition of the non-traded inputs is required to arrive
at an acceptable approximation.
17
59. Demand price conversion factors are to be used whenever a project leads
to a change in domestic consumption; this is generally the case in the valuation
of non-traded outputs. The demand price, or the price that consumers are willing
to pay, is related to the prices and quantities of substitutes and complements
consumed. Changes in the quantities of substitutes and complements consumed
should thus be determined and their amounts valued at border prices. The de-
mand price conversion factor is an approximation that incorporates this cor-
rection. For instance, in the case of a power project, electricity output may
replace petroleum products or coal, which are close substitutes. In the case of
a railway project, the output replaced may be road transport. A demand price
conversion factor reflects the value of a non-traded output in terms of the border
prices of the commodities it replaces.
60. When evaluating the benefits and costs of a project, it is sometimes con-
venient or necessary to use data that aggregates project inputs or outputs into
groups such as the "costs of domestic machinery", "civil construction", "transport
and distribution margins" or, for the shadow wage calculation, "the value of
agricultural output forgone". In such cases, group conversion factors (GCF)
may be used.
62. There are some items for which a group conversion factor cannot be
readily estimated. In such cases, use can be made of a standard conversion factor
(SCF) which is a a weighted average of the commodity conversion factors for
all commodities produced or consumed in an economy_
18
may not be available for an item. In such cases, the following procedure should
be followed. First, correct any underpricing or overpricing of the critical non-
traded inputs relative to marginal cost. Second, segregate the principal traded
inputs used to produce the critical non-traded outputs and value them at border
prices. An SCF can then be used to convert the residual non-traded element
into an equivalent value in border prices. This procedure captures most of the
adjustment required for the inputs.
64. If an SCF is used to convert the entire cost of non-traded output valued
at market prices, the approach is equivalent to using a shadow exchange rate
(SER). The only difference is that use of an SCF converts all values of non-
traded inputs and outputs into their border price equivalents, and use of an
SER expresses the values of traded inputs and outputs in terms of domestic prices.
This does not affect project rankings in terms of desirability or calculations.
However, if commodity-specific conversion factors are used in making any of
the adjustments, the two approaches are not equivalent, except in the unlikely
event that all conversion factors are exactly equal to the SCF. The real advan-
tage of the conversion factor approach is its more thorough treatment of non-
traded inputs and outputs.
65. Conversion factors are basically meant to be used for converting the
domestic prices of non-traded outputs into their border price equivalents. While
traded goods can be valued directly in terms of border prices, since the conver-
sion factors for non-traded outputs are derived from the conversion factors of
substitute and complement goods, conversion factors for traded goods are also
necessary. Conversion factors are also useful in estimating group conversion fac-
tors for both inputs and outputs. Finally, even though traded goods can be
border-priced directly, it is convenient to have a complete set of conversion factors
for commonly encountered project inputs and outputs.
66. Having identified and valued the costs and benefits of a project, the
next step is to compare the two streams in order to determine whether the proj-
19
ect would result in an efficient use of resources from an economic point of view.
A project must satisfy at least two conditions in order to be acceptable for
investment. First, it must yield benefits in excess of costs over its life. Second,
the net benefit must be larger than, or at least as large as that resulting from
the next best alternative project. Three devices are commonly used for com-
paring cost and benefit streams in arriving at investment decisions:
(i) the economic internal rate of return (EIRR), which is the rate
of discount at which the cost and benefit streams over the life of
the project are equalized;
(ii) the cost benefit ratio (CBR), which compares the present values
of the cost and benefit streams by discounting them at a rate equal
to the opportunity cost (or economic price) of capital; and
(iii) the net present value (NPV), which is the difference between the
present values of the cost and benefit streams of a project which
have been discounted at a rate equal to the opportunity cost of
capital.
67. While both the NPV and the CBR have the disadvantage that they re-
quire assumptions regarding the opportunity cost of capital over a fairly dis-
tant time horizon, the CBR is less commonly used because of its high degree
of sensitivity to the way costs and benefits are classified. That is, by grouping
costs and benefits differently, the cost-benefit ratio for the same project can
change substantially. Since there is no fixed rule for grouping the costs and
benefits of a project, it is important to clearly state the grouping of the dis-
counted values of costs and benefits of the project when this method is used.
Despite its shortcomings, the CBR is a useful supplement to other methods,
especially when evaluating a project that requires little or no fixed investment
and which is short-lived and quick-maturing, such as a program loan.
68. The NPV and EIRR are the two techniques most frequently used in
investment decision making. The NPV technique is particularly useful when
an array of projects is to be financed from a fixed amount of money. If the
opportunity cost of capital is known, the NPV method helps identify projects
that will maximize output or national welfare. However, the NPV requires the
use of a discount rate, and a change in this discount rate can change the rank-
ing of projects. Moreover, since NPV is an absolute magnitude, the size of the
project is an important determinant, whereas in EIRR calculations, the size
20
of the project is of much less significance. On the other hand, the EIRR is not
always unique (e.g., where the net benefit stream changes sign more than once)
and is not definable for certain cases (e.g., where benefits exceed costs for all
years). But these pose no practical handicap in using the EIRR technique.
69. It has been standard Bank practice to use the EIRR for the economic
analysis of projects. The major advantages of EIRR over the other two techni-
ques are that it does not require preselection of a discount rate and that it pro-
vides a single measure of the return of the project and allows a ready comparison
among projects. However, the EIRR should be supplemented by other techni-
ques when warranted.
21
cannot be identified and valued, e.g., loans to development banks and for social
sector projects, all other projects must include EIRR calculations in the ap-
praisal report, in addition to identifying the least-cost option.
C. Sensitivity Analysis
73. The EIRR for Bank projects is calculated using the most probable values
of the parameters in the cost and benefit streams of a project. The values of
the parameters, such as quantities and prices of inputs and outputs, can change
over the life of the project for a variety of reasons, and these changes are dif-
ficult to predict. The effects of possible changes in these variables on the EIRR
must therefore be assessed. If warranted, safeguards should be built into the
project to minimize possible adverse effects on the project's viability.
14 See Appendix 7, "Guidelines for Sensitivity Analysis in the Economic Analysis of Projects."
22
determine the impact on project viability of combinations of adverse events.
Sensitivity analysis, including calculation of sensitivity indicators, is standard
procedure in project analysis.
D. Project Risks
76. After carrying out the sensitivity analysis, the next step is assessing pro-
ject risks and considering measures for minimizing them.l5 It is neither possi-
ble nor desirable to identify and examine in detail all the possible risks associated
with a project. However, risks which entail major economic consequences should
be identified using the results of sensitivity analysis.
77. Particular attention should be paid to factors or events that would severe-
ly affect project implementation or would substantially reduce the project's
economic viability. In this context, both the base case EIRR and the sensitivity
indicators are relevant. Some projects are more prone to certain types of risks
than others. For example, an agricultural project oriented toward export pro-
motion would be more subject to the risk of price fluctuation than one oriented
toward domestic consumption. If a high degree of risk is apparent from the
results of the sensitivity analysis, the appraisal report should explain the measures
proposed to minimize the risk.
78. Risks are inherently greater in projects for which the base case EIRR
is only marginally greater than the opportunity cost of capital. This is particularly
so if major variables are highly sensitive to adverse changes because even a
relatively small change in one variable could render the project unviable. Even
if most variables are not very sensitive to such changes, a combination of changes
could adversely affect the economic viability of the project. In such cases, the
discussion of the risk faced and the measures taken for reducing them should
be comprehensive, and the remedial actions proposed should be fully explained.
79. For projects that are known to have high risks, it is desirable to supple-
ment the sensitivity analysis with a probability analysis of the values that each
variable may take, since doing so attaches numerical values to the probable
outcomes. However, due to the considerable work involved in probability analysis
of risks, it is undertaken only for projects carrying a high degree of risk or for
large projects where miscalculations could lead to a major loss to the economy.
23
APPENDIXES
'26
Appendix 1
FORMAT FOR THE CHAPTER ON
ECONOMIC AND FINANCIAL EVALUATION OF
PROJECTS IN APPRAISAL REPORTS
Appendix 1
I. Introduction
2. While the general structure of the format should not be altered, there
may be variations within each main section (e.g., section B, para. 5) in the
sequence of the aspects discussed. Any rearrangement of the material should
reflect the relative importance and interrelationships of the items covered.
1 Initially circulated on 1 September 1982. Revised May 1983 and August 1987.
2 The format outlined here applies to all loan project appraisal reports except those for
development finance institutions.
29
Appendix I
Page 2
Analysis, and Project Risks. In appraisal reports of projects for which benefits
cannot be quantified, the sections concerned, e.g., FIRR/EIRR and Sensitivity
Analysis, will be omitted.
A. Objectives
30
Appendix 1
Page 3
(vi) Other Benefits: If a project has benefits other than those listed
above, these are described at the end of this sub-section.
31
Appendix 1
Page 4
economic internal rate of return of the project over its life. A brief description
should be given regarding the procedure by which the estimates were arrived
at and the underlying assumptions used in calculating the EIRR or FIRR (or
other measures). Cross-references to the appropriate appendixes should be given.
Such analysis only relates to projects for which it is possible to ascribe a monetary
value to project benefits.
D. Sensitivity Analysis
7. This section should discuss the sensitivity analysis of the project for which
FIRR or EIRR is estimated. The discussion should focus on sensitivity indicators
and the viability of the project. 5 The positive ( + ) or negative (-) signs should
not be attached to the sensitivity indicators presented in tables.
E. Project Risks
8. The final section should deal with project risks. The risks discussed should
essentially be economic risks, though major physical or technical risks (e.g.,
in gas production and dam construction) and institutional risks should also be
mentioned. The sensitivity analysis for projects having quantified rates of return
(FIRR or EIRR) serves as a useful basis for describing project risks. In appraisal
reports of projects for which benefits cannot be quantified, the risks in achiev-
ing the objectives of the project should be identified and discussed. This discussion
should include both the costs and benefits of the project and the measures pro-
posed for minimizing these risks. 6
5 See Appendix 7, "Guidelines for Sensitivity Analysis in the Economic Analysis of Projects."
6 See Appendix 8, "Project Risks."
32
Appendix 2
GUIDELINES ON MACROECONOMIC PRIORITIES AND
COMPARATIVE ADVANTAGE OF BANK-ASSISTED PROJECTS
Appendix 2
4. This section should interpret the basic political, economic and social trends
in the country and identify the government's long-term socioeconomic objec-
tives and their relationships with the main socioeconomic problems and develop-
Circulated by the Vice President on 2 October 1978. Revised May 1983 and August 1987.
35
Appendix 2
Page 2
ment needs. The section should assess the development objectives, the extent
of government commitment to them, and the effectiveness with which they are
pursued. In this context, a review should be made of the country's overall develop-
ment strategy, as well as specific development targets. The constraints affec-
ting these targets, the policy measures and resources needed to overcome these
constraints, and the prospect of meeting the necessary requirements should be
examined.
2. External Resources
6. This section should present the Bank's strategy and priorities for assisting
development in the country on the basis of the discussion and evaluation con-
tained in the preceding sections, taking into account the resource position of
the Bank. The section should begin by listing the Bank's country and sector
assistance goals and then discuss these goals in terms of their implications for
the socioeconomic issues in (1) above, describe the rationale of the proposed
sectoral allocation of assistance, indicate the extent to which the proposed com-
bination of assistance responds to aggregate needs for foreign exchange,
technological and institutional requirements, and appraise the relationship of
the proposed program to any specific assistance request made by the Govern-
ment. Any significant changes proposed in the size or sector content of the lending
program (compared with those previously approved) should be highlighted and
justified. The relationship between the country strategy and overall develop-
ment policies on which the Bank places emphasis (e.g., greater domestic pro-
duction of foodgrains and proteins, rural development for enhancing income
36
Appendix 2
Page 3
9. The appraisal report should not merely describe the sector, subsector
or industry to which the project belongs, but should assess and relate the project's
importance to the socioeconomic development of the country. Where the direct
impact of the sector, subsector or industry in overall national output and income
is not large in relation to its investment (e.g., power and some heavy industries
37
Appendix 2
Page 4
such as cement and steel), its indirect impact in promoting economic growth
should be adequately discussed.
10. The chapter on the project should include a discussion of the following
aspects:
(ii) With respect to projects that could normally attract private sources
of finance, the report should provide information on whether (and
the extent to which) alternative sources of financing are available
on reasonable terms.
(iii) The estimated cost of production of the output from the proposed
project compared with cost of imports must be shown, if ap·
plicable. Special justification should be provided for the proposed
project in circumstances where (a) an alternative size would have
reduced the unit cost of production; and (b) the unit cost of im-
ports of the product concerned is lower than the unit cost of the
product from the project.
11. The economic and financial rates of return are the most important in-
dicators of the economic viability and financial soundness of a project. While
the financial rate of return (FIRR) gives a measure of "private" return, the
economic rate of return (EIRR) gives a measure of the return to the society.
Given alternatives in the scope of a project, that which yields the highest EIRR
should normally be selected. In Bank practice, 10-12 per cent has been accepted
as the EIRR cut-off point. A project whose EIRR is less than 10 per cent may
be supported only if there are strong justifications in terms of other socioeconomic
considerations, which should be adequately described. This will ensure that the
project would satisfy the objectives and priorities of socioeconomic development
and reflect efficient allocation of resources.
38
Appendix 3
MEASUREMENT OF ECONOMIC BENEFITS
Appendix 3
A. Background
1 Initially circulated on 7 May 1980. Revised May 1983 and August 1987.
41
Appendix 3
Page 2
(ii) transportation projects, (iii) public \ltility projects, and (iv) social projects.
The special difficulties associated with multi-purpose projects (including rural
and urban development schemes) are not addressed here, it only being necessary
to say that for such projects an EIRR should ideally be calculated not only for
the whole project, but also for each subproject and alternative combination
of subprojects in order to optimize the scope and composition of the multipurpose
investment.
5. Problems arise, however, when for one reason or another the market works
imperfectly. For example, where government intervention takes the form of pro-
tective import duties for industrial commodities or subsidization of agricultural
products in order to assure access to basic nutritional needs of lower income
groups, the observed willingness of domestic consumers to pay for such com-
modities - the market test - tends to understate the benefits of project out-
puts as perceived by the subsidizing authority. In these circumstances, the cost-
benefit calculation should incorporate an analysis of the consequences of such
intervention. The data provided by observed willingness to pay for project out-
puts should ideally be supplemented by estimates of the impact of protective
duties on industrial growth or of the health impact of food subsidies. It is clear
that such estimates are considerably more subjective than those based upon
market information.
42
Appendix lJ
Page 3
2. Transportation Projects
43
Appendix 3
Page 4
9. Public utility projects such as water supply and electric power are in a
situation very different from that of industrial and agricultural projects. In con-
trast to the latter, water and electric power supply projects normally operate
in a restricted market environment in which, mainly because of economies of
scale and the need to avoid duplication of facilities, it is appropriate for the
services to be provided by a local monopoly. In the case of typical industrial
and agricultural projects, the demand for project outputs tends to be elastic,
with market prices of outputs providing a fairly good estimate of economic values.
In the case of water and power projects, the reverse is normally true: the revenues
obtained from sales of water or electric power may be a significant underestima-
tion of the economic benefits thereby derived, due mainly to the presence of
a large "consumer surplus".
2 Even rural electrification benefits often cannot be estimated fully in view of the signifi-
cant growth in energy consumption (the parallel to "generated traffic") that is usually
associated with such schemes.
3 While due to the presence of "consumer surplus" this procedure does not permit a true
cost-benefit calculation to be made, a comparison of costs and benefits at the margin is
possible, and this provides an indication as to whether increased output is warranted.
44
Appendix 3
Page 5
11. In certain cases, the benefits from public utilities may be quantifiable
in terms of their impact on the consumption of other commodities or services.
For instance, the benefits of a powe.r project may be quantifiable in terms of
reduced requirements of other fuels. In such cases, the benefits from public
utilities may be valued in terms of the social value of the impact on the level
of use of other commodities and services.
4 Note that in the case of complex systems, attributing incremental revenues to the project
itself may be arbitrary and in any case may not be a useful indicator of long-term trends
in incremental costs. Therefore, the procedure should be: (a) carry out a demand forecast,
(b) ensure that the project is part of the least-cost program, and then (c) relate incremental
revenues to the incremental cost of the whole system expansion (including the project) over
an appropriate "time slice."
45
Appendix~
Page 6
return, the interpretation is simply that existing prices are lower than the
incremental cost of supply. While the project itself may or may not be
economically justified, the relatively low price that is charged means that
consumers' willingness or unwillingness to pay for the costs of additional output
cannot be demonstrated, and therefore the power or water authority has
inadequate guidance as to whether system expansion is economically justified.
Such a situation points to a clear institution-building role for an international
development institution such as the Bank. Reform of tariff levels and structures,
taking into account relevant economic and social considerations and thereby
helping supply information necessary for reasonable judgment about project
cost-benefit relationships, should be a major objective. For this reason, it is im-
portant to show the internal rate of return that results when projected tariff
reforms are induded on the benefit side of the calculation, although the rate
of return itself may not provide adequate evidence as to the value of the project.
4. "Social" Projects
15. Special mention should be made of housing projects, which do not fall
neatly into any one of the four categories of projects mentioned here and thus
46
Appendix 3
Page 7
provide a good illustration of the general theme of this note. The appropriate
method of valuing the benefits of such projects is determined by the extent to
which market forces are relied upon to allocate housing to project beneficiaries.
Where the housing market works freely, housing projects might be evaluated
in the same way as industrial or agricultural projects. However, housing is often
the subject of governmental intervention, which may take the form of subsidized
low-income housing, slum upgrading, and sites and services facilities. Even for
"social" projects of this kind, some reliance upon willingness to pay is an ele-
ment of the allocation process and the price of alternative accommodation (a
rough parallel to the cost-saving approach used in transportation projects) can
be used as a partial benefit measure, the cost-benefit analysis possibly being
supplemented by evaluation of rental or pricing policy, as in the case of public
utilities. The greater the degree of subsidization, however, the less such indicators
can be employed to demonstrate project justification and the greater the reliance
that must be placed upon judgments about health or productivity effects of
improved housing for project beneficiaries.
C. Conclusion
16. The general conclusion that may be drawn from the foregoing is that
while cost-benefit analysis is a valuable discipline to be followed in the process-
ing of Bank projects, the degree of uncertainty about the nature and magnitude
of potential benefits imposes severe limitations upon the extent to which the
EIRR calculation can be relied upon to determine investment priorities. Indeed,
given the complexity of almost every project for which the Bank lends, it would
be unlikely that any one calculation would be sufficient to encompass all the
economic and social factors that combine to determine the ultimate justifica-
tion of the project. The unquantifiable elements of projects will frequently dwarf
those effects that can be estimated in monetary terms, particularly where social
considerations are central to the decision. Because of this, it is not reasonable
to expect the approaches to be used in the various sectors to have the appearance
of uniformity. Nevertheless, the basic procedure, namely,an analysis of the
"market" for the project outputs, followed by selection of the least-cost solu-
tion and then by some comparison of the expected economic and social costs
and benefits of the selected project, remains appropriate for all sectors.
47
Appendix 4
GUIDELINES FOR PRICING INPUTS AND
OUTPUTS IN THE ECONOMIC ANALYSIS OF PROJECTS
Appendix 4
I. Introduction
1 Initially circulated on 21 August 1981. Revised May 1983 and August 1987.
51
Appendix 4
Page 2
52
Appendix 4
Page 3
be used. This approach is dealt with in greater detail in the "Guidelines for
the Use of Conversion Factors in Economic Analysis of Projects. " 2
B. Treatment of Inflation
8. Over the life of a project, the prices of inputs and outputs can be expected
to rise. In theory, it is possible to project the future rate of inflation and estimate
the prices of both inputs and outputs for every year of the life of a project,
but as the experience of the past decades has shown, average prices of certain
commodities vary considerably from year to year and it is difficult to predict
with a high degree of accuracy the prices that are likely to prevail in the future.
In order to avoid unnecessary complications, economic costs and benefits are
expressed in real terms. It is recommended that the base year be the year of
appraisal, and that all prices be expressed in constant prices of the base year.
C. Pricing of Inputs
10. The primary inputs used in production of a project are labor and goods
and services (hereafter called commodities). In these guidelines only the pricing
2 See Appendix 6, "Guidelines for the Use of Conversion Factors in the Economic Analysis
of Projects."
3 See Appendix 10, "Guidelines for the Treatment of Price Changes in the Economic
Analysis of Projects."
53
Appendix 4
Page 4
11. If an input is produced locally and would have been exported without
the project, its economic cost is equivalent to its export price (FOB). If the input
is not internationally traded and is produced in an industry with excess capacity,
the project demand for the input is met from increased production and its
economic price is the marginal cost of production. If there is no excess capaci-
ty and the project demand is met wholly or partly from diversion from other
uses, the market price, adjusted for taxes and subsidies, represents the economic
cost of the input. However, in certain cases where the price is controlled by
the government, such as power tariffs in many countries, the market price may
understate the cost of production or supply. In such a case, the marginal cost
should be the basis for valuation.
12. If the input is imported from abroad, the import price (CIF) constitutes
the economic cost. What is relevant is not whether the input is imported for
the project, but whether the project requirement leads to an increase in im-
ports in the economy as a whole. In estimating economic prices, adjustments
should be made to the CIF and FOB prices for incidental costs such as port
charges and local transport and marketing costs.
13. In the case of a mixed input composed of traded goods and non-traded
goods, the input should be broken down into constituent parts and their economic
prices derived separately in the manner discussed above. For example, in the
case of domestically produced fertilizer, a portion of the input cost may be
attributable to imported raw materials. To arrive at the economic price, the
cost should be broken into its foreign and domestic components and the op-
portunity cost principle applied to each part to arrive at the total economic
price of the input.
4 For pricing of labor see Appendix 5, "Guidelines for Determining the Economic Price
of Labor."
54
Appendix 4
Page 5
D. Pricing of Outputs
14. The general approach followed in the pricing of outputs is the same
as that for inputs. The output of a project may fall into any of the three
categories: (i) exports, (ii) import substitutes, and (iii) non-traded outputs. Many
projects produce more than one category of output listed above, and economic
pricing of project outputs is better done by separately analyzing the different
categories of outputs.
16. The basis for the economic price of an output which is a substitute for
an import is the price of the import. To arrive at the economic price, it is
necessary to add to the CIF price the cost of transport and handling from the
port to the market and deduct the cost of transport and handling from the project
area to the market. The local currency equivalent for the import substitute is
also referred to as the import parity price.
17. Non-traded outputs consist of goods and services that would not have
been supplied by imports in the absence of the project. This category includes
output of utilities such as power and transport services, agricultural goods s~ch
as vegetables, and other farm products, bulky construction materials or manufac-
tured goods consumed by the local community. The general rule for valuation
of these goods is to use farmgate and ex-plant prices or prices at the point of
first sale after adjustment for transport and distribution costs, taxes, subsidies,
and other transfer payments, as applicable. As in the case of non-traded in-
puts, appropriate adjustments should also be made if the price of output is fix-
ed by the government. In such a case the opportunity cost principle should be
applied.
55
Appendix 4
Page 6
18. The general principles for pricing inputs and outputs mentioned above
can be applied to most of the sectors and subsectors of the economy. The man-
ner in which these guidelines are applied should be decided upon by the project
analyst taking into account the characteristics of the individual project. There
are, however, certain sectors with special characteristics that make analysis of
projects more complex. The following sectors/ subsectors illustrate the applica-
tion of these guidelines and exemplify their special characteristics and problems.
19. The nonrenewable nature of minerals, oil and natural gas differentiates
these resources from those of other sectors. Since the availability of these resources
in a country is ultimately given5, the pace of their use depends upon the discre-
tion of policy makers. When these resources are depleted, further use of the
commodity in question can only occur through imports or through use of
domestic or imported substitutes. This presents a special problem of pricing
for these products, which is discussed below with reference to natural gas.
1. Valuation of Benefits
20. The pricing of the output of a natural gas project does not pose special
problems. If a country is a net importer of fuel, the value of output is the import
price of gas or the substitute displaced by the increased domestic supply of gas
due to the project. The comparison of values could be made at the point of
use on the basis of physical properties such as the calorific values of gas and
its substitutes, with adjustments for differences in quality and convenience of use.
21. If, however, the country exports gas, the value of output computed at
the wellhead is equivalent to the FOB price minus the transport costs to the
5 Refer to natural endowment. Known reserves of course will increase as new discoveries
are made.
56
Appendix 4
Page 7
port. In both cases, account should be taken of a possible increase in the real
price of oil and gas which may be expected during future years for reasons noted
earlier.
2. Valuation of Cost
23. Natural gas is often used as an energy input, e.g., in a power genera-
tion plant, in the manufacture of fertilizer, or as a fuel in an industrial plant.
The economic price of gas as an input in these activities should not simply be
based on the cost of producing gas. Rather, it should be calculated according
to the opportunity cost principle noted earlier. The following illustration clarifies
this position.
57
Appendix 4
Page 8
24. If the output of gas in a country can be used to replace the import of
oil products used in the production of electricity or fertilizers, the economic
price of natural gas should be the import price of the oil products it replaces.
If the country is an exporter of gas, the economic price of gas is its export price
net of transport costs to the point of export. However, in no circumstance should
the economic price of gas as an input be below the economic cost of gas which
includes the production cost, distribution cost and the depletion premium.
B. Fertilizers
25. In the case of a fertilizer project, the general principles discussed earlier
can be readily apphed. The value of project output should be measured by the
world price of fertilizer. If the country is a net importer of fertilizer, the economic
price is the import price (CIF), and if the country is a net exporter, its economic
price is export price (FOB). On the cost side, the economic price of the input
depends upon the source of inputs. If production is based on imported naptha,
the CIF price of naptha is the economic cost of the input. If domestic gas is
the input of the fertilizer plant, the opportunity cost of the gas is the economic
price of the gas.
C. Agro-Industries
58
Appendix 4
Page 9
29. On the cost side, the cost of the oil palm and its processing should be
treated as one entity. The price paid by the factory may not necessarily be the
true economic cost of growing palm in the project area. Thus the economic
benefits of the processing plant maybe inflated or depressed, depending upon
the price paid to farmers. The economic cost of oil palm should include the
initial investment cost, e.g., in land development and planting of trees; the recur-
rent costs of other inputs such as fertilizer, labor, irrigation and the cost of
transporting the fruit to the factory; and the investment and operating cost of
the factory. However, where landholdings are small and individually cultivated,
and the capacity of the processing plant does not match the output from the
project area, it may be necessary to separate the economic valuation of cultiva-
tion and factory operations. The arbitrary decisions made in evaluating these
separately should be explained.
IV. Conclusions
30. The opportunity cost principle should always be kept in view in deter-
mining the economic or efficiency price of goods and services. The opportuni-
ty cost, that is the cost to society, of using a commodity or service as an input
59
Appendix 4
Page 10
31. For all internationally traded goods, the border prices for imports (CIF)
and for exports (FOB) should be used as the basis for determining domestic
parity prices.
32. For goods which are not internationally traded, the domestic prices net
of taxes and subsidies - ex-farm and ex-factory prices - should be used.
However, they should then be converted into their border price equivalents
through the use of conversion factors.
33. To simplify the economic analysis, all benefits and costs should be
expressed in constant prices. The base year should normally be the year in which
the project is appraised.
34. Whenever changes in the relative price of an input or output are an-
ticipated, these should be reflected in the analysis.
35. The costs of production of certain products (e.g., natural gas) which
are inputs to other industries (fertilizer and power) should not be taken as the
input prices of these goods. The opportunity cost principle should be applied
in determining their prices.
60
Appendix 4
Page 11
(ii) The country suddenly discovers a pool of natural gas from which it
can produce just enough gas daily to displace the entire oil import
of 10,000 bbl/day over the next 20 years.
(iii) It costs only $20,000 daily to produce and bring sufficient gas (58
MMCF/day) to the power plant. This cost is not expected to change
for 20 years, when the gas will run out.
(iv) In 20 years, the crude oil cost will be $65/bbl in constant dollars,
i.e., oil prices will have increased at 3 per cent per annum in real
terms.
(v) The assumed discount rate for estimating the present value of the
future benefit stream is 10 per cent.
In the above circumstances, what is the real economic cost to the country of
using the gas to displace imported oil? Since using the gas reserve now would
necessitate imported crude oil at the cost of $65/bbl at the end of 20 years to
meet the country's needs at that time, the real cost of gas or its opportunity
cost must include an element of depletion premium or the cost of replacing
the gas by a substitute in 20 years' time over the cost of producing and transpor-
ting the gas to the plant during the 20-year life of the reserve.
61
Appendix 4
Page 12
In other words, one must put away $1.66 per 1,000 cubic feet of gas used
now to be able to substitute its use in 20 years through oil imports. 1 Therefore,
As is readily apparent, the depletion premium is really the discounted value of the switching
cost. An algebraic expression for the depletion premium per unit in a particular year during
the production period is as follows:
62
Appendix 4
Page 13
this cost must be added to the current cost of producing and transporting gas,
viz., 34 cents/MCF. The economic cost of the first 1, 000 cubic feet of gas thus
equals $0.34 + $1.66 = $2.00.
63
Appendix 5
GUIDELINES FOR DETERMINING THE
ECONOMIC PRICE OF LABOR
Appendix 5
Initially circulated on 16 March 1982. Revised May 1983 and August 1987.
67
Appendix 5
Page 2
labor withdrawn from that sector or industry. Thus, its effect on national out-
put greatly depends upon the types of skills required for the project and the
market for those skills. The SWR will be lower if a particular skill required
is in plentiful supply, i.e., if a large number of persons with that skill are
unemployed. It is therefore often necessary to use a set of shadow wage rates,
one for each skill and location rather than a single rate for the whole country.
68
Appendix 5
Page 3
1. Skilled Labor
2. Semi-skilled Labor
69
Appendix 5
Page 4
10. The supply of semi-skilled labor is likely to vary considerably across coun-
tries. In many countries the supply of these workers is barely adequate to meet
the growing demand. In this case, the market wage rate in the "unprotected"
sector should be taken as representing the opportunity cost of labor. This is
so because even if workers are withdrawn from the "protected" sector, they will
leave vacancies that will be filled from the "unprotected" sector, including recent
migrants whose alternative urban employment would most likely be in the "un-
protected" sector.
11. In countries where workers with such skills are in oversupply and where
there is clear evidence of unemployment, the opportunity cost (shadow wage)
should be adjusted downward, taking into account the extent of unemployment
in the skills concerned. However, care must be taken in assuming very low SWRs
for semi-skilled workers; this is because these workers can also find employment
as unskilled workers. The SWR of semi-skilled workers should thus not be below
the "unprotected" wage which unskilled workers receive in the project area.
3. Unskilled Labor
12. Most of the discussion on SWRs concerns the opportunity cost of un-
skilled labor. Most developing member countries report a high degree of
unemployment and underemployment in both rural and urban areas, with most
of the unemployed being unskilled. In determining the SWR for such workers,
the starting point, as in the case of semi-skilled workers, should be the "un-
protected" wage for unskilled workers in the project area. In determining the
SWR, it should be borne in mind that unskilled employed workers in urban
areas can engage in such unorganized activities as peddling, hawking and shining
shoes. The income from such activities should be taken into account in estimating
SWR. In rural areas, the unemployed may provide help on family farms, doing
seasonal work in nearby industries or working on construction projects. These
alternative activities should also be taken into account when estimating the SWR.
13. The above suggests that where direct information on the annual income
of unemployed and underemployed workers is available, it could be used in
estimating the SWR. Where such direct estimates are not available, the an-
nual SWR of unskilled workers could be estimated by multiplying the
70
Appendix 5
Page 5
14. It should be noted that the procedure outlined thus far establishes the
SWR in terms of the value of output forgone at domestic market prices. This
value of output forgone may be equal to or less than the market wage rate.
The value of output forgone must sometimes be converted from domestic market
prices to border prices in order to get a SWR defined in border prices. This
can be done by applying appropriate conversion factors, a subject treated
separately in the guidelines for the use of conversion factors. 2
C. Basis of Estimation
15. The major task in estimating shadow wage rates is to secure reliable
data concerning the variables listed below.
(i) Regulated and unregulated, or open market wage rates for skilled,
semi-skilled and unskilled workers in the project area. Unskilled
workers form a fairly homogenous group and the wage rate ap-
plicable to them is likely to be more or less uniform in the project
area. For skilled and semi-skilled workers, if the number of skills
involved and the range of wage levels is large, an average wage
rate should be estimated for the project.
2 See Appendix 6, "Guidelines for the Use of Conversion Factors in the Economic Analysis
of Projects."
71
Appendix 5
Page 6
16. In countries where reliable and up-to-date data are available from the
above sources, it may not be difficult to estimate shadow wage rates. Where
such data are not available, it may be necessary to perform limited surveys as
part of the feasibility study for a project. In any case, most of the work in
estimating SWRs should be carried out at the feasibility study stage. The terms
of reference for project preparatory technical assistance should include, as part
of the economic evaluation of the projects, the gathering of adequate informa-
tion for the estimation of shadow wage rates.
18. A convenient and useful approach in ascertaining the need for such
refinements is to subject SWRs to sensitivity tests. If the tests show that the EIRR
of a project is relatively insensitive to changes in the wage rate, further
refinements may not be required. If, on the other hand, the EIRR is found
to be relatively sensitive, further refinements may be warranted or justification
may be required to show that the SWRs used provide an appropriate measure
for the opportunity cost of labor.
19. According to the opportunity cost principle, the economic price of Ia bor
or the shadow wage rate (SWR) may be defined as the marginal product of
labor (MPL) forgone elsewhere in the economy due to its use in the project.
72
Appendix 5
Page 7
21. Since skilled workers are generally in short supply in developing coun-
tries, prevailing market wages in the project area may be taken as a proxy for
their economic wage. In estimating the SWR, benefits other than wages should
also be included.
22. For semi-skilled workers, wages in the "unprotected" wage sector ad-
justed for the degree of unemployment in the project area should be used as
the basis for estimating the SWR. Where there is no unemployment for such
skills, the "unprotected" wage should be taken as the SWR.
23. For unskilled workers, who normally account for the bulk of wage ex-
penditure, the annual SWR should be estimated on the basis of the "unprotected"
wage rate and the number of days of gainful employment during the year.
24. Data on wage rates and unemployment in or around the project area
available from national surveys and other such sources should be used in
estimating the SWR. Where such data are not available, it may be necessary
to carry out limited independent surveys during the project feasibility stage.
25. In projects for which wages constitute a very small proportion of the
total cost and benefit streams, and where technological options are limited,
it may not be necessary to estimate the SWR.
73
Appendix 6
GUIDELINES FOR THE USE OF CONVERSION FACTORS
IN THE ECONOMIC ANALYSIS OF PROJECTS
Appendix 6
I. Introduction
A. The Concept
77
Appendix 6
Page 2
4. The discrepancies between the domestic prices of non -traded items and
their border price equivalents are due to two main reasons. The first is the
possibility that domestic prices may not reflect marginal costs; the second is
the discrepancies between market prices and border prices for the inputs that
define this marginal cost. Conversion factors take both these elements into
account.
78
Appendix 6
Page 3
5. Conversion factors are applied to the cost of all the non-traded com-
modities and services used or produced by a project. In principle, a separate
conversion factor should be estimated for each non-traded commodity used in
a project. In practice, this is seldom possible, and frequently a common con-
version factor is calculated for a group of commodities. The extreme form of
the conversion factor is a single conversion factor calculated for all commodities
produced (or consumed) in the economy. Hence, three types of conversion factors
may be distinguished: (i) commodity conversion factors (CF) for specific com-
modities or services, (ii) group conversion factors (GCF) for a group of related
commodities or services, and (iii) standard conversion factor (SCF) for all com-
modities and services produced (or consumed) in the economy.
6. Commodity conversion factors are used for converting the values of specific
commodities used as inputs or produced as outputs in a project. The illustra-
tion for electricity given earlier is an example of a commodity-specific conver-
sion factor. The use of such specific conversion factors is generally restricted
to a few major non-traded project inputs or outputs.
79
Appendix 6
Page 4
10. In certain cases, even where the data required for the adjustments de-
scribed above are not available, the SCF may be applied to the entire cost of
non-traded items without any adjustment. In such cases, the conversion factor
approach is equivalent to the shadow exchange rate (SER) approach, the only
difference being that the first approach expresses the costs and benefits of a
project in terms of border prices and the second expresses them in terms of
80
Appendix 6
Page 5
domestic prices. The SCF indicates the border price of goods worth one unit
when valued at domestic prices, while the SER indicates the domestic price of
goods worth one unit when valued at border prices. For any economy, the SCF
and the SER are inversely relatedl. For instance, if the standard conversion
factor is 0.8 then the equivalent shadow exchange rate is 1.25 (i.e., 1.0/0.8.)
times the official exchange rate.
11. The SCF and SER do not measure the extent of foreign exchange im-
balance, but measure only the average discrepancy between domestic and border
prices. For example, a country's balance of payments may be in equilibrium
at the prevailing exchange rate, yet the SER as defined above would still differ
from the prevailing exchange rate if there are distortions due to factors such
as duties and quotas. This is true for any country irrespective of whether its
balance of payments position is favorable. The SCF or SER should not be
regarded as an equilibrium exchange rate or as a way of attaching a premium
to foreign exchange in a situation of foreign exchange scarcity. The SCF and
SER only compare values expressed in domestic prices with values expressed
in border prices.
12. The conversion factors defined above reflect the impact of a change
in the availability of a non-traded item in terms of border prices. However,
this varies depending on whether the impact is on production (i.e., input) or
consumption (i.e., output). In the electricity example above (in para. 3) it was
assumed that the additional electricity demand from the project would lead
to increased production of electricity in the economy. Such an assumption is
generally relevant when dealing with non-traded inputs. Since the impact was
on production, the effects were analyzed in terms of the inputs required by the
increase in electricity production. However, in the case of a project that pro-
duces electricity (as an output), a plausible assumption is that the additional
output of electricity would lead to increased consumption of electricity in the
1 SCF = (1/SER)OER, where OER stands for the official exchange rate and SER for
the shadow exchange rate.
81
Appendix 6
Page 6
13. The two types of conversion factors described in para. 12 above are
"supply price conversion factors" (SPCF), which are used when the impact is
on production, and "demand price conversion factors" (DPCF), which are used
when the impact is on consumption. The SPCF generally relates to non-traded
inputs and the DPCF to non-traded outputs. There may be cases in which the
impact of a project is partly on production and partly on consumption. For
instance, the additional electricity requirements of a project may be met partly
by increased production and partly by reduced consumption of electricity
elsewhere in the economy. In that case a weighted average of the SPCF and
DPCF should be used. 3
14. Conversion factors are required basically for valuing non-traded com-
modities. Traded goods and services can generally be valued directly at border
prices. However, since the conversion factors for non-traded outputs are derived
from the conversion factors of closely related substitutes and complements, it
is necessary to derive conversion factors for traded items. 4 Further, the latter
are also useful in estimating group conversion factors for both inputs and out-
puts. For example, to estimate a consumption conversion factor, which is a GCF,
conversion factors of both traded and non-traded goods should be included in
the consumption basket.
2 Excluding transport and distribution costs, though these should be normally taken into
account.
3 In algebraic terms: CF = (aE + bN)/(E + N) where a and bare the SPCF and DPCF,
respectively. E and N are the (absolute) values of the demand and supply elasticities.
4 For instance, the conversion factor for fresh fish that is not traded could be derived
on the basis of the conversion factor for dry salted fish that is traded.
82
Appendix 6
Page 7
15. The conversion factor is generally the ratio of the border price to the
market price. However, the border prices of some traded goods change when
the project is implemented. This may be the case for a project that produces
an exportable output for which the country already has a major share of the
world market. In such cases, which are likely to be rare, instead of the border
price, the marginal revenue from export should be used in calculating the con-
version factor.
16. Conversion factors are particularly useful in shadow wage rate (SWR)
calculations using border prices. While the shadow wage rate is defined in terms
of output forgone in the rest of the economy, the output forgone must be valued
in terms of border prices. Generally, output forgone in the case of skilled labor
is industrial output, and a GCF is necessary to identify industrial commodities
whose output is affected by the diversion of skilled labor. Similarly, iQ the case
of semi-skilled and unskilled workers, the SWR is defined in terms of the out-
put forgone in the "unprotected" sector.5 In such cases, a group conversion fac-
tor for converting the value expressed in terms of domestic prices to its border
price equivalent will also be required. This could be a group conversion factor
for industrial OJ.ltput or agricultural output, depending on the nature and loca-
tion of the project.
I. Sensitivity Test
83
Appendix 6
Page 8
A. Approach
18. This chapter suggests how the various types of conversion factors can
be estimated from available data. The main objective of the estimate is to arrive
at a central value for each conversion factor. This includes all major corrections
required. The method of calculating the SPCF and DPCF is presented, followed
by a discussion of methods for estimating the GCF and SCF. These methods
require the use of trade data, which is explained in the final part of this chapter.
19. The first step in estimating the SPCF for a commodity or service is to
establish whether its domestic price reflects the marginal cost of producing it.
The financial performance of enterprises that supply the non-traded commodity
or service should be examined. If the enterprises operate at a loss or show finan-
cial rates of return that are abnormally low or high, there is prima facie evidence
that market prices and costs diverge. Further examination may show whether
this divergence affects the supply price paid by users. For example, in many
countries tariffs for rural power supply are particularly low relative to the cost
of supplying such power. Thus, when analyzing a ground water irrigation project
based on electric pumpsets, the cost of electricity must be adjusted upward.
84
Appendix 6
Page 9
idle. Such project-specific variations in costs can be estimated if the project report
identifies all linked investments.
21. Correction of the discrepancy between prices and costs requires a large
measure of judgment and can be readily justified only when there is an obvious
discrepancy. A useful way of quantifying the discrepancy is to examine similar
projects. For instance, if an estimate of the costs of rural power is needed for
a lift-pump irrigation project, the data for a rural electrification scheme in the
same country may provide a reasonable approximation of them.
22. Having established the cost of production that reflects the real resource
cost in terms of domestic prices, the next step is to express this cost in its border
price equivalent. The method of decomposition should be used to do this. In
this method, the cost of production in terms of input costs is first analyzed.
The inputs that are traded commodities and services can be valued directly at
border prices. Portions of the cost that are clearly transfer payments should
be excluded. The remainder will consist of labor, which can be valued at the
shadow wage rate expressed in terms of border prices, and of other non-traded
items. The remaining portion of the cost should likewise be disaggregated, with
each part being analyzed in terms of cost of production, the traded part of this
cost being valued at border prices, labor at the shadow wage rate, and the non-
traded items being analyzed further. Normally, two or three rounds of decom-
position produce most of the corrections required.
23. When the representative commodities used for deriving the conversion
factors differ from the commodity that will be used in the project, the use of
commodity-specific conversion factors introduces an element of approximation.
For instance, for a railway system as a whole, a commodity-specific conversion
factor may be based on the mix of traction (steam, diesel, electric). However,
a project may only use rail transport with one type of traction. In that case
the commodity-specific conversion factor for rail transport may need further
adjustment. However, if commodity-specific conversion factors are available
for each mode of traction separately, then they may be used for different types
of projects without introducing large errors in the analysis. This could greatly
reduce the amount of work involved in the analysis.
85
Appendix 6
Page 10
C. Commodity-Specific DPCF
86
Appendix 6
Page II
not available. Second, the GCF can be based on group-level data of the ratio
of border prices to market prices, which may be easier to estimate than similar
ratios for individual commodities. Therefore, it may be easier to calculate the
GCF than specific CFs.
28. Group conversion factors may be calculated only for commonly en-
countered aggregates. On the project cost side, these may include civil con-
struction, domestic machinery, transport and distribution margins. The shadow
wage rate calculation requires GCFs for industrial output and agricultural output
and a GCF for low-income consumption.
30. The standard conversion factor is a group conversion factor for which
the group covers all commodities produced or consumed in the economy. Hence,
it should be calculated as the weighted average of the conversion factors for
specific commodities or groups of commodities. However, certain short cuts can
be used for calculating the SCF.
87
Appendix 6
Page 12
32. The ratios of border prices to market prices for a variety of commodities
must be known in order to calculate GCFs and SCFs. These can be approx-
imated from foreign trade data and net border taxes on the commodities con-
cerned. This approximation is given by the "border value formula" as follows:
M+X
CF = ---------
where M and X are values of imports and exports in border prices, respective-
ly, where T m is revenue from import duties net of subsidies, and where T x
is revenue from export duties net of subsidies.
33. By use of this formula, conversion factors can be derived at any level
of disaggregation permitted by the trade and revenue data. Generally, the
limiting factor is the level of disaggregation of the revenue data. The GCF for
any group can then be derived as a weighted average of a subset of these ratios,
the weights being derived from consumer expenditure surveys, crop produc-
tion estimates, or censuses of manufacturing.
88
Appendix 6
Page 13
35. The simplest approximation for the SCF is given by the border value
formula given above. However, this is a rather crude approximation because
(i) it assumes that the shares of the various commodities in the total value of
trade approximates the shares in production (or consumption), and (ii) it does
not take into account the possibility that for some commodities the spread be-
tween domestic prices and border prices is greater than the net border tax.
where Ca and Cm are the GCFs for agricultural and industrial output and W a
and W m are the weights attached to them, the weights being the relative shares
of agriculture and industry in total production. 6
6 This is a supply-price SCF suitable for valuing non-traded inputs. Non-traded outputs
generally should be valued in terms of border prices. However, if a demand-price SCF is
required it can be calculated from the same formula, the relative weights being the shares
of agricultural and industrial commodities in national expenditure rather than in national
output.
89
Appendix 6
Page 14
IV. Conclusion
38. In the first stage an SCF is derived from trade and border tax data and
the decomposition method is applied to a few major non-traded items. In the
second stage, CFs and GCFs are estimated for major non-traded inputs and
outputs and for major categories of inputs and outputs commonly encountered
in project analysis. In the third stage, specific conversion factors for commodities
and services in each country are derived. In each sucessive stage, further
refinements may be introduced as more and better data become available.
90
Appendix 6
Page 15
The numerical example regarding the conversion factor for electricity given
in paragraph 3 can be used to illustrate the method of decomposition.
The first step is to estimate the cost of production which is, say, 60 cents
per kWh. This may have been derived from the accounts of the national elec-
tricity agency or from a recent project report. The same source may also disag-
gregate this cost. Let us assume it is as follows:
This is the first-round decomposition. Fuel oil is tradeable and can be valued
directly at border prices. While the O&M component is small, and further
decomposition is unnecessary, a second-round decomposition is desirable for
capital charges.
These shares are then applied to the share of capital charges in electricity pro-
duction. The imported machinery component can be valued directly at border
prices. Transfer payments (mainly duties on imported machinery) should be
excluded. Since the other domestic costs are small, only the civil works compo-
nent should be decomposed further.
91
Appendix 6
Page 16
Cement 20%
Steel 20%
Unskilled labor 40%
Other domestic cost 20%
These latter shares should then be applied to the civil works component in the
second-round decomposition. Cement and steel can be valued directly at border
prices, and unskilled labor is valued at the shadow wage rate. The other domestic
cost component forms a substantial proportion of civil works costs, but its im-
pact on the shadow price of electricity is limited since it constitutes only 2 per
cent of the capital charge of 30 cents per kWh. Thus it need not be disaggregated
further.
The weights total 0.85 because the transfer payments were excluded from the
capital charges component, these payments accounting for 30 per cent of capital
costs and hence 15 per cent of electricity costs.
An SCF of 0.9 is assumed for the country; the ratio of the SWR to the
market wage is estimated at 0. 7 after valuing output foregone at border prices.
The other elements are basically traded goods, and the conversion factor is simply
the ratio of their border price to the market price implicit in the cost data.
For imported machinery, we assume a CF of one since tariffs have already been
92
Appendix 6
Page 17
netted out. For steel and cement, we assume that domestic prices are 25 per
cent higher than CIF prices, i.e., that the CF is 0.8. In the case of fuel oil,
we assume that while the country is a net exporter, as a matter of policy, the
price charged to power plants is kept well below the FOB export price. Thus
the conversion factor is 1.93, i.e., the border price for fuel oil is 93 per cent
higher than the domestic price paid by electricity plants. Assuming these values,
the conversion factor for the cost of production of electricity is 1.2515, or 1.25.
In the example, the cost of production is 60 cents per kWh against a market
price of 50 cents per kWh, i.e., thus the cost of production is 20 per cent higher
than the market price. Hence the conversion factor for electricity is 1.2 x 1.25
= 1.5.
It is assumed that the road transport freight rate is 30 cents per ton-kilometer
(tkm). There is no serious underpricing relative to costs but there is a freight
tax of 2 cents per tkm; thus the "cost of production" of road transport is 28
cents per tkm.
93
Appendix 6
Page 18
Representative data on trucking operations are available, and the cost data
are reconstructed in the following manner.
(i) A new truck costs $150,000 and is used for long-distance hauling for
five years, after which it is sold for $50,000. Assuming a capital
recovery factor of 12 per cent for five years, and taking account of
the resale value at the end of five years, the annual capital charge
is $33,750.
(ii) The truck's diesel consumption is one liter per 5 km and the domestic
cost of diesel is $3 per liter. The cost of lubricants is 5 per cent of
fuel costs.
(iii) The cost of drivers and other staff is $25,000 per year.
(iv) The cost of maintenance is 10 per cent of capital costs, i.e., $15,000
per year.
(v) The truck can carry 10 tons and it covers 50,000 km per year; 25
per cent of this represents unloaded return trips.
(vi) It is assumed that there is no other capital cost (e.g., for roads or
terminal facilities).
94
Appendix 6
Page 19
This is the first-round decomposition. We assume that fuel and lubricants are
traded goods, and that drivers and staff are semi-skilled workers. Capital charges
equal only the cost of the truck which is assumed to be imported. Maintenance
expenditures must be disaggregated further.
Labor 50%
Imported components 40%
Other costs 10%
We assume that trucks and imported spare parts are subject to a tariff ,of 20
per cent. Thus the CF for the trucks and spare parts is 0.83. Since we assume
that fuel and lubricants are subsidized, the CF is calculated at 1.3. The SWR
for semi-skilled labor is 0.8 times the market wage and the SCF is 0.9. Thus
the CF for the cost of production of road transport is 0. 9627.
Since cost of production of road transport is 28 per tkm and the market
price is 30 cents per tkm, the CF for market prices is 0.8985, or 0.9.
95
Appendix 7
GUIDELINES FOR SENSITIVITY ANALYSIS IN
THE ECONOMIC ANALYSIS OF PROJECTS
Appendix 7
A. Introduction
l. For projects for which most benefits can be quantified, standard Bank
practice is to judge the economic viability of a project by its economic internal
rate of return (EIRR).2 Calculation of the base-case EIRR essentially involves
comparing the project's expected cost and benefit streams, which in turn are
based on the most probable values of key variables. Both the magnitude and
the distribution of these streams over time are influenced by a wide variety of
factors, and changes in these streams cause the EIRR to change. Sensitivity tests
show the extent to which the EIRR changes when the values of key variables
change. They thus provide additional information about the economic viabili-
ty of a project that can be of considerable value when making decisions about
extending Bank assistance.
2. The purpose of these guidelines is twofold. First, they inform new Bank
staff as to how sensitivity tests are carried out in Bank project appraisal. Second,
they ensure uniformity in the presentation of the results of sensitivity tests in
future appraisal reports.
3. The procedures presented here should be followed for projects for which
costs and benefits are fully or for the most part quantifiable. Sensitivity tests
are also used to verify the cost effectiveness of projects for which the EIRR can-
not be estimated because the benefits are for the most part not quantifiable.
Projects in areas such as public health, education and family planning are clearly
of this type. Sensitivity tests are not appropriate for projects comprising credit
lines to development finance institutions since the subprojects to be financed
have not been identified at the time the projects are appraised.
1 Initially circulated on 18 March 1980. Revised May 1983 and August 1987.
2 The discussion here is limited to sensitivity analysis of the EIRR. Sensitivity tests should
also be applied to the financial rate of return following the procedures presented here. They
can also be applied to other indicators of the economic viability of a project such as
benefit/cost ratios and net present value.
99
Appendix 7
Page 2
5. Sensitivity analysis involves three steps. The first step is to determine the
changes in the value or quantity of each key variable most likely to occur. The
next step is to determine the effect of each change on the cost and benefit streams
and to calculate the EIRRs implied by these changes. Finally, the results ob-
tained are interpreted and the implications explained.
6. It would not be practical to examine the effects on the EIRR of all possible
changes in every variable. Attention should therefore be focussed on the following
key variables:
7. The prices of project outputs!! partly determine the size of the benefit
stream, while the prices of project inputs influence the cost stream. These sets
3 Constant prices are used in calculating IRRs. Thus the changes in prices in these
guidelines refer to relative price changes unless otherwise noted. See Appendix 10, "Guidelines
for the Treatment of Price Changes in the Economic Analysis of Projects".
100
Appendix 7
Page 3
9. The quantities of project outputs may also be less than anticipated for
a variety of reasons. These include inadequate supplies of spare parts, power,
or irrigation water. Such shortfalls will clearly affect project benefits. Further,
the quantity of project outputs produced per unit of inputs may not reach the
rate assumed in the calculation of the base case EIRR because of similar reasons
such as inefficient use of inputs, a shortage of skills, difficulties in adjusting
to a new technology, or inefficient management. All such possibilities should
be considered.
I 0. The level of capacity utilization of the project facilities may also be lower
than projected, thereby affecting both the project's benefit and cost streams.
The extent of capacity underutilization in power, transportation and industrial
projects can be expressed as a percentage of the level of utilization assumed
in calculating the base case EIRR. In irrigation projects, underutilization as
indicated by the expected reduction in cropping intensity can be expressed as
a percentage of that assumed in the base case EIRR. A lower-than-optimum
level of capacity utilization reduces output and hence project benefits, even
though it also reduces operating costs. The effects of capacity underutilization
should therefore be expressed in terms of the net effect on the project.
II. The amount of time taken to commission project facilities and to achieve
the target level of capacity utilization may be longer than that envisaged at
appraisal. If project facilities are not completed as specified in the implemen-
tation schedule, both the cost and benefit streams will be different from those
assumed in calculating the base case EIRR. It is further possible that even when
the project facilities are completed on schedule there may still be a delay in
IOI
Appendix 7
Page 4
attaining the target level of output. In this case both the cost and benefit streams
will likewise be affected. The effects of such a delay should therefore be ex-
pressed in terms of the net effect.
12. In cases where project benefits are derived from a single output, a given
percentage change in the level of output will change the benefit stream by the
same percentage. If the benefit or operating cost stream comprises a small
number of items and the mix of these items remains constant, a given percent-
age change in one item will result in a percentage change in the former equal
to the change in the item times the percentage share of the item in the benefit
or cost stream. Where the cost or benefit stream comprises numerous items,
the effect of a change in one item could be small. In such cases it would be
sufficient to indicate the overall change in the cost or benefit stream and its
effect on the project's EIRR.
13. Where several important items in the cost or benefit stream are likely
to change during the project life, sensitivity tests for each should be performed.
14. This section presents the guidelines for sensitivity analysis and presen-
tation of results for Bank-assisted projects. A numerical example follows.
(i) The key variables should be examined and all relevant possible
changes in them stated.4 The basis for assuming these changes
should also be clearly stated.
(ii) Changes in the prices or quantities of inputs and outputs that will
affect either the benefit or cost stream should be expressed in terms
of the resulting percentage change in the benefit or cost streams.
4 Favorable changes would enhance the viability of the project. Since the purpose of sen·
sitivity analysis is to show whether the project would remain viable if circumstances less
favorable than those assumed in calculating the base case EIRR prevailed only unfavorable
changes are to be considered.
102
Appendix 7
Page 5
(iii) The range of EIRRs implied by the assumed changes in the benefit
or cost stream should be calculated and presented.
(vi) A sensitivity indicator (SI) which shows the sensitivity of the EIRR
to changes in the variable tested should also be presented. 5 Sis
should be calculated for changes in benefit and cost streams, the
rate of capacity utilization, and other key variables to which sen-
sitivity tests have been applied.
103
Appendix 7
Page 6
In this example, the purpose of the project is to construct a mill for pro-
ducing two products: A and B. Product A is to contribute 60 per cent of total
sales revenue while product B is to contribute 40 per cent. The mill is to be
commissioned in four years and operated for 20 years, after which it will be
scrapped.
A. Key Variables
Table 1 shows the quantities and values of the key variables used in the
calculation of the EIRR for the base case and those chosen for the sensitivity tests.
The behavior of the prices of the project outputs in the past were examined
and the likely future supply and demand for both were considered. It was then
assumed that the worst case scenario would be a 10 per cent reduction in the
prices of the outputs on the average throughout the project life.
104
Appendix 7
Page 7
While the agency responsible for operating the project has experience with
the processes for producing both A and B, part of the labor force has no ex-
perience, particularly with respect to the production of product B. It is therefore
possible that productivity might lag. Lower-than-expected productivity would
reduce the cost of materials, but have no effect on other costs. To examine
the sensitivity of project benefits to this possible decline in productivity, a pro-
ductivity decline of 10 per cent for A and 20 per cent for B are tested.
While the cost of raw materials fluctuated widely before 1980, in that year
a buffer stock arrangement came into operation that stabilized the prices of
these commodities. Since changes in the prices of raw materials have been within
a range of 20 per cent since 1980, an increase in the cost of raw materials of
20 per cent is tested.
The price of fuel oil has also fluctuated considerably during recent years
and further increases may occur. An increase of 40 per cent in fuel oil costs
above the base case level is chosen for testing. It is assumed that this increase
will persist throughout the project life.
The prices of the materials used in constructing the project facilities are
expected to increase, but at a rate equal to the domestic inflation rate. The
quantities of inputs, however, could exceed those allowed in the estimates. The
effects of a 10 per cent increase in construction costs are therefore tested.
105
Appendix 7
Page 8
The results of the sensitivity analysis are presented in Tables 2 and 3. Table
2 shows the effects of changes in key variables on the benefit and operating
cost streams. Table 3 shows the range of EIRRs calculated for the various assump-
tions and the sensitivity indicator for each.
The EIRR is most sensitive to changes in the benefit stream arising from
changes in prices and productivity. However, past trends indicate that the prices
of both A and B have been very stable. Further, analysis by consultants and
other independent experts of the future demand for and supply of these products
suggest stable or slightly increased prices for these goods. Thus a sharp fall in
the prices of project outputs is not likely. As regards productivity, a fall below
the base case level is a distinct possibility, at least for the first few years of opera-
tion because of lack of experience on the part of the labor force. In order to
minimize the impact of such an eventuality, a specially designed training program
for workers is included in the project.
Three combinations of adverse changes are tested (see Table 3). The first
combination includes a delay in project completion, a cost overrun (since these
two generally occur together) and an increase in operating costs. If all three
occur simultaneously, the project is still viable. The second combination tests
increases in both investment and operating costs and a decrease in the prices
of the outputs. The third combination tests a delay in construction, a decline
in productivity and a reduction in capacity utilization. These tests show that
if these combinations of adverse changes occur simultaneously, the EIRR
decreases substantially, but the project remains viable.
106
Appendix 7
Page 9
Percentge Changes
Changes in the Values
Shares of in
of Key Variables
Total Total
From To (%) (%) (%)
A. Operating Coetsa
B. Benefits
107
Appendix 7
Page 10
7. Combined Unfavorable
Assumptions
(a) Combination of (1 ),
(2), and (6) 17.63
108
Appendix 8
PROJECT RISKS
Appendix 8
PROJECT RISKSl
2. The economic internal rate of return (EIRR) is the measure most often
used to indicate the economic viability of Bank-financed projects. Calculation
of the EIRR requires a set of assumptions regarding the conditions faced by
the project which in the judgement of the appraisal mission are most likely to
prevail during its life. However, since Bank-financed projects normally have
a very long life, the conditions faced by the project may change for a variety
of reasons. Sensitivity analysis is therefore carried out to determine the effects
of possible changes in the values of key variables (costs, yields, and prices of
inputs and outputs) on the project's EIRR.2
1 Initially circulated on 11 February 1981. Revised May 1983 and August 1987.
2 See Appendix 7, "Guidelines for Sensitivity Analysis in the Economic Analysis of Projects".
111
Appendix 8
Page 2
6. Risks are obviously greater in projects for which the base-case EIRR is
only marginally higher than the opportunity cost of capital. These larger risks
are even greater if the EIRR is highly sensitive to changes in key variables since
even a small reduction in the EIRR would render the project unviable. Even
when the EIRR is relatively insensitive to changes in key variables, combina-
tions of adverse changes might easily affect the project's viability. Thus in such
cases the remedial actions proposed or adopted should be fully explained.
3 While the opportunity cost of capital varies among countries, a minimum EIRR of 10
to 12 per cent is generally acceptable to the Bank.
112
Appendix 8
Page 3
report, they should be summarized under the discussion of project risks if the
EIRR is relatively sensitive to delays in project implementation, and especially
if such a delay would adversely affect project viability.
9. By their very nature, certain types of projects such as gas and oil
exploration involve very high risks. For such projects, it is necessary to supple-
ment the sensitivity analysis with a probability analysis. The latter provides a
range of possible outcomes in terms of a probability distribution and based on
that project-related decisions could be made more intelligently. But the analysis
is more complex and requires more information about events affecting the
project. Due to the considerable work involved, probability analysis of risks is
usually undertaken only for projects carrying a high degree of risk or for large
projects where miscalculations could lead to a major loss to the economy. For
such projects, the nature of the risks involved and the measures taken or recom-
mended to minimize the risks together with results of the analyses should be
discussed in the appraisal report.
11. As in the case of projects for which benefits can be quantified, the risks
relating to both the costs and benefits of the project should be discussed. In
113
Appendix 8
Page 4
12. In such projects, the risks are greater on the benefit side than on the cost
side. For instance, in education projects, school buildings and equipment are
provided to help achieve a prescribed annual output of graduates with a cer·
tain skill level. However, provision of the facilities alone may not ensure achieve-
ment of the project objectives. Their achievement may depend more upon the
availability of trained teachers, provision of sufficient funds for the recurring
expenditures of the institutions, curriculum and admission standards, and
motivation of the students.
14. The real benefits of this type of project relate to broad socioeconomic
goals. For education projects, these may include increased income levels for
the trainees and a higher level of industrial and agricultural productivity. For
family planning projects, the broad goals may be an increased number of ac-
ceptors and a consequent reduction in the rate of population growth. The success
of such projects thus depends not merely on the facilities provided, but also
on the continued favorable conditions assumed by the appraisal mission. For
such projects, the assumptions made regarding the relationship between the
facilities provided and project's long-term objectives should be clearly explained.
The conditions or facilities necessary but external to the project should also
be identified, together with relevant assurances received from the Government.
For projects such as these, this is one of the most important aspects to be discussed
in the section dealing with project risks.
114
Appendix 8
Page 5
III. Conclusion
15. As the problems and risks facing each project are unique, it is not possible
to prescribe a standard format. The selection of project risks to be presented
must thus be based on the appraisal mission's judgment. Nevertheless, the discus-
sion of the project risks in the appraisal report should be concise, and should
normally not exceed two or three paragraphs.
115
Appendix 9
GUIDELINES ON THE TllEATMENT OF WORKING CAPITAL
IN THE ECONOMIC ANALYSIS OF PROJECTS
Appendix 9
119
Appendix 9
Page 2
goods in process, semifinished goods, and finished products. The monetary value
of these inputs mainly constitutes the working capital requirement of an
enterprise.
5. The need to take working capital into account and the different ways
this can be done can be illustrated in a simplified hypothetical example. Suppose
a project with an initial fixed investment of $1,000 produces a net annual return
of $250 for 15 years, the return of $250 being the difference between sales
revenues of $1,000 and operating costs of $750. The amount of working capital
the project uses is $375. If the working capital is ignored, the project's cash
flow is as follows:
With these cash flows, the IRR for the project works out to 24 per cent.
6. If, on the other hand, the working capital is taken into account, one
would reach the very different result, shown below:
The working capital is added to the capital cost estimate, but since the work-
ing capital remains intact at the end of project life, this is listed as a credit
120
Appendix 9
Page 3
in the last year. The IRR for this cash flow works out to about 17 per cent. I
9. Financial analysis should take account of all of these items. All of them
generally appear in the accounts of industrial projects; for projects in other sec-
tors, working capital requirements should be clearly identified and included
in the financial cost of the project.
In this example, fixed investment is assumed to take place without much time lag.
Therefore, working capital is also assumed to be needed in the base year. In practice, fixed
investment occurs over several years, but the full amount of working capital is required
in the first year of full operation.
2 Where IRRs are being recomputed (for review missions, supplementary loans, PCRs
and PPARs), account must be taken of inventory changes from year to year for ex-post data.
3 Work-in-progress includes the value of goods, services and labor in the production process
as of the end of the accounting period.
4 This also includes marketable securities.
121
Appendix 9
Page 4
10. The first three items listed in paragraph 8 clearly represent stocks of
goods that would be available for other uses if the project were not implemented.
Thus the first three items represent a real cost and should be taken into account
in the economic analysis. The provision for work-in-progress relates to the gap
between the application of inputs and the production of outputs which was dealt
with earlier (in para. 3). It is essential that the provision for work-in-progress
not only include the cost of material inputs used, but also the cost of non-material
inputs such as labor and electricity.
11. The fourth and fifth elements in the accounting definition do not re-
present real costs, but are merely credit transactions. Because no resources would
be released for other uses if the project were not implemented, these items should
not be taken into account in the economic analysis.
12. The "cash and bank balances" element is likewise not a real resource
cost except in a very indirect sense. If the project were implemented, the reduced
requirement for money in the economy would not release any real resource for
any other use. Thus the cash requirement included in the project's financial
accounts should also be excluded from the economic analysis.
13. The definition of working capital for economic analysis has, as noted
earlier, been based on the project's financial accounts. The provision for
inventories5 and work-in-progress in these accounts is based on domestic market
prices. For purposes of economic analysis, these must be revalued in terms of
border prices. This may be done by using CIF or FOB prices in the case of
Craded goods and by applying relevant conversion factors in the case of non-
traded goods. 6
14. Demand for inventories of raw materials and finished goods by the pro-
ject varies with the nature of the production process and the institutional ar-
rangements for purchase and sale. It is quite possible that additional stocks of
122
Appendix 9
Page 5
raw materials and finished goods will be held in part by organizations other
than the project entity. Thus, it is desirable that inventory requirements be
assessed on the basis of norms that relate to the level of consumption of inputs
and production of outputs. All increases in inventories held by the project entity
or other entities due to the project should be taken into account in the economic
analysis.
C. Conclusions
(ii) For the economic analysis of projects, working capital should in-
clude only inventories and work-in-progress.
123
Appendix 10
GUIDELINES FOR THE TREATMENT OF PRICE
CHANGES IN THE ECONOMIC ANALYSIS OF PROJECTS
Appendix 10
2. All prices are subject to change. While some prices remain stable for
a considerable time, others change more frequently. The prices of some com-
modities such as fresh fish change daily depending on the supply of these com-
modities to the market. While the supply of and demand for commodities and
services determine their respective daily, monthly and yearly prices, they are
in turn influenced by a variety of factors. These include weather conditions,
length of gestation period, the flow and character of investment, ease of storage
and distribution, fashion, taste, technology, general business conditions and
income levels, government interventions and natural calamities.
127
Appendix 10
Page 2
5. Prices may or may not move in the same direction at the same time.
Even when they do move in the same direction as in times of high inflation,
they do not move at the same rate. Some prices change quickly while others
change relatively slowly. A change in the real price of a commodity should
therefore be measured in relation to the change in the general price level over
the same period. When changes in real prices need to be measured over several
years as in project analysis, the reference prices must remain "constant" or "fixed"
in order to obtain consistent results. Thus the recommendation that "costs and
benefits should be measured in constant prices" implies that changes in prices
should be measured with reference to prices prevailing in the year of appraisal
of a project. In this context, the term "base year prices" refers to average nominal
prices prevailing in a particular year used for reference when measuring real
price changes in succeeding years. "Current" prices refer to the average nominal
prices prevailing in the preceding or succeeding years.
D. Price Projections
6. Since the economic life of most Bank -financed projects extends over many
years, it is necessary to make use of relevant price projections for project inputs
and outputs. However, even when price projections are available from reputable
sources, the project analyst should carefully assess the validity of these estimates.
When in the judgment of project staff these price projections are not appropriate,
alternative price projections should be used, provided adequate justification
is given in the appraisal report. For commodities for which no price forecasts
128
Appendix 10
Page 3
are available, the project analyst must make his own estimates. The choice is
then between using base year prices or making estimates based on the analyst's
own judgment. If the base year prices are likely to change, the analyst should
take past trends into account and use demand and supply projections to make
price projections for use in the project analysis. In all cases the project analyst
should describe the sources, method and assumptions underlying the price pro-
jections used.
8. Despite these limitations, there are several advantages in using the World
Bank's price projections: (i) the projections are readily accessible and regularly
revised; (ii) they incorporate both minor and major expected shifts in relative
2 The projections are derived from two linked modelling exercises. First, a central
macroeconomic scenario is compiled to portray the expected evolution and interaction of
the main determinants of world development. The major inputs to this exercise are assump-
tions concerning GDP growth in the world's major trading blocs, and demographic trends.
Second, the prospects for each commodity are considered on a case-by-case basis by using
models which fall into two broad categories: formal market price clearing models and less
formal long-run marginal (or average) cost models. Exogenous information concerning pro-
duction developments in key countries and likely changes in market structures and demand
patterns are used by the analyst in modifying results.
129
Appendix 10
Page 4
E. Recommendations
9. It is recommended that in all projects for which costs and benefits extend
over long periods, analysts give explicit consideration to the projection of price
relativities. The WBCPP should normally be used in estimating project benefits
and costs. The projected prices should be expressed in terms of prices prevail-
ing in the year of appraisal. When the base year used in the WBCPP is different
from that used in project appraisal, the MUV index should be used to arrive
at base year prices. Since project benefits often continue to accrue 20 to 30
years after project completion, the latest year for which projections are available
should be used for estimating project benefits. For example, if the latest price
projection given by the WBCPP is for the year 2000, then the prices of the in-
puts and outputs projected for that year should be used in estimating the net
benefit of the project for that year and beyond. For the intervening period (i.e_,
for the period between project completion and the year 2000) a trend line could
be used in estimating the prices of inputs and outputs for each year based on
the WBCPP.
10. Since the prices prevailing in the base year are often very different from
those projected, an estimate of the EIRR using base year prices should be in-
eluded in the sensitivity tests. The implications of this price sensitivity should
be fully discussed in the section dealing with projec_t risks.
11. For commodity program loans, where costs and benefits normally accrue
over two to three years, the base year prices of inputs and outputs should be
3 The manufacturing unit value (MUV) index is used as a deflator for estimating the real
projected prices of primary commodities.
130
Appendix 10
Page 5
used in estimating the net benefit of the projects since price changes over a
short period are not likely to be significant.
13. If price projections for major outputs and inputs are not available from
the WBCPP, the project analyst should make his own estimates based on the
prices prevailing during the year of appraisal, recent trends, foreseeable changes
in supply and demand, and the projections, if any, made by other organiza-
tions. In cases where base year prices appear to be representative and no major
shifts in supply and demand are expected, the base year prices of inputs and
outputs may be used. In all cases the project analyst should describe the sources,
methods and assumptions underlying the price projections. If necessary, the
Economics Office could be consulted regarding the projections to be used.
15. In the economic analysis of projects, the capital cost is generally estimated
on the basis of the base year prices of the major items of machinery, equip-
ment and construction materials required by the project. The rationale for doing
so is that the construction period is generally short and the changes in relative
prices which do occur during the period are not likely to be significant. The
provision for general price inflation used in estimating the financial cost is
131
Appendix 10
Page 6
excluded from the estimate of the real capital cost. While the present practice
of estimating the real capital cost of projects is appropriate and should be con-
tinued, care should be taken to ensure that if expenditure on commodities in-
cluded in the WBCPP (e.g., oil) constitutes a significant portion of the invest-
ment cost, then changes in the relative prices of these commodities should be
taken into account in estimating the real cost of the project, particularly if
substantial real price changes are expected. Further, for projects for which the
construction period is quite long and for which the domestic construction cost
component is large, changes in construction costs which exceed or fall short
of the general increase in prices should also be taken into account in estimating
the economic cost of construction.
F. Conclusion
132
Appendix 11
GUIDELINES FOR THE ECONOMIC ANALYSIS
OF EDUCATION PROJECTS
Appendix II
I. Introduction
A. Objectives
135
Appendix 11
Page 2
A. Project Objectives
136
Appendix 11
Page 3
aspects of the education system. Its objectives must therefore correspond to the
country's overall educational goals. Since a project constitutes a part of the
system, its objectives would have to be limited but more specific in terms of
targets. For example, a project aiming at eliminating illiteracy would have to
spell out its objectives in terms of area, level, and target group. This normally
presents no problem. However, there can be cases in which the project objec-
tives though corresponding to some of the general objectives might be in con-
flict with another general objective. For instance, an expansion of tertiary educa-
tion might be in conflict with the general objective of promoting equity and
this might require some compromise or trade-off. In such a case the appraisal
should clearly spell out the need for and the extent of the trade-off between
objectives.
B. Assessment of Needs
10. Two approaches for the assessment of needs are generally used in the
education sector. These are the "social demand approach" and the "manpower
requirements approach" .1
1 There is another approach popular in some circles which may be termed "intrinsic value
approach". In this approach education is taken as intrinsically good in any amount. While
no one would deny the intrinsic value of education, this approach is not useful for deter-
mining the need, since the need is simply taken for granted in this approach.
137
Appendix 11
Page 4
11. The social demand approach accommodates the will or desire of the
government and the people to provide a certain level or type of education to
the citizens on the basis of ethical, social or political considerations. Specifying
primary education as a basic need of the people illustrates the social demand
approach. Sometimes the need is defined more specifically. For example, instead
of saying that primary education is a basic need of all citizens, it might be
specified that all citizens in a certain age group (say between five and ten years)
should have access to primary education. Flow models based on population and
income growth, etc., are often used to specify the targets.
138
Appendix 11
Page 5
14. One major practical problem with this approach is lack of sufficient
data. Some countries may have only rough or rudimentary manpower plan-
ning. In most cases the analyst will have to rely on some basic data such as
the population census and labor and employment statistics. Manpower coeffi-
cients in another country with a similar background, if available, could also
be used as proxies. Where such proxies are used similarities as well as
dissimilarities in conditions and background should be fully taken into account.
In some countries where even basic data are not available, a limited survey should
be conducted at the feasibility study or pre-appraisal stage. In all cases, the
experience and judgment of the analyst would be crucial.
15. Once the need for a project is established either through social demand
consideration or manpower requirements approach (or through both) the
appraisal should identify the target group to which the project is directed. This
is essentially part of the project- designing process. Ultimately, the project might
benefit the whole population but the immediate impact of the project will be
only on a limited number of people. They are the people who may bear the
cost (or part of the cost) and may also be the direct beneficiaries of the project.
In addition to their number, the beneficiaries should be identified to the extent
possible, by location, income level and social and educational stratification so
as to enable an assessment of the project impact. Outlining an impact tableau
could be useful as it will facilitate the assessment of the project impact not only
for the appraisal but also for the preparation of project completion and post-
evaluation reports and in the project benefit monitoring and evaluation processes.
139
Appendix 11
Page 6
A. Budgetary Implication
140
Appendix 11
Page 7
19. The question of affordability may not be fully answered from the study
of the financial impact alone, since education also involves other costs. In
addition to fees, there are out-of-pocket costs for a student such as expenses
for the purchase of books and transport as well as the opportunity cost of forgone
earnings. Where such costs are significant, they should also be taken into account
in assessing the financial impact on the target group.
C. Distributive Impact
20. Most education projects have some distributive impact when education
is provided at less than its full cost. This subsidy involves a transfer of resources
from one section of the general public to another. When such a subsidy is mainly
enjoyed by the low-income groups, the project has a positive distributive im-
pact. An education project could have either a positive, neutral or negative
distributive impact depending on the objectives and design.
141
Appendix 11
Page 8
A. Cost-Benefit Approach
22. Once the need for an education project is established and the availability
of resources ascertained, the appraisal must address two fundamental issues:
whether the project is worth the cost and whether the society and the target
group can afford it. These issues can be resolved only when all the costs involved
and the benefits expected from the project are fully taken into account. For
instance, a national manpower plan may indicate that a few nuclear engineers
are needed to maintain the country's research reactors. For most developing
countries it would not be worthwhile to train the engineers within the country
since the cost of in-country training would be too high and would far outweigh
the expected benefits. A careful assessment of both cost and benefits is necessary
in the economic evaluation of education projects. Consideration of cost in rela-
tion to benefits is commonly known as the cost-benefit approach.
24. The direct or out-of-pocket private costs of education are relatively easy
to identify and evaluate. These mainly include tuition and other fees and cost
of textbooks, transportation, and board and lodging if the school is beyond the
normal commuting range. In addition, there is an opportunity cost in the form
of forgone earnings of the student. The opportunity cost depends upon the level
of skill or educational attainment which the student had before entering school
or college, the time required to complete the course, the ease or difficulty in
getting a job and the expected wage rate.
142
Appendix 11
Page 9
25. Perhaps the most crucial part of the above analysis is the estimate of
forgone earnings. It depends upon the nature of skills and employment oppor-
tunities in the country concerned for people with those skills. Where self-
employment in family is involved, it would depend on loss of income to the
family. The cost of sending a child to a primary school may, for instance, be
relatively high if the child's mother could not work during the child's absence
to supplement the family income. Private costs partly explain the problem of
over crowded colleges while school classrooms are empty in many villages and
slums in some developing countries.
26. In general, the out-of-pocket costs and the opportunity cost of forgone
earnings taken in relation to the income of the target student families provide
the basis for determining whether education is affordable.2 Generally, some
information is available on income and employment to assess affordability. But
in situations where such information is lacking, a limited sample survey at the
pre-appraisal stage may be advisable.
27. Project objectives will be realized only if the education offered by the
project is demanded by the target group. It is therefore necessary during the
feasibility study or appraisal to assess the demand. In addition to the question
of cost, demand is largely a function of the anticipated benefits from the educa-
tion proposed under the project. The assessment of private benefits to the target
group is an essential element in the appraisal process. People seek education
because of monetary and non-monetary benefits that accrue from it. Educa-
tion imparts skills and knowledge about certain disciplines and activities thereby
contributing to higher productivity and an increase in earning power. There
are, however, several other benefits which cannot be readily quantified. For,
education also widens one's intellectual and spiritual horizons, modifies attitudes
2 In some instances, education may also involve non-quantifiable cost in the form of
physical or psychological hardship such as living away from family. A format for identifica-
tion and assessment of such cost, if significant, is provided at the end of this appendix.
143
Appendix 11
Page 10
and perceptions and enhances appreciation of social, ethical and economic values
thereby enabling one to tackle the problems of physical, social and economic
environment. These benefits may be individual or family-related or society-
related. 3 Every effort should be made to identify the non-monetary benefits
and assess them qualitatively.
30. All private costs (direct and indirect) net of taxes and subsidies are also
a cost to society to the extent that they represent the use of resources. However,
social cost comprises more than the private costs. A government's capital and
current expenditures are an important part of the social cost of education.
Governments-usually spend large sums of money every year on education. Part
of these funds may be used to expand physical infrastructure (for example, school
buildings and laboratories), but most of these funds are used to meet the
3 See the format for identification and assessment at the end of this appendix.
4 An estimated two-thirds of increased earnings in developing countries are generally taken
as the alpha coefficient- This figure may be modified according to data and country
experience_
144
Appendix 11
Page 11
31. The share of public expenditure in the social cost of education may
be large or small, depending on the relative roles of private and public educa·
tion and the amount of subsidies given to students and institutions in a par-
ticular country. Both private and public costs (net of transfers) should be taken
into account in determining the social cost of education.
32. Private benefits from education also constitute social benefits since
greater earnings generally reflect improved productivity and, hence, larger social
output. When earnings are subject to income-tax, it is the gross earnings that
represent social benefits. Social benefits from education would, in addition to
increased earnings and output, include several other benefits such as improved
sanitation and health conditions, family planning and a lower crime rate. While
these benefits are real, they cannot be easily quantified and, therefore, must
be identified and assessed in qualitative terms. The impact on equity should
also be taken into account in social cost-benefit analysis.
33. Once the costs and benefits are identified and evaluated, a comparison
can be made to assess whether the benefits justify the costs. A comparison of
private costs and private benefits provides a basis to assess whether the educa-
tion to be provided or supported by a project would be affordable and attrac-
tive enough to the target group and to ensure that sufficient demand exists to
justify the project. A comparison of social cost and social benefits provides a
basis for assessing whether the project is worth undertaking from the viewpoint
of society. Because a large part of the assessment will be in qualitative terms,
the appraisal should clearly spell out the reasons for justification of the project
in terms of cost and benefits, both private and social (see the format for iden-
tification and assessment of costs and benefits).
34. The internal rate of return (IRR) is a discount rate which equalizes the
flows of cost and benefits over a relevant period which is generally the lifetime
145
Appendix 11
Page 12
of a project. The private rate of return relates private costs to private benefits
just as the social rate of return relates social cost to social benefits. Obviously,
the rate of return analysis cannot be applied to those benefits which could only
be assessed in qualitative terms.
35. In the Bank's education projects, most of the investment has been made
to improve the quality of education through improved facilities, equipment and
curricula and training of teachers. It is extremely difficult to measure in monetary
terms the qualitative improvements which generally tend to be cumulative. For
this reason, estimation of internal rate of return is not recommended for all
education projects.
36. Despite the difficulties involved, the rate of return analysis can be par-
ticularly useful in allocating a given amount of resources among various levels
or types of education. This is especially true if the non-measurable benefits are
considered to be more or less uniform among various types of education. By
transferring resources from those areas of education which yield lower rates of
return to those which produce higher rates of return, the benefits of invest-
ment in education can be substantially increased. This is of particular relevance
to national governments in determining priorities in the education sector.
Moreover, there are many education projects which are primarily intended to
improve th~ internal efficiency such as centralized textbook printing and pro-
duction of science apparatus whose benefits can be measured in terms of cost
savings. For such projects, IRR estimates could be used for their justification.
37. Whether the IRR is actually estimated, the cost-benefit approach is fre-
quently used in the process of planning and management. What is suggested
here is that a detailed analysis of various economic costs and benefits of an educa-
tion project being appraised should be undertaken in a systematic manner so
as to provide a sound basis for decision making.
146
Appendix 11
Page 13
objectives and ensuring that the project goals and needs are met in the most
cost-effective manner. This is really a limited application of the full cost-benefit
approach because it deals only with the cost aspect. This approach works best
when the need for a particular project and its justification is already established.
39. Cost-effectiveness means either of two things: (i) given the desired end
results, cost-effectiveness means the least-cost method of achieving them; or
(ii) given the resource constraints it means the maximization of end results. The
least-cost analysis is most often applied in engineering studies because the
objective is more easily defined in terms of capacity or output. Once the objec-
tive is defined, the cost may be minimized in terms of alternatives in technology,
design, location or time phasing of the project. The second method is more
often used in analyzing projects in the social sector where resource constraints
are generally given. The essence of this approach is the ability to compare alter-
native options and select the one that is most effective within the given con-
straints. This approach is only as effective as the analyst's ability to define precise-
ly project objectives, options and constraints.
40. Once the objectives of an education project are defined, alternative op-
tions in terms of standard, design, location, coverage, time-phasing and technical
and pedagogical considerations should be considered within given constraints.
This is an essential aspect of the approach and it is necessary to describe in
the appraisal report at least the best alternative options considered. For example,
in most countries standards are well established with respect to physical in-
frastructure and recurrent activities in education. Since construction costs are
a major part of the investment cost of a project, construction design standards
under a project must be compared with those of the existing ones and when
departures are proposed, adequate justification should be given. Similar justifica-
tion should also be provided whenever variations from standards are proposed
for recurrent expenditure. Establishing the cost-effectiveness of a project is in-
dispensable to project appraisal so as to ensure that unnecessary cost (or waste)
is avoided.
147
Appendix 11
Page 14
VI. Conclusions
149
Appendix 11
Page 16
A. Individual/Fami ly
1. out-of-pocket costs
2. forgone earnings
3. others
B. Private Institutions
l. capital costs
2. recurrent costs
3. others
C. Government
l. capital costs
2. recurrent costs
3. others
A. Individual/Fami ly
l. increased earnings
2. cost savings
3. others
B. Private Institutions
l. increased earnings
2. cost savings
3. others
C. Government
l. increased earnings
2. cost savings
3. others
150
Appendix 11
Page 17
A. Individual
1.
2.
B. Family-
Related
1.
2.
c. Society-
Related
1.
2.
3.
D. Others
IV. NON-
QUANTIFIABLE
BENEFITS
A. Individual
1.
2.
B. Family-
Related
1.
2.
c. Society-
Related
1.
2.
3.
v. OVERALL
ASSESSMENT
151
Appendix 12
GUIDELINES FOR. THE ECONOMIC ANALYSIS OF
HEALTH SECTOR. PROJECTS
Appendix 12
I. Introduction
1. The health sector covers a wide range of activities concerned with the
prevention and treatment of disease and disability, and With prolonging human
life. Recent advances in health science and medical technology have vastly im-
proved the effectiveness of health care services, and have brought people
everywhere the hope of living longer and healthier lives. At the same time, these
improved services demand an increasing share of the resources of both nations
and individuals. Thus, there tends to be a widening gap between advances in
medical technology, and the amount that individuals in most developing coun-
tries can afford to spend on health care. This problem is often made worse by
misallocation of resources. It is therefore extremely important that resources
allocated to the health sector be distributed in a way that is consistent with
the priorities of the sector, and that these resources be used in the most effi-
dent manner possible. Only in this way will maximum benefits be achieved.
155
Appendix 12
Page 2
4. The primary objective of this review is to define the country's health prob-
lems in terms of deficiencies and disease groups, and to determine the ability
of the health care system to respond to the country's health sector needs. It
should also assess the availability of health sector manpower, and the overall
organization of the health care syrtem. This should include the relative roles
of the public and private sector, and an evaluation of the system's str.engths,
weaknesses and potential for improvement and expansion. Essentially, this review
should provide an appropriate background for assessing the country's health
care plan or program and its scope for improvement.
5. The national health plan should be reviewed with respect to its overall
direction, coverage, comprehensiveness, flexibility, and equity in responding
to the country's health needs. Its viability should be examined in terms of
technology, manpower, institutional capability, and budgetary requirements
and availability of funds. In countries where there is no comprehensive national
health plan, a review should be made of the programs and projects contemplated,
the objectives of the latter, and government policy statements relating to the
health sector. The purpose of this exercise is to assess the plan's or program's
strengths, weaknesses, and potential for meeting the country's health sector needs,
the government's goals for the sector, and its degree of commitment in achiev-
ing them.
156
Appendix 12
Page 3
6. The appraisal should then tum to a review of the project's objectives and
how they relate to the objectives of the national health plan. In particular, the
appraisal mission should be satisfied that both the overall objectives and the
specific targets of the project are feasible and realistic, and are in accordance
with the priorities of the sectoral plan. In the case of projects which address
particular regions or target groups, the objectives must also be consistent with
the needs of the particular region or target group. I The appraisal mission
should also be satisfied that both the design and scope of the project are consis-
tent with available resources. In the case of a large project which requires a
substantial increase in government health expenditure, the sources of funding
should be identified, and where necessary, measures for mobilizing the required
resources should be defined and relevant commitments from the government
secured. In addition to funding requirements, the appraisal mission should be
satisfied that the technology envisaged is appropriate, that the manpower re-
quired is available, and that institutional requirements will be fulfilled.
157
Appendix 12
Page 4
projects, the usefulness of IRRA in appraising projects in the health care sec-
tor is limited. CEA is thus generally used instead.
(i) The direct costs of a dise.ase include all costs involved in prevent-
ing, diagnosing and treating the disease (i.e., expenditures associated
with hospital care, services of medical practitioners and other h«1alth
personnel, drugs, medical equipment, and long-term care).
(ii) The incidental costs of a disease include travel and transpc;»rt costs
to and from the clinic or hospital where immunization or diagnosis
and treatment of the disease :.s received, and the cost of attendants
where necessary.
(iii) The indirect costs of a disease include loss of wages due to illness,
premature death, and loss of productivity due to disability.
(iv) The psychic costs of a disease are generally unquantifiable and in-
clude pain, suffering and disruption of normal lifestyle, and other
costs not captured in the other three categories.
10. The costs under categories (i) and (ii) are relatively easy to quantify.
Hospital and he,lth care records, and sample surve'ys (where necessary) nor-
mally provide reasonably reliable e$timates. Q.uantifying the costs which fall
under category (iii) is. much more difficult. Use of a "lifetime costing"
methodology creates several problems. One of these is how to quantify the loss
to society of a premature death. While ~any approaches are possible, one solu-
tion which is frequendy used is the human capital approach which values loss
158
Appendix 12
Page 5
11. Health care intervention on the other hand is concerned only with
prevention or treatment of disease. The cost of health care intervention therefore
includes only the cost of prevention or diagnosis and treatment of disease, and
costs incidental to prevention or treatment. The cost of intervention thus relates
only to categories (i) and (ii).
12. The purpose of CEA is to find the means (activity, process or interven-
tion) by which the desired results are achieved with a minimum expenditure
of resources; or when resources are fixed, the means by which maximum results
are obtained. Since CEA is concerned with internal efficiency or the least~cost
means. of achieving the stated goal of a project or intervention, it helps avoid
waste. CEA essentially involves ranking the alternative means of fulfilling a stated
objective by their costs. In practice, at least two or three alternatives should
be compared, and the least-cost means chosen. This comparison should be done
in terms of increnien.tal costs. For projects or programs which consist of several
mutually non-exclusive interventions, a cost-effectiveness comparison of alter-
natives should be done for each inter\rention.
13. The advantage of CEA is that the objective of the process or interven-
tion need not be measurable in monetary terms. It can be applied to any pro-
cess or intervention, provided the objective is quantifiable. For this reason, CEA
is widely used in project analysis in the health sector.
159
Appendix 12
Page 6
tend to be of varying durations and severities, and the same is true of disable-
ment. Thus, without a common denominator, one cannot say that it is more
cost-effective to spend a dollar on treating one disease than on another. A com-
mon denominator is therefore necessary if the impacts of individual health
disorders and the cost-effectiveness of various interventions are to be assessed.
The expert services of an epidemiologist and a health statistician are indispens-
able in this regard. Several methodologies have been suggested for this pur·
pose, the least controversial of which is the disease impact assessment (DIA)
methodology described below.
15. DIA is a method for ranking health disorders. As everyone knows, the
effect of a health disorder is illness. Illness, of course, leads to loss of healthy
days, the number of which depend on the nature and severity of the disorder.
DIA ranks the impact of health disorders in terms of days of healthy life lost.
Instead of imputing a monetary value to healthy days lost, DIA assumes that
a day of healthy life lived by any person is of the same value, irrespective of
that person's age, sex, or income. This assumption makes it possible to rank
health disorders according to their severity and prevalence, i.e., according to
the number of healthy days lost (see pages 167-168).
160
Appendix 12
Page 7
18. Although the DIA technique is conceptually simple, its application en-
tails fairly substantial data requirements. Estimates of the parameters for the
most important diseases must be obtained from all available sources such as
census data, hospital discharge data, special survey data and data on the cause
ofdeath. In developing countries where the statistical systems producing health
care and vital statistics are fairly well developed, there is likely to be an ade-
quate data base from which the required data set can be derived, with the aid
of a few sample surveys where necessary. When a sample survey is contemplated
for this purpose, it is advisable for it to be undertaken during the feasibility
or pre:appraisal stage. For countries in which national statistical systems are
not well developed, the parameters from other countries with similar health
profiles can sometimes be adapted. However, it is clearly desirable to build up
health sector proftles· including unit cost statistiCs for each DMC.
19. The discussion of DIA above is intended more to highlight the problems
· involved in the application of DIA and to explain certain basic concepts than
to recommend its universal application. In any case, the possibility of universal
application of DIA is not likely in the near future for most DMCs because of
data constraints. However, for major health care programs and projects, use
of the DIA approach on a selective basis is desirable since data bases are usual-
ly fairly complete for such programs and projects.
161
Appendix 12
Page 8
21. However, for some health sector projects, both costs and benefits can
be defined in monetary units. For these projects IRRA can be used. Usually
the benefits of such projects are cost savings. This technique is thus often ap-
plicable to hospital renovation and equipment maintenance programs, and to
projects relating to hospitals and rural health centers. In fact, IRRA can generally
be applied to all projects which increase operational efficiency.
22. It was noted earlier that in order to initiate a project, there must be
clear evidence of need for the project. But need for a project, or rather for
the services provided by the project, is not always the same as demand for these
services. This is because need is often defined on the basis of what health
authorities consider to be necessary or desirable for the target population. De-
mand, on the other hand, reflects what the target population is prepared to
pay for. In the case of free services there must be acceptance. For demand to
occur, the services or goods concerned must be perceived as having value, and
there must be ability and willingness to pay on the part of the target popula-
t~on. For many health sector interventions, target groups often have little
knowledge of the benefits likely to accrue from them. In such cases, it is desirable.
to disseminate information regarding the benefits of specific interventions and
to cultivate knowledge of their values. This often takes time and expenditure
of a substantial amount of resources. Further, the need for 4isseminating such
information is greater in projects which require active community participa-
tion. Where such needs are apparent, dissemination of information should
generally be made a component of the project or intervention.
162
Appendix 12
Page 9
F. Sustainability
163
Appendix 12
Page 10
A. Access
27. Since health care is a basic human need, equity considerations assume
special significance in health sector projects. Proper identification of project
beneficiaries is extremely important in this regard. 7 Two main equity aspects
164
Appendix 12
Page 11
in health care projects are access and affordability. Access refers to physical
access to health care services. Equity suggests access to health care services and
facilities at reasonable cost by all who need them. Access is particularly impor-
tant for those living in rural areas, as health care facilities tend to be concen-
trated in urban centers. The need for more equitable distribution of services
and facilities should be recognized when appraising health sector projects.
28. Apart from locational constraints, access to health care services may
also be limited by the cost of the services themselves. Thus, although all types
of health care services may be available in large cities, the urban poor may
not have access to them because of inability to pay. Affordability is therefore
an important equity issue in the provision of health care services.
B. Affordability
29. Affordability depends both on the cost of the services in question and
on the income of those who need the services. Therefore, the cost of health
care services should be considered from the viewpoint of the user and should
take account of both direct costs and costs incidental to patients and their
families. Most developing country governments provide basic health services
free of charge or at a nominal cost on grounds of equity, externalities and na-
tional welfare. With regard to secondary health care - particularly clinical
and hospital care - the manner in which costs are shared requires careful
scrutiny because the costs of these services are generally rather high. Never-
theless, since health care is a basic human need, affordability, especially with
respect to low-income groups, should be given due consideration in every pro-
gram of cost recovery.
C. Cost Recovery
30. Cost recovery should be examined from both the efficiency and equity
points of view. In most developing countries, what the government can afford
to spend on health care generally falls short of what is needed to finance the
full cost of the health care program. In such circumstances it is necessary to
165
Appendix 12
Page 12
distribute available resources in the most efficient way possible, while at the
same time ensuring the maximum degree of equity. This suggests price
discrimination according to users' ability to pay.
166
Appendix 12
Page 13
DIA is a method for assessing and ranking the major health disorders in
.a country. DIA ranks the impacts of health disorders in terms of "healthy days
lost". The method does not, however, attempt to impute any monetary value
to healthy days lost. In fact, it assumes that a day of healthy life to any person
is of the same value, irrespective of that person's age, sex, or income. This makes
it possible to rank health disorders according to their severity and prevalence,
i.e., according to their impact on health in terms of healthy days lost.
167
Appendix 12
Page 14
From the data listed above, the total number of healthy days lost (L) can
be computed for each disease category as
L C * [E(Ad)] * 365
+ C * (Dd) * (Ad-Ao) * 365
+ P * (Pd) * (1- C) * [E(Ao)] * 365
+ (1- c- P) * t •
The total number of healthy days lost by the nation or region on account
of each disease can be related to the incidence data (I) and expressed in terms
of per thousand population. Thus LI gives healthy days lost per thousand popula-
tion due to each disease. The result of these computations will resemble Table 1,
which should then be converted into a table similar to Table 2 which ranks
all major diseases by healthy days lost. from these two tables it is possible to
obtain a crude estimate of the potential impact of alternative interventions.
By relating the probable impact of each intervention to the cost of the in-
tervention, a measure of cost-effectiveness can be obtained for each interven-
tion. For example, if the impact of one intervention for a disorder is the saving
of a day of healthy life at a cost of $1.00, whereas the impact of another in-
tervention for the same or another disorder is the saving of a day of healthy
life at a cost of $1.50, then the first intervention is clearly more cost-effective
than the second. By comparing alternative interventions in this manner, the
most cost-effective solution can be identified.
It should be noted that the DIA model is not concerned with the cost of
a disease or disorder in monetary terms, but rather in terms of healthy days
of life lost. Since the latter is what a health care intervention is intended to
avoid, there is no need to evaluate this cost in monetary terms. Thus under
the DIA method, one must only ascertain the cost of intervention or treatment.
It is .important to note that loss of earnings due to illness is not included in
the DIA computation because it is part of the cost of disease and not of the
treatment. Loss of earnings due to illness is a cost that would be borne in any
case, i.e., whether any treatment is taken or not.
168
Table 1. An Illustration of the Cost of Disease Measured in Terms of
Days of Healthy Life Lost Per 100,000 Population Per Year
20. Pneumonia
(a) child 2 65.0 36.5 2 65.0 0 0 0 21 191.9 1,664,341 99.8
(b) adult 48 25.0 52.5 48 25.0 0 0 0 21 44.7 214,587 99.8
21. H-Fever 10 58.2 18.1 10 58.2 0 0 0 21 3.2 12,359 99.6
22. Rabies 32 38.6 100 32 38.6 0 0 0 0 0.6 8,453 100.0
23. Filariasis 30 40.4 6.8 45 27.5 2 0 1 0 0.1 69 98.9
24. Bronchitis 10 58.3 0.6 10 58.3 0 0 0 14 678.1 96,014 90.2
25. Malignant Neoplasms 52 21.9 69.6 53 21.1 75 0 0 180 49.7 278,593 95.6
26. Food Poisoning 23 46.5 16.9 23 46.5 0 0 0 10 2.3 6,616 99.7
27. Leukemia 15 53.6 80.0 30 40.4 75 75 30 0 3.5 55,868 73.9
28. Septicemia 24 45.6 35.0 24 45.6 0 0 0 21 17.9 104,519 99.8
29. Diabetes Mellitus 45 27.5 45.0 64 13.4 30 50 25 0 9.6 36,742 57.5
30. Nutritional deficiencies
and metabolic disorders
(a) child 1 65.4 50.0 65.4 0 0 0 180 28.1 337,917 99.3
(b) adult 54 20.4 20.0 59 16.7 10 0 0 40 42.8 55,109 94.7
31. Meningitis 10 58.3 20.0 10 58.3 0 0 0 30 29.0 124,117 99.4
32. Hypertension 50 23.4 75.0 63 14.0 50 25 25 0 29.7 170,636 66.7
33. Chronic rheumatic
heart disease 25 44.7 75.0 35 36.1 50 25 30 0 5.1 58,941 85.5 >'1::1
34. Other forms of 'i
=-...
'"Ct:S
heart disease 45 27.5 75.0 60 16.0 50 25 25 0 75.3 496,224 66.5 Ill
35. Cerebrovascular ~ ~
Appendix 12
Page 18
172