Decision Analysis - Risk and Reliability For Engineers
Decision Analysis - Risk and Reliability For Engineers
Contents
Introduction
Decision rules
Introduction
Making a decision is in fact choosing from alternatives. The decision theory is based on the
classic “Homo Economicus” model assumes that the decision-maker:
The decision-making concept discussed in these lecture notes assumes this model, although
decision-making in practice is often different since the above conditions are often not
fulfilled. For example, there can be multiple decision makers and multiple objectives, and in
reality the decision maker does not know all the alternatives or their outcomes. For many
practical cases this has led to an extension of the decision model, but not to a fundamental
adjustment of the classical model described here.
Skip to main content
Within a decision problem the following characteristics can be distinguished:
the set of all possible actions or decisions a, from which the decision maker can choose
the set of all (natural) circumstances, θ that influence the outcomes*
the set of the set of all possible results, ω, which are functions of the actions and
circumstances: ω .
= f (a, θ)
The actions, natural circumstances and the outcomes can be shown in a so-called decision
tree (Figure Fig. 20).
Based on the possible results a choice is made for an action. To be able to assess the
different results, a numerical value is assigned to each outcome, ω, which can be used to
establish the benefit of each outcome. This number can be a monetary value, a number on
an arbitrary scale or utility–as long as the decision maker(s) can establish a consistent
ranking of the outcomes with it. In the last two cases the benefit has no absolute value, but
only gives the relative value of the different outcomes.
Utility, u, is a concept used to rank the possible outcomes according to the preferences of
the decision maker, with possible values 0 ≤ u ≤ 1 . A utility function can be used to
characterize the relative utility of various outcomes. The elaborations below are based on the
monetary values as a measure for the outcomes and assume a risk neutral decision maker.
This is a decision maker who is indifferent between choices with equal expected outcomes,
even if one choice is riskier than the other. For example, a risk neutral decision maker would
have the same preference for a € 400 pay out, or a 50/50 bet with a coin toss with outcomes
of € 0 (head) or € 800 (tail). Utility and risk aversion are further discussed in ater sections.
Skip to main content
Decision rules
Once a set of actions, circumstances and outcomes is known, various approaches can be
used to come to a preferred decision. Various deterministic decisions rules are available
which do not take into account the probabilities of the possible circumstances and
outcomes. One example of such a decision rule is the minimax criterion: a decision maker
wants to minimize maximum losses. This is in fact a risk-averse criterion. Another example is
the maximax criterion: a decision maker chooses the option with the maximum income and
is risk seeking.
Although these decision rules are helpful in some cases, the probability of occurrence of
certain circumstances is a key feature of the decision problem. Information on the
probability of outcomes is needed for an optimal choice of action(s). For example, when
making a decision to start a business in soup or ice cream, the decision maker would want to
know what the probabilities of rainy or sunny weather are. Selling ice cream in Dutch winter
will probably not make a good (expected) profit, but it would be a profitable business in a
Mediterranean summer.
∗
a : max E(u(a, θ)) = max ∑ u(a, θ i )P (θ i )
a a
θ
In which u(a, θ) is the utility of action a under circumstance θ and P (θ) is the probability
that circumstance θ occurs.
i
A rational decision is choosing the action with the highest expected (utility) value or highest
benefit if outcomes are expressed in monetary values. This is illustrated in the example
below. Note that other examples in these lecture notes will also be based on monetary
values.
Suppose a person has €1000 at his or her disposal and is given the choice to invest
this money in bonds or in shares of a given company. It is known that, on a yearly
basis, 3 % of the current market value is distributed as interest on the bonds. The
dividend of the shares depends on the company’s profit. Suppose that the board of
directors have made the following agreements:
for a profit smaller than 5% of the shareholders capital, no dividend is paid; for
a profit larger than 5% of the shareholders capital, dividend is paid, the
percentage of which corresponds to 3% of the current market value of the
shares;
for a profit larger than 10% of the shareholders capital, the dividend
corresponds to 6% of the current market value of the shares.
The set of actions A has two elements: a = investing in shares AND a = investing
1 2
Note that for the bonds the net outcome always yields ω =1% (i.e. 3% interest –
2
2% inflation). The outcomes can be illustrated using a decision tree (see Fig. 21) or
a table (see Table 4).
Market
circumstances
Actions θ1 θ2 θ3
a1 : buy shares − 2% 1% 4%
a2 : buy bonds 1% 1% 1%
The deterministic decision rules can be applied to this example. Minimax would
result in investing in bonds (a ), maximax would result in buying shares. The
2
optimal decision can be found by taking into account the probabilities of the
market circumstances. These three circumstances are assumed to be exhaustive
and mutually exclusive (i.e. outcomes cannot overlap and the sum of probabilities
equals 1). The probabilities are estimated at P (θ 1) = 0.2; P (θ 2) = 0.3; P (θ 3) = 0.5.
These probabilities can now be included in the decision tree. The expected value of
the return of the actions is as follows:
In this case the expected outcome is larger for buying shares than for buying
bonds. So for a risk neutral decision maker buying shares (a1) would be the
preferred action. Note that this action also includes a probability of 0.2 of a loss.
This is also expressed by a higher standard deviation of the expected outcomes for
buying shares. The above example can also be extended by applying different
utility functions for various outcomes.
In the previous example, the number of circumstances is limited and the probability
distribution of the circumstances is discrete. For many decision problems this is not the case.
The state of nature, for instance, can assume many values that cannot be made discrete. This,
for example, would have been the case if the dividend in example 0 had been a percentage
of the profit. In such cases a probability density function can be used to characterize the
In taking decisions with uncertainties, it appears that probabilistic calculation techniques are
a valuable aid to reach a rational choice. This is particularly the case if risks are dependent on
the possible decisions. In such cases, Bayesian decision theory minimizes the total costs (i.e.
investment costs plus risk in terms of potential losses). This can best be illustrated by means
of an example from the civil engineering domain.
The river cuts through the clay layer and the underlying sand layer is fed by the
river, which causes high uplift pressures on the clay which is exposed in the
excavation (see Figure Fig. 22). If the pressure becomes too high the excavation
base will push upward and water will enter the excavation in an uncontrolled way,
damaging property and perhaps risking human life.
σ h = 0.75m (see Figures Fig. 23). Since h is a hydraulic head (units of [L]),
pressure is calculated by multiplying the unit weight of water (10 kN/m ). 3
Failure occurs when the uplift pressure exceeds the weight of the clay layer, which
can be described by a limit state function Z = R − S with resistance R and load S
:
Z = ρc ⋅ d − ρw ⋅ h
deterministic value. The probability of failure is thus P (Z < 0) , which for this
situation can be found by calculating the mean and standard deviation of Z :
2
μ Z = ρ c μ d − ρ w μ h = 20(2.5) − 10(4) = 10 kN/m
2 2 2 2 2
σ z = √ρ c σ c + ρ w σ = 8.5 kN/m
h
Since Z also has the normal distribution, we find the failure probability:
Fig. 23 Cross-section of excavation near a river. Hashed area indicates the clay layer,
which is underlain by sand. The water pressure is given by h and is directly related
to the river level (Figure Fig. 22).
The effect of a drainage system in the construction site (see Fig. 22) on the
groundwater levels has been reviewed using groundwater flow calculations. It
appears that it reduces the mean value of the maximum water levels to μ = 3.52m h
and the standard deviation remains the same. In this case the failure probability is
reduced to 0.04. Such a drainage system costs €150,000.
The previous analysis has shown that the probability of flooding of the excavation
equals p = 0.12 for a situation without drainage and p
f fd = 0.04 with drainage.
Without drainage, the risk, defined as the expected value of the loss, is
Costs and probabilities can also be shown in the decision tree (see Figure Fig. 24).
The expected values of the costs can be calculated for the different actions by
adding the present values of the cost of actions and risk:
This implies that the construction of the drainage system is rationally speaking the
best decision for a risk neutral decision maker.