02 Decision Making Under Uncertainty and Risk
02 Decision Making Under Uncertainty and Risk
2.4 Posterior probabilities and Bayesian analysis Compiled by Dr. A.K. Chaudhary
New information is frequently discovered through the search and evaluation of decision alternatives. The test of
alternatives is revised and expanded as new information is concerned that affects the identification of alternatives.
Consequences are restated when it concerns the effects. The states of nature itself are either reconsidered or their
probabilities are revised when the uncontrolled factors are involved. The value of new information is seen in its
impact on the expected payoff. The expected value and the cost of the new information are compared to determine
whether it is worthwhile.
A prior probability is a probability of an uncertain quantity calculated to express one's beliefs about this quantity
before some evidence is taken into account. In other words, an initial probability statement used to evaluate expected
payoff is called a prior probability distribution. The one which has been revised in the light of information which has
come to hand is called a posterior probability distribution. It will be evident that what is a posterior to one sequence
of state of nature becomes the prior to others which are yet to happen. A further analysis of problems using posterior
probabilities with respect to new expected payoffs with additional information is called prior-posterior analysis.
So far, we have used the prior probability distribution of the various states of nature to evaluate EMV or EOL for
different decision alternatives/ acts and accordingly choose the optimal decision alternative/act. Bayesian decision
rule / posterior analysis is an extension of this criterion. EMV and EOL techniques of decision making discussed so
far come under the Prior Analysis technique in as much as both are based on the prior probabilities assigned by the
decision maker on the basis of his/her perfect information, experience and subjective judgment. So, prior probability
distribution is not always the best predictor. To optimize his/her action, the decision maker might be interested to
look in for the best (exact or most accurate) predictor. For this, the posterior analysis technique of decision making
is more appropriate that is based on the posterior probabilities which are determined on the basis of Bayes theorem
in the light of the additional information obtained by sampling techniques, market survey, experiments, and test
research and through some other agencies. We have already discussed the concept of EVPI, which provides the
upper limit to the amount of money, the decision maker would be willing to spend to gather the additional
information about various states of nature.
In posterior analysis, the prior probabilities are revised to obtain posterior probabilities on the basis of the additional
information gathered. These posterior probabilities are then used to obtain the expected payoffs for different
combinations of decision alternatives/acts and events. Finally, the decision alternative/act with the maximum EMV
is chosen as the best decision on alternative act. This process is likely to result in better decision.
This technique is applied only when the EVPI or the EOL (i.e. the cost of transferring a risk into certainty) obtained
under any prior analysis technique appears to be very high on account of imperfect information. In such cases, the
prior probabilities are converted into the posterior probabilities and then the revised EVPI (EOL) is computed again
on the basis of such revised or posterior probabilities. According to Bayes' theorem, the posterior probabilities are
obtained by the following model:
Total ∑EOL
(vi) Determine the EVSI by the model:
EVSI = EVPI – AMEOL
(vii) Determine the ENGS by the model:
ENGS = EVSI – ECS
(viii) If there is ENGS, state that the expected cost of sampling is desirable otherwise not.
Example1. There are three varieties of machines viz. A, B and C of which any one is to be purchased by a firm. The
profits expected from the different machines under different markets conditions are tabulated as under:
Profit matrix (in ‘000 Rs.)
Market Machine
A B C
Poor 0.50 0.00 −1.50
Fair 1.00 1.50 0.50
Good 1.50 2.50 3.50
The probabilities of the market being poor, fair, and good were estimated by the firm to be 0.3, 0.5 and 0.2
respectively. But a research group opined that these probabilities can not to be relied upon to be accurate and they
assessed the following chances after a careful survey of the market conditions.
Actual state Indicated state
Poor Fair Good
Poor 0.7 0.2 0.1
Fair 0.2 0.7 0.1
Good 0.0 0.2 0.8
From the above particulars
(i) Construct the expected opportunity loss table basing on the market assessment made by the firm and
determine the optimal act using EOL criterion. Also, determine the EVPI therefrom.
(ii) Construct the EOL table basing upon the information furnished by the research group and determine the net
revised EOL (i.e. AMEOL) thereby.
(iii) State the maximum amount that should be spent after the market research.
(iv) Also, find the expected net gain from the sampling (ENGS), if the decision maker is prepared to obtain
additional information for Rs.110.
Solution:
Prior Analysis
The payoff table/profit matrix is given as follows:
Payoff table [Profit matrix (in ‘000 Rs.)]
Act A B C
Event
Poor 0.50 0.00 −1.50
Fair 1.00 1.50 0.50
Good 1.50 2.50 3.50
The regret table (opportunity loss table) can be obtained by subtracting payoff value of each event in the row from
maximum payoff value of corresponding event of that row.
Regret table [OL table]
Act A B C
Event
Poor 0.50−0.50=0 0.5−0= 0.5 0.5−(−1.50) =2
Fair 1.50−1.00=0.5 1.50−1.50=0 1.50−0.50=1
Good 3.50−1.50=2 3.50−2.50=1 3.50−3.50=0
The expected opportunity loss (EOL) value of each act by using formula [expected loss = Prob. ×OL] can be
obtained as follows:
Expected opportunity table [EOL table]
Act A B C
Event Prob.
Poor 0.3 0.3×0=0 0.3×0.5=0.15 0.3×2=0.6
Fair 0.5 0.5×0.5=0.25 0.5×0=0 0.5×1=0.5
Good 0.2 0.2×2=0.4 0.2×1=0.2 0.2×0=0
EOL Total 0.65 0.35 1.10
From the above EOL table constructed on the basis of the prior probabilities, we have found that the EOL for act B
is least value i.e. 0.35 or Rs.350. Thus, best act by prior analysis is machine B. We know that EVPI means minimum
EOL. Thus,
EVPI = Minimum EOL = Rs.350 which is the cost of transferring the risk to uncertainty. This represents the
maximum amount of money that decision maker has to pay to get additional information about various states of
nature before decision has to be made.
Posterior Analysis
Since the research group advice not to rely on the prior probabilities thus estimated and to revise such probabilities
in the light of the additional information i.e., the given conditional probabilities, the posterior analysis of the
problem is to be made as under:
Event Prior Conditional Probability Joint Probability Posterior Probability
Prob. Poor Fair Good Poor Fair Good Poor Fair Good
Poor 0.3 0.7 0.2 0.1 0.21 0.06 0.03 0.68 0.13 0.12
Fair 0.5 0.2 0.7 0.1 0.10 0.35 0.05 0.32 0.78 0.21
Good 0.2 0 0.2 0.8 0 0.04 0.16 0 0.09 0.67
Total 1 0.31 0.45 0.24 1 1 1
Example2. A manager is faced the problem of choosing one of the three products (acts): product A (act A1), product
B (act A2) and product C (act A3), for production. The potential demand (states of nature) for each product may turn
out to be poor (N1), moderate (N2) and good (N3). The payoff table (in Rs.) for different combinations of acts and
events is given in following Table.
Acts A1 A2 A3
States of nature
N1 −20 −50 200
N2 200 −100 −50
N3 400 600 300
The probabilities of the states of nature are 0.3, 0.4 and 0.3 respectively.
(i) Determine the optimal act using the EMV criterion.
(ii) Also, find the expected value of perfect information (EVPI).
(iii) If the decision maker is prepared to obtain additional information for Rs.110, should the information be
collected?
(iv) If he/she collects the additional information and gives the following conditional probabilities for the states
of nature, obtain the posterior probabilities and the posterior payoff table.
Actual state of nature Predicted State of nature (Demand)
(Demand) X1(Low) X2(Moderate) X3(Good)
N1 (Low) 0.5 0.3 0.2
N2(Moderate) 0.3 0.6 0.1
N3(Good) 0.2 0.1 0.7
(v) What is the optimal decision based on posterior analysis?
(vi) Also, find the expected value of sample information (EVSI) and the expected net gain from sampling
(ENGS).
Solution:
(i) The payoff table in Rs. and the probabilities of the states of nature are given below:
States of nature Probability Payoff (in Rs.)
Act A1 Act A2 Act A3
N1 0.3 −20 −50 200
N2 0.4 200 −100 −50
N3 0.3 400 600 300
The EMV for each act can be calculated as follows:
EMV for A1 = ∑Payoff ×Probability
= −20×0.3 + 200×0.4 + 400×0.3= −6 + 80 + 120= Rs.194
EMV for A2 = ∑Payoff ×Probability
= −50×0.3 + (−100×0.4) + 600×0.3= −15 − 40 + 180= Rs.125
EMV for A3 = ∑Payoff ×Probability
= 200×0.3 + (−50×0.4) + 300×0.3= 60 − 20 + 90= Rs.130
Since EMV for act A1 has maximum value by EMV criterion, act A1 is the optimal act.
(ii) The expected profit under perfect information (EPPI) is given by
EPPI = ∑Maximum payoff over different acts ×Probability
= 200×0.3 + 200×0.4 + 600×0.3= 60 + 80 + 180= Rs.320
EVPI = EPPI – Maximum EMV under uncertainty= Rs.320 − Rs.194 =Rs.126
(iii) EVPI represents the maximum amount of money that the decision maker has to pay to get additional
information before decision has to be made.
Here, the cost of additional information = Rs.110 and EVPI = Rs.126
Net gain = Rs.126 – Rs.110 = Rs.16
Since EVPI = Rs.126 > Rs.110, the decision maker should decide to go in for the additional information to
get net gain Rs.16.
(iv) Posterior Analysis
"Utility" is the level of satisfaction or benefits that someone gains from consuming a given amount of goods or
services. In economics, the unit of utility is known as "Utils".
So far problems were analyzed with probabilities of states of nature where selection of an optimal course of action
was based on the criterion of expected profit (or loss) expressed in monetary terms. However, in many situations,
such criteria involving expected monetary payoff may not be appropriate. This is because of the fact that different
individuals attach different utility to money under different conditions. The term utility is the measure of preference
that individuals have for various alternatives available to them. The utility of a given alternative is unique to
individual decision-makers and, unlike a simple monetary amount, can incorporate intangible factors or subjective
standards from their own value systems.
2.5.1Utility Functions
Utility functions typically describe the relative preference value that individuals have for a given amount of the
criterion such as money, goods, etc. They are often determined by proposing a situation to the subjects whereby they
must choose between receiving a given amount, say Rs.20, 000 for certain thing versus a 50-50 chance of gaining a
larger amount or nothing say Rs.60, 000 or zero. The gamble amount Rs.60, 000 is then adjusted upward or
downward until the individual is indifferent to whether decision-maker receives the certain amount of Rs.20, 000 or
the gamble. This indifference point then establishes one experimentally determined value on the individual's utility
curve and other points are similarly determined.
Utility Function is a mathematical function that transforms monetary values into utility values. In other words, the
utility function is the mathematical representation of a consumer’s preferences. Once derived, a utility function can
be used to convert a decision criteria value into utils so that a decision can be made on the basis of maximizing the
expected utility value (EUV) rather than, say EMV. Three general types of utility functions are (1) Risk-Averse (2)
Risk-Neutral and (3) Risk-Seeking (or loving) .
Expected utility is a theory in economics that estimates the utility of an action when the outcome is uncertain. It advises
choosing the action or event with the maximum expected utility. At any point in time, the expected utility will be the
weighted average of all the probable utility levels that an entity is expected to reach under specific circumstances.
Under this alternative criterion, it is assumed that a rational decision-maker will choose that alternative which optimizes
the expected utility rather than expected monetary one. Once we know the individual's utility function along with the
probability assigned to outcomes in a particular situation, then total expected utility for each course of action can be
obtained by multiplying utility values with their probabilities. Thus,
Expected Utility = ∑Utility value ×Probability =PAU(A) + PB U(B) + PcU(C)
The strategy which corresponds to optimum utility function is called the equal strategy. Expected utility is used as a tool
for decision-making under circumstances where the outcomes of decisions are not known.
The expected utility theory considers it a logical choice to choose the event with the maximum expected utility. However,
in case of risky outcomes, decision-makers may not choose the action with a higher expected utility. The decision to
choose an action will also depend on the entity’s risk aversion and other entities’ utility. While some entities choose the
option with the riskier highest expected utility, some highly risk-averse entities prefer the low-risk option even if it shows
a lower expected value.
Expected utility theory also helps to explain the reason for people taking out insurance policies. It is a situation where the
payback is not immediate; however, insurance policies cover individuals for several risks. Insurance policyholders receive
tax benefits and a certain income at the expiry of a predetermined period. Hence, when one compares the expected utility
to be received from paying insurance premiums with the expected utility of investing the amount on other products,
insurance appears to be a better choice.
The concepts of marginal utility and expected utility are related. The expected utility of wealth or a reward reduces when
the entity possesses sufficient wealth. Such entities may go for the safer alternative instead of the riskier ones.
The addition of $1,000 to the income may not impact the marginal utility of two different entities in the same way. For
example, if the annual income of a low-earning family is increased from $1,250 to $2,250, it will improve their quality of
life as well as the marginal utility. On the contrary, if the income of a high-earning family increases from $120,000 to
$121,000 in a year, there is a very small utility improvement.
Example3. Here is the information given below for playing two gambles 1 and 2.
Gamble1 Gamble 2
20% chance of winning Rs.6000 25% chance of winning Rs.4000
80% chance of winning Rs.0 75% chance of winning Rs.0
Suppose consumer’s utility of money is U(X) =X.
(i) Find expected utility of each gamble.
(ii) Select best option using EUV criterion.
Solution:
The expected utility of gamble1 =EUV1= p1U1+p2U2 = 0.20 ×Rs.6000 +0.80×Rs.0 = Rs.1200
The expected utility of gamble2 =EUV2= p1U1+p2U2 = 0.25 ×Rs.4000 +0.75×Rs.0 = Rs.1000
Since EUV1 > EUV2, consumer will choose gamble 1 that maximizes the expected utility.
A utility curve that relates utility values to rupees values is constructed. Such a curve usually is obtained by placing
the decision-maker in various hypothetical decision situations and plotting the decision-maker’s pattern of choices in
terms of risk and utilities. The following figure shows several utility curves and the risk preference associated with
each.
The utility curve exhibits whether a consumer is risk aversion (avoider), risk indifference (neutrality) or risk affinity
(seeker or loving). It determines whether a given utility function is consistent with a consumer being risk averse, risk
neutrality or risk loving.
Case1. Risk neutrality: Risk neutral consumers always choose the option with the highest expected value.
Maximizing expected utility Maximizing expected value
For risk neutral consumer, the utility of getting the expected value of a gamble for certain equals the expected utility
of the gamble. Thus, E (U) = U
Risk neutral = Linear utility function
Case2. Risk Averse
Risk Averse = Concave utility function
For risk averse consumer, the utility of getting the expected value of a gamble for certain is greater than the expected
utility of the gamble. Thus, U > E (U)
Case3. Risk Loving (Seeker)
Risk Loving = Convex utility function
For risk loving consumer, the utility of getting the expected value of a gamble for certain is less than the expected
utility of the gamble. Thus, U < E (U).
2.6 Decision making under ignorance
Ignorance is an extreme form of uncertainty. In most narrow and technical sense, it means inability to assign a
meaningful probability to the phenomena of interest. Decisions making under ignorance are decisions made when
one cannot assign a subjective probability to the possible outcomes of any act i.e., under ignorance, decision maker
knows all possible states of nature but does not know the probability of occurrence. For decisions making under
ignorance there are no probabilities available to the agent. So, the standard principle for decision making, that is, the
principle of maximizing expected utility cannot be used. Under the decision making under ignorance, the following
three criteria are used to select the best decision alternative (best act).
Under decision making with ignorance, select best alternative action based on (i) maximax criterion (ii) maximin
criterion and (iii) Laplace-Bayes criterion.
Solution:
(i) Here,
Kelly Construction payoff table (Rs.)
Alternative actions States of nature (Demand) Maximan criterion
Low (50 units) Medium (100 units) High (100 units) Maximum payoff
Build 50 400000 400000 400000 400000
Build 100 100000 800000 800000 800000
Build 150 200000 500000 1200000 1200000 maximax
Under decision making with ignorance based on maximax criterion, decision maker should build 150 which gives
maximum payoff Rs.1200000 among all selected maximum payoff values Rs.400000, Rs.800000 and Rs.1200000.
(ii) Here,
Kelly Construction payoff table (Rs.)
Alternative actions States of nature (Demand) Maximin criterion
Low (50 units) Medium (100 units) High (100 units) Minimum payoff
Build 50 400000 400000 400000 400000Maximin
Build 100 100000 800000 800000 100000
Build 150 200000 500000 1200000 200000
Under decision making with ignorance based on maximin criterion, decision maker should build 50 which gives
maximum payoff Rs.400000 among all selected minimum payoff values Rs.400000, Rs.100000 and Rs.200000.
(iii) Here,
Kelly Construction payoff table (Rs.)
Alternative actions States of nature (Demand) Laplace-Bayes criterion
Low (50 units) Medium (100 units) High (100 units) Average payoff Rs
Build 50 400000 400000 400000 400000
Build 100 100000 800000 800000 566667
Build 150 200000 500000 1200000 633334
Under decision making with ignorance based on Laplace-Bayes criterion, decision maker should build 150 which
gives maximum average payoff Rs.633334 among all selected minimum payoff values Rs.400000, Rs.566667 and
Rs.633334.
2.7 Risk analysis and Sensitivity analysis.
Risk analysis helps the decision maker recognize the difference between: the expected value of a decision
alternative, and the payoff that might actually occur. The risk profile for a decision alternative shows the possible
payoffs for the decision alternative along with their associated probabilities.
Sensitivity analysis can be used to determine how changes to the following inputs affect the recommended decision
alternative:
• probabilities for the states of nature
• values of the payoffs
If a small change in the value of one of the inputs causes a change in the recommended decision alternative, extra
effort and care should be taken in estimating the input value.