Assignment Module 5
Assignment Module 5
1. Daily weather at a place may be considered as a two state Markov Chain, with the
W D
W 0.7 0.3
D 0.4 0.6
where W indicates a rainy day and D a dry day. What is the probability that it will be a
rainy day four days from today, given that today is a rainy day? Obtain the steady state
2. Consider a 2-state, first order homogeneous Markov Chain for a sequence of wet and dry
days. State 1 is dry and state 2 is wet. The transition probability matrix for the Markov
Chain is given by
dry wet
What is the probability of the day 3 being in wet state, if day 0 is a dry day?
3. Consider a Markov chain model for daily rainfall in a subcatchment. Consider state-1
represents a dry condition, state-2 represents an intermediate rainfall condition and state-
state-1 without going to state-2, what fraction of time is the subcatchment in each of the
states.
corresponding to t = 1, 2, …, 50.
5. Consider that today’s weather condition depends on the previous two days weather
condition (i.e., whether or not it rains today depends on previous weather conditions
through the last two days). The transition probability matrix is given by
Obtain the probability that it will rain on Friday, given that it rained on Tuesday and
Wednesday.