Scribd
Upload
36 views8 pages

IE516 10/17 DTMC Notes: Tuesday, October 17, 2017 9:05 AM

This document contains notes from a class on Discrete Time Markov Chains (DTMC). The notes cover DTMC concepts such as states, transition probabilities, stationary distributions, absorbing states and recurrent states. Examples are provided to illustrate DTMC applications in areas like reliability, queueing systems and random walks.

Uploaded by

Nasr Cheaib
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
36 views8 pages

IE516 10/17 DTMC Notes: Tuesday, October 17, 2017 9:05 AM

This document contains notes from a class on Discrete Time Markov Chains (DTMC). The notes cover DTMC concepts such as states, transition probabilities, stationary distributions, absorbing states and recurrent states. Examples are provided to illustrate DTMC applications in areas like reliability, queueing systems and random walks.

Uploaded by

Nasr Cheaib
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 8

IE51610/17DTMCnotes

Tuesday,October17,2017 9:05AM

Quick Notes Page 1


Quick Notes Page 2
Quick Notes Page 3
Quick Notes Page 4
Quick Notes Page 5
Quick Notes Page 6
Quick Notes Page 7
Quick Notes Page 8

You might also like