
Advanced Statistics Advanced Probability and Statistics Math Forum 
 LinkBack  Thread Tools  Display Modes 
February 2nd, 2016, 10:27 PM  #1 
Newbie Joined: Jan 2016 From: Brussels Posts: 1 Thanks: 0  3X3 matrix, Markov chain
I'm preparing an exam and I found this problem in the previous year's documents. I've been trying to solve it, thinking about it ever since. Consider the following 3x3 matrix $\displaystyle P$: $\displaystyle \begin{vmatrix} 0.5 & 0.3 & 0.2 \\ 0.2 & 0.2 & 0.6 \\ 0.4 & 0.4 & 0.2 \end{vmatrix}$  Calculate $\displaystyle P^{100}$ analytically but quickly (show the steps  no Matlab)  Assume this matrix corresponds to a (discrete time) markov chain where entry $\displaystyle P_{ij}$ shows the probability of going from state i to state j. What is the stationary distribution for this chain (if any)?  How fast does the chain converge to the stationary distribution? (assume the initial distribution is (1,0,0) and calculate some difference metric between the initial distribution and the derived stationary distribution). Firstly, let me tell you what I got so far.  $\displaystyle P^{100}=P^{4}+P^{32}+P^{64} = $ $\displaystyle \begin{vmatrix} 0.376 & 0.301 & 0.32 \\ 0.376 & 0.301 & 0.32 \\ 0.376 & 0.301 & 0.32 \end{vmatrix}$  Def: "The stationary distribution of a markov chain with transition matrix P is some vector, x, such that xP=x." Then we multiply x = [x1 x2 x3] with the matrix P from the beginning, and get the value of the vector (the stationary distribution): x=(0.377, 0.301, 0.32).  The last question is the one causing trouble. 1) are my results correct so far? 2) how do I calculate convergence speed from (1,0,0) to (0.377, 0.301, 0.32)? 3) what are the difference metrics? I've only heard of "Total Variation Distance", but unfortunately, "I've only heard of it" is really all I know. I would be tremendously grateful to any guidance/help you could provide me. Thanks! 

Tags 
3x3, chain, markov, matrix, stationary 
Search tags for this page 
Click on a term to search for related topics.

Thread Tools  
Display Modes  

Similar Threads  
Thread  Thread Starter  Forum  Replies  Last Post 
Markov Chain (transition matrix)  rmcf87  Advanced Statistics  3  January 21st, 2016 08:31 PM 
Do you know Markov chain?  Hemantha  Probability and Statistics  1  July 7th, 2014 12:57 PM 
help in markov chain  legendoulis  Advanced Statistics  4  April 4th, 2012 11:28 AM 
Markov chain  butabi  Advanced Statistics  1  February 12th, 2012 03:20 PM 
Markov Chain matrix  Turloughmack  Linear Algebra  0  February 7th, 2011 05:15 AM 