
Probability and Statistics Basic Probability and Statistics Math Forum 
 LinkBack  Thread Tools  Display Modes 
July 7th, 2014, 08:32 AM  #1 
Newbie Joined: Jun 2014 From: SriLanka Posts: 5 Thanks: 0  Do you know Markov chain?
A particle moves on a circle through points which have been marked 0, 1, 2, 3, 4 (in a clockwise order). At each step it has a probability p of moving to right (clockwise) and (1p) to the left (counterclock wise). Let X n denote its location on the circle after the nth step. (i) Explain why {X n , n ≥ 0} is a Markov chain. (ii) Find the transition probability matrix. Please Help me.. 
July 7th, 2014, 01:57 PM  #2 
Global Moderator Joined: May 2007 Posts: 6,628 Thanks: 622 
{i} Essentially by definition. The distribution of X(n+1) depends entirely on the value of X(n). (ii) (I forgot the exact form of a transition matrix). Each row should look like (1p),0,p,0,0 rotated. First row p in second column, second row p in third column, etc. (I may have rows and columns interchanged). 

Tags 
chain, markov 
Search tags for this page 
a particle moves on a circle through points which have been marked,a particle moves on a circle through points which have been marked markov chain,a particle moves in a circle through points marked,a particle moves on a circle through points that have been marked 0 1 2 3 4
Click on a term to search for related topics.

Thread Tools  
Display Modes  

Similar Threads  
Thread  Thread Starter  Forum  Replies  Last Post 
Help with Hidden Markov chain  dr_romix  Advanced Statistics  2  October 16th, 2012 07:36 PM 
help in markov chain  legendoulis  Advanced Statistics  4  April 4th, 2012 12:28 PM 
Markov Chain problem  450081592  Advanced Statistics  1  March 6th, 2012 05:17 PM 
Markov chain  butabi  Advanced Statistics  1  February 12th, 2012 04:20 PM 
Markov Chain matrix  Turloughmack  Linear Algebra  0  February 7th, 2011 06:15 AM 