
Advanced Statistics Advanced Probability and Statistics Math Forum 
 LinkBack  Thread Tools  Display Modes 
March 6th, 2016, 08:53 PM  #1 
Newbie Joined: Mar 2016 From: Baltimore Posts: 1 Thanks: 0  Advanced Markov Problem
Hi, Can someone help me solve this question (5) please 5. [Markov Chain Advanced, 15 Points] The onestep transition probability matrix with seven states (i.e., 0, 1, 2, 3, 4, 5, 6) of a Markov chain is given below: States (a) Determine the classes of this Markov chain and, for each class, determine whether it is recurrent, transient or absorbing. (b) For each of the classes identified in part (a), determine the periodicities of each class. (c) Starting from state 2 and state 4 respectively, what are the mean numbers of times state 2 and state 4 will be visited if the Markov chain is continued for infinite time period? (e) Starting from state 0, what is the probability to reach to state 1 for the first time after exactly four time periods? (f) If we start from state 3, what is the limiting (steadystate) probability of being into state 1? Last edited by aditimittal; March 6th, 2016 at 08:56 PM. 
March 8th, 2016, 02:00 PM  #2  
Global Moderator Joined: May 2007 Posts: 6,834 Thanks: 733  Quote:
 

Tags 
advanced, markov, problem 
Thread Tools  
Display Modes  

Similar Threads  
Thread  Thread Starter  Forum  Replies  Last Post 
Advanced Geometry Problem  Orlando895  Geometry  2  December 27th, 2014 10:49 AM 
Proof that sum of N Markov processes is a Markov process  jjkraak  Advanced Statistics  5  November 30th, 2011 05:35 AM 
Advanced trigonometry problem  NeuroFuzzy  Algebra  4  September 28th, 2009 08:28 PM 
Advanced Series Problem  sixflags11804  Real Analysis  10  April 4th, 2008 05:05 PM 
coin tossing problem/ markov chain problem  aptx4869  Advanced Statistics  0  June 30th, 2007 09:03 PM 