My Math Forum Advanced Markov Problem

 March 6th, 2016, 08:53 PM #1 Newbie   Joined: Mar 2016 From: Baltimore Posts: 1 Thanks: 0 Advanced Markov Problem Hi, Can someone help me solve this question (5) please 5. [Markov Chain Advanced, 15 Points] The one-step transition probability matrix with seven states (i.e., 0, 1, 2, 3, 4, 5, 6) of a Markov chain is given below: States (a) Determine the classes of this Markov chain and, for each class, determine whether it is recurrent, transient or absorbing. (b) For each of the classes identified in part (a), determine the periodicities of each class. (c) Starting from state 2 and state 4 respectively, what are the mean numbers of times state 2 and state 4 will be visited if the Markov chain is continued for infinite time period? (e) Starting from state 0, what is the probability to reach to state 1 for the first time after exactly four time periods? (f) If we start from state 3, what is the limiting (steady-state) probability of being into state 1? Last edited by aditimittal; March 6th, 2016 at 08:56 PM.
March 8th, 2016, 02:00 PM   #2
Global Moderator

Joined: May 2007

Posts: 6,762
Thanks: 697

Quote:
 one-step transition probability matrix ....is given below
Where?

 Thread Tools Display Modes Linear Mode

 Similar Threads Thread Thread Starter Forum Replies Last Post Orlando895 Geometry 2 December 27th, 2014 10:49 AM jjkraak Advanced Statistics 5 November 30th, 2011 05:35 AM NeuroFuzzy Algebra 4 September 28th, 2009 08:28 PM sixflags11804 Real Analysis 10 April 4th, 2008 05:05 PM aptx4869 Advanced Statistics 0 June 30th, 2007 09:03 PM

 Contact - Home - Forums - Cryptocurrency Forum - Top