My Math Forum  

Go Back   My Math Forum > College Math Forum > Advanced Statistics

Advanced Statistics Advanced Probability and Statistics Math Forum

LinkBack Thread Tools Display Modes
March 6th, 2016, 08:53 PM   #1
Joined: Mar 2016
From: Baltimore

Posts: 1
Thanks: 0

Advanced Markov Problem

Hi, Can someone help me solve this question (5) please

5. [Markov Chain Advanced, 15 Points] The one-step transition probability matrix with seven states (i.e., 0, 1, 2, 3, 4, 5, 6) of a Markov chain is given below:
(a) Determine the classes of this Markov chain and, for each class, determine whether it is recurrent, transient or absorbing.
(b) For each of the classes identified in part (a), determine the periodicities of each class.
(c) Starting from state 2 and state 4 respectively, what are the mean numbers of times state 2 and state 4 will be visited if the Markov chain is continued for infinite time period?
(e) Starting from state 0, what is the probability to reach to state 1 for the first time after exactly four time periods?
(f) If we start from state 3, what is the limiting (steady-state) probability of being into state 1?

Last edited by aditimittal; March 6th, 2016 at 08:56 PM.
aditimittal is offline  
March 8th, 2016, 02:00 PM   #2
Global Moderator
Joined: May 2007

Posts: 6,834
Thanks: 733

one-step transition probability matrix given below
mathman is offline  

  My Math Forum > College Math Forum > Advanced Statistics

advanced, markov, problem

Thread Tools
Display Modes

Similar Threads
Thread Thread Starter Forum Replies Last Post
Advanced Geometry Problem Orlando895 Geometry 2 December 27th, 2014 10:49 AM
Proof that sum of N Markov processes is a Markov process jjkraak Advanced Statistics 5 November 30th, 2011 05:35 AM
Advanced trigonometry problem NeuroFuzzy Algebra 4 September 28th, 2009 08:28 PM
Advanced Series Problem sixflags11804 Real Analysis 10 April 4th, 2008 05:05 PM
coin tossing problem/ markov chain problem aptx4869 Advanced Statistics 0 June 30th, 2007 09:03 PM

Copyright © 2019 My Math Forum. All rights reserved.