My Math Forum  

Go Back   My Math Forum > College Math Forum > Advanced Statistics

Advanced Statistics Advanced Probability and Statistics Math Forum


Reply
 
LinkBack Thread Tools Display Modes
March 6th, 2016, 08:53 PM   #1
Newbie
 
Joined: Mar 2016
From: Baltimore

Posts: 1
Thanks: 0

Advanced Markov Problem

Hi, Can someone help me solve this question (5) please




5. [Markov Chain Advanced, 15 Points] The one-step transition probability matrix with seven states (i.e., 0, 1, 2, 3, 4, 5, 6) of a Markov chain is given below:
States
(a) Determine the classes of this Markov chain and, for each class, determine whether it is recurrent, transient or absorbing.
(b) For each of the classes identified in part (a), determine the periodicities of each class.
(c) Starting from state 2 and state 4 respectively, what are the mean numbers of times state 2 and state 4 will be visited if the Markov chain is continued for infinite time period?
(e) Starting from state 0, what is the probability to reach to state 1 for the first time after exactly four time periods?
(f) If we start from state 3, what is the limiting (steady-state) probability of being into state 1?

Last edited by aditimittal; March 6th, 2016 at 08:56 PM.
aditimittal is offline  
 
March 8th, 2016, 02:00 PM   #2
Global Moderator
 
Joined: May 2007

Posts: 6,834
Thanks: 733

Quote:
one-step transition probability matrix ....is given below
Where?
mathman is offline  
Reply

  My Math Forum > College Math Forum > Advanced Statistics

Tags
advanced, markov, problem



Thread Tools
Display Modes


Similar Threads
Thread Thread Starter Forum Replies Last Post
Advanced Geometry Problem Orlando895 Geometry 2 December 27th, 2014 10:49 AM
Proof that sum of N Markov processes is a Markov process jjkraak Advanced Statistics 5 November 30th, 2011 05:35 AM
Advanced trigonometry problem NeuroFuzzy Algebra 4 September 28th, 2009 08:28 PM
Advanced Series Problem sixflags11804 Real Analysis 10 April 4th, 2008 05:05 PM
coin tossing problem/ markov chain problem aptx4869 Advanced Statistics 0 June 30th, 2007 09:03 PM





Copyright © 2019 My Math Forum. All rights reserved.