My Math Forum A newbie needs urgent help in Markov chain
 User Name Remember Me? Password

 Advanced Statistics Advanced Probability and Statistics Math Forum

 February 23rd, 2015, 02:15 AM #1 Newbie   Joined: Feb 2015 From: Amsterdam Posts: 3 Thanks: 0 A newbie needs urgent help in Markov chain Hi people, I am a newbie in Markov chains and I have difficulty to solve some questions. I would appreciate very much if I get some help: 1) First question is about: I am given a sequence of U1, U2,U3,... of independent random variables, uniformly distributed on the unit interval (0,1). I am asked to describe how this sequence can be used to simulate Markov chain with state space {0,1} and transition matrix (p11,p12,p21,p22) starting in state 1. 2) Second question is about: an Markov process {Xt} with state space S={1,2,3}, and generator Q (a 3X3 size matrix), starting in state Xo=1. I am asked: a) Finding limits (t goes to infinite) lim P(Xt=j), j=1,2,3. b) Finding the mean recurrence time of state 1, i.e. finding expected value of T, where T=inf {t>J1 : Xt=1 | Xo=1} and J1 denotes the time for the first jump. Thanks in advance...

 Tags chain, markov, newbie, stochastic, urgent

 Thread Tools Display Modes Linear Mode

 Similar Threads Thread Thread Starter Forum Replies Last Post Hemantha Probability and Statistics 1 July 7th, 2014 12:57 PM legendoulis Advanced Statistics 4 April 4th, 2012 11:28 AM butabi Advanced Statistics 1 February 12th, 2012 03:20 PM CraigSager Advanced Statistics 5 March 23rd, 2011 10:10 AM superman001 Algebra 0 August 31st, 2009 06:17 AM

 Contact - Home - Forums - Cryptocurrency Forum - Top