My Math Forum  

Go Back   My Math Forum > College Math Forum > Advanced Statistics

Advanced Statistics Advanced Probability and Statistics Math Forum

LinkBack Thread Tools Display Modes
March 12th, 2009, 12:35 AM   #1
Joined: Mar 2009

Posts: 2
Thanks: 0

Markov Chain (transition matrix)

Hey can anyone please help me obtain the transition of the markov chain with states being the number of projects the architect has in hand at the beginning of a month.

An architect can handle up to 3 projects at once. During any month there is a probability of 0.5 of acquiring one new project (to start the next month) provided the architect knows that the project can be handled, otherwise no new projects are acquired. That is, the architect decides to take the honourable course of not taking on a new project for the next month unless it is known that it can be handled. Existing projects are equally-likely to finish by the start of the next month or to continue, independently of each other.
Thank you.
rmcf87 is offline  
March 12th, 2009, 07:51 AM   #2
Senior Member
Joined: May 2008
From: York, UK

Posts: 1,300
Thanks: 0

Re: Markov Chain (transition matrix)

Try writing everything in terms of what can happen, with what probabilities. For instance, if and then:

no new projects are acquired, prob. 0.5.
a new project is acquired, prob. 0.5
not possible - only one project can be acquired in any month, prob. 0

a project is finished and no new projects are acquired, prob. 0.5 x 0.5


Remember that for any where is the state space.
mattpi is offline  
March 12th, 2009, 02:18 PM   #3
Joined: Mar 2009

Posts: 2
Thanks: 0

Re: Markov Chain (transition matrix)

Thank you very much for your reply. And I can see what you're trying to say, I understand it now, thanks again.

Last edited by skipjack; January 21st, 2016 at 09:26 PM.
rmcf87 is offline  
January 21st, 2016, 08:31 PM   #4
Joined: Jan 2016
From: Ethiopia

Posts: 1
Thanks: 0

Math Focus: DouglasmiXM
This seems like an awesome place!


Stumbled upon this space and just checking out what is all about!
Douglasmi is offline  

  My Math Forum > College Math Forum > Advanced Statistics

chain, markov, matrix, transition

Thread Tools
Display Modes

Similar Threads
Thread Thread Starter Forum Replies Last Post
Markov Chain transition diagram jameshall Advanced Statistics 0 March 26th, 2014 04:47 AM
help in markov chain legendoulis Advanced Statistics 4 April 4th, 2012 11:28 AM
Markov chain and state transition diagram Fabio Advanced Statistics 1 February 21st, 2011 05:26 AM
Markov Chain matrix Turloughmack Linear Algebra 0 February 7th, 2011 05:15 AM
Markov Chains (Transition Matrix) dani87 Advanced Statistics 1 July 24th, 2009 09:00 PM

Copyright © 2019 My Math Forum. All rights reserved.