My Math Forum  

Go Back   My Math Forum > College Math Forum > Advanced Statistics

Advanced Statistics Advanced Probability and Statistics Math Forum

LinkBack Thread Tools Display Modes
February 12th, 2012, 04:31 AM   #1
Joined: Sep 2010

Posts: 60
Thanks: 0

Markov chain

A boy and a girl move to the same two-bar-town on the same day. Each night, boy visits one bar, starting the first night with bar 1 and continues by selecting a bar for the next night according to a Markov chain with transition matrix P below. Similarly, girl visits one bar a night,starting with bar 2 and selecting the next bar according to Q below:

Hint: The progress of boy and girl finding each other can be modelled as a single Markov chain where only one (!) state is absorbing.
a) Find the probability that boy visits bar 1 and girl visits bar 2 on the nth night.
b) Let N denote the number of the night when girl meets boy. Compute the expected number of nights E[N] it takes for boy and girl to meet. Hint: Either compute the distributionof N, or develop an invariance equation for E[N].
c) Find the probability that they meet in bar 1.
d) Find the distribution of the time of their meeting (distribution of N).

Thank you very much for your help in advance!
butabi is offline  
February 12th, 2012, 03:20 PM   #2
Senior Member
Joined: Oct 2011
From: Belgium

Posts: 522
Thanks: 0

Re: Markov chain

Do first a eigensystemdecomposition for P and Q, then it is easier to calculate P^n and Q^n.
wnvl is offline  

  My Math Forum > College Math Forum > Advanced Statistics

chain, markov

Thread Tools
Display Modes

Similar Threads
Thread Thread Starter Forum Replies Last Post
Help with Hidden Markov chain dr_romix Advanced Statistics 2 October 16th, 2012 06:36 PM
help in markov chain legendoulis Advanced Statistics 4 April 4th, 2012 11:28 AM
Markov Chain problem 450081592 Advanced Statistics 1 March 6th, 2012 04:17 PM
Markov Chain Epidemics CraigSager Advanced Statistics 5 March 23rd, 2011 10:10 AM
Markov Chain matrix Turloughmack Linear Algebra 0 February 7th, 2011 05:15 AM

Copyright © 2018 My Math Forum. All rights reserved.