My Math Forum  

Go Back   My Math Forum > College Math Forum > Advanced Statistics

Advanced Statistics Advanced Probability and Statistics Math Forum


Thanks Tree3Thanks
  • 1 Post By soroban
  • 1 Post By v8archie
  • 1 Post By v8archie
Reply
 
LinkBack Thread Tools Display Modes
February 2nd, 2015, 10:26 AM   #1
Newbie
 
Joined: Dec 2012

Posts: 27
Thanks: 0

Markov Chains

Hi , I am trying to classify the subsets of this Markov chain

I am unsure if one of the subsets is {2, 3, 4} or it is {2, 4}.

So 2 and 4 obviously communicate but I have not seen an example where another number joins two communicating classes in this way (i.e. 3).

Could someone help me clear this up please?
Attached Images
File Type: jpg markov.JPG (13.0 KB, 1 views)
interestedinmaths is offline  
 
February 2nd, 2015, 12:18 PM   #2
Global Moderator
 
Joined: May 2007

Posts: 6,806
Thanks: 716

You need to explain the diagram.
mathman is offline  
February 2nd, 2015, 02:50 PM   #3
Math Team
 
Joined: Dec 2006
From: Lexington, MA

Posts: 3,267
Thanks: 408

Hello, interestedinmaths!

Quote:
I am trying to classify the subsets of this Markov chain
I am unsure if one of the subsets is {2, 3, 4} or it is {2, 4}.
$\color{blue}{\text{I don't understand what "subset" means.}}$

You seem to have this matrix:

$\quad \begin{pmatrix}0&1&0&0&0&0 \\
0&0&\frac{1}{2}&\frac{1}{2}&0&0 \\
0&0&0&1&0&0\\
0&1&0&0&0&0 \\
0 & \frac{1}{3} &0& \frac{1}{3} &0& \frac{1}{3} \\
\frac{1}{2} &0&0&0&\frac{1}{2}&0 \end{pmatrix}$

What exactly is the question?

Thanks from interestedinmaths
soroban is offline  
February 2nd, 2015, 07:05 PM   #4
Math Team
 
Joined: Dec 2013
From: Colombia

Posts: 7,674
Thanks: 2654

Math Focus: Mainly analysis and algebra
I suspect that this is the sort of thing we are after
Quote:
A set of states C is a communicating class if every pair of states in C communicates with each other, and no state in C communicates with any state not in C... A communicating class is closed if the probability of leaving the class is zero, namely that if i is in C but j is not, then j is not accessible from i.
By these definitions $\{2,3,4\}$ is a closed communicating class and $\{5,6\} is a communicating class. There are no other communicating classes.

Subsidiary definitions:
Quote:
A state j is said to be accessible from a state i (written i → j) if a system started in state i has a non-zero probability of transitioning into state j at some point... A state i is said to communicate with state j (written i ↔ j) if both i → j and j → i.
Source: Wikipedia
Thanks from interestedinmaths
v8archie is offline  
February 3rd, 2015, 01:05 AM   #5
Newbie
 
Joined: Dec 2012

Posts: 27
Thanks: 0

Thanks for all the replies. Apologies for not being more descriptive.

I have the matrix that soroban mentions and I wanted to draw the corresponding Markov chain. When drawing it, I was not sure how to identify the communicating classes.

I was stuck deciding whether it was {2,4} and {5,6}

or {2, 3, 4} and {5, 6}.

So could it be said as 4 communicates to 2, and 2 communicates to 3, 3 to 4, and 4 back to 2 they all communicate with each other?
interestedinmaths is offline  
February 3rd, 2015, 03:29 AM   #6
Math Team
 
Joined: Dec 2013
From: Colombia

Posts: 7,674
Thanks: 2654

Math Focus: Mainly analysis and algebra
Yes. 2 and 4 are not a communicating class because from 4 you can get to 3 and back again. (The same goes for 2).
Thanks from interestedinmaths
v8archie is offline  
Reply

  My Math Forum > College Math Forum > Advanced Statistics

Tags
chains, markov



Thread Tools
Display Modes


Similar Threads
Thread Thread Starter Forum Replies Last Post
Markov Chains Wasseem92 Advanced Statistics 1 April 26th, 2014 12:40 PM
markov chains lakshwee0292 Algebra 0 December 3rd, 2013 12:37 AM
MARKOV CHAINS jeany lou Linear Algebra 1 August 11th, 2012 09:28 PM
Markov Chains inequality Algebra 11 November 26th, 2009 03:12 AM
markov chains aptx4869 Advanced Statistics 0 April 30th, 2007 04:57 PM





Copyright © 2019 My Math Forum. All rights reserved.