My Math Forum calculating the entropy

 Algebra Pre-Algebra and Basic Algebra Math Forum

 November 6th, 2011, 01:50 AM #1 Member   Joined: Jul 2010 Posts: 95 Thanks: 0 calculating the entropy Hello i need a help finding an entropy: I have the alphabet and probabilitties of source: $S=\{X,Y,Z\} {\tab}{\hspace*{5em}} where {\tab}{\hspace*{5em}} P(X)=0.2; {\tab}{\hspace*{5em}} P(Y)=0.5$ and i know that symbols are independent. My question is how can i find an entropy of $S^2$ ----------------------------------------------//----------------------------------------------- So i would do the following: 1) i would find an entropy of $S$ $P(Z)= 1 - P(X) - P(Y) = 0.3$ $H(S)=0.2*log_2{5}+0.5*log_2{2}+\frac{3}{10}*log_2{ \frac{10}{3}\approx {1.4854}$ 2) and to find $H(S^2)$ should i square the result of $H(S)$ ?

 Tags calculating, entropy

 Thread Tools Display Modes Linear Mode

 Similar Threads Thread Thread Starter Forum Replies Last Post acepsut Economics 0 June 28th, 2013 04:28 AM ZardoZ Computer Science 0 April 6th, 2013 05:48 AM iVenky Computer Science 5 March 29th, 2013 09:35 AM iVenky Computer Science 1 March 27th, 2013 05:16 AM trid2 Advanced Statistics 1 March 1st, 2009 06:24 PM

 Contact - Home - Forums - Cryptocurrency Forum - Top