next up previous contents
Next: The Kirkwood phase transition Up: Constraint induced correlations Previous: Relationship of entropies per

 

Correction terms in second order entropy.

The last three terms of tex2html_wrap_inline13873 in equation 4.12 for tex2html_wrap_inline13847 with B/N fixed are tex2html_wrap_inline13879. Specifically, expanding these correction terms in a Taylor series for N with B=N q yields
 equation1361
Note 1) this is independent of q only in the first term; 2) this is negative, which is required to satisfy the theorem of section 4.7; 3) in deriving this result it was assumed that tex2html_wrap_inline13887, so that the second order entropy exists; however 4) in deriving this result a range for B was not assumed other than tex2html_wrap_inline13891, contrary to the perhaps misleading form of the correction terms in equation 4.12; 5) the correction terms of equation 4.12 are not necesarily real for noninteger N and B or, therefore, away from the discrete values of q allowed. However it is clear from the form of equation 4.12 that the correction terms become imaginary for noninteger B only for 0<B<1 (0<q<1/N) and 0<N-B<1 (1-1/N<q<1); 6) the third and higher order correction terms are not independent of q; 7) the third order correction term becomes singular at q=0,1 (B=0,N), indicating that for fixed N, as tex2html_wrap_inline13917 (tex2html_wrap_inline13919), the correction terms can become quite large. However, entropies are always positive, and as tex2html_wrap_inline13917 all entropies converge to zero, so either the series for the correction terms must also converge to zero in sum in these limits, or the radius of convergence of the series does not include these limits, which is actually the case; 8) each coefficient of the series of equation 4.16 is a real function of q, yet the overall correction of equation 4.12 is not real for values of q in the ranges mentioned above. This is an effect of the fact that the radius of convergence of the Taylor series includes only those values of N for which the arguments of the logarithms in equation 4.12 are all positive.

Not unexpectedly after the discussion just given, the maximum absolute value of the correction of equation 4.12 occurs at the points q=1/N,1-1/N, and has a slope which diverges logarithmically as these points are approached. In this unphysical sense, the derivative of the second order entropy with respect to bit density shows a phase transition as the number of one bits per string of length N drops to one, or increases to N-1. Again, what this indicates physically is not defined, as it is not possible to have fractional bits.


next up previous contents
Next: The Kirkwood phase transition Up: Constraint induced correlations Previous: Relationship of entropies per

David Wolf
Tue Mar 25 08:11:49 CST 1997