


Next:Forms
of the information Up:Information
and correlation in Previous:High
order entropies of
Information correlation functions
in the Ising system
Referring to section 3.12
and using the general distribution for the Ising system we find that the
of equation 3.26
(here denoted by
)
of the information correlation function
equations 3.29
(here denoted by
)
is given by
Taking the logarithm of this and averaging yields
.
In the large n limit, where there are a large number of spins in
the system, the terms in the fraction largely cancel, leaving the simpler
result that
A comparison with the distribution of two spins and its marginals shows
that
is
times the mutual information between the spins (see section 6.16).
In general this mutual information and
are then
Graphs of the information correlation functions of 2,3 and 4 neighboring
spins are given in figures 6.5-6.7.
When the external field is zero, we find that the ratio of v's is
either +1 or -1 depending on whether
and
differ. (Note that the logarithms are base e, and that
appears as b in the axis label.) Thus, referring to section 6.14
for the values of the eigenvectors and eigenvalues the nth information
correlation function is given simply in this case by
where
and
.
Thus, we have a straightforward interpretation of
in the large number of spins limit (regardless of whether the external
field is zero) - it is defined on a set of k possibly widely-separated
spins, but gives us
times the mutual information between the first spin and the last spin.
The asymptotics of
in zero field are trivial, since
.
Finally, defining
and
to be the probability that spins
and
are the same and different, respectively, we have
,
and
where S(p,1-p) := - p log(p) - (1-p)
log(1-p).
Figure 6.5: Second order information correlation function of
the Ising system. Information correlation of two neighboring spins. Note
that the information correlation functions are similar up to a sign at
each order for this system. The information correlation functions are the
mutual information of the first and last spins along the chain in the k
spins considered at order k times
Figure 6.6: Third order information correlation function of
the Ising system. Information correlation of three neighboring spins.
Figure 6.7: Fourth order information correlation function of
the Ising system. Information correlation of four neighboring spins.



Next:Forms
of the information Up:Information
and correlation in Previous:High
order entropies of
David Wolf
Tue Mar 25 08:11:49 CST 1997