Abstract Methods in Information Theory

Front Cover
World Scientific, 1999 - Mathematics - 251 pages
0 Reviews
Information Theory is studied from the following view points: (1) the theory of entropy as amount of information; (2) the mathematical structure of information sources (probability measures); and (3) the theory of information channels. Shannon entropy and Kolmogorov-Sinai entropy are defined and their basic properties are examined, where the latter entropy is extended to be a linear functional on a certain set of measures. Ergodic and mixing properties of stationary sources are studied as well as AMS (asymptotically mean stationary) sources. The main purpose of this book is to present information channels in the environment of real and functional analysis as well as probability theory. Ergodic channels are characterized in various manners. Mixing and AMS channels are also considered in detail with some illustrations. A few other aspects of information channels including measurability, approximation and noncommutative extensions, are also discussed.
 

What people are saying - Write a review

We haven't found any reviews in the usual places.

Contents

Entropy
1
Information Sources
67
Information Channels
121
Special Topics
189
References
225
Indices
239
Copyright

Other editions - View all

Common terms and phrases

References to this book

Bibliographic information