Information TheoryStudents of electrical engineering or applied mathematics can find no clearer presentation of the principles of information theory than this excellent introduction. After explaining the nature of information theory and its problems, the author examines a variety of important topics: information theory of discrete systems; properties of continuous signals; ergodic ensembles and random noise; entropy of continuous distributions; the transmission of information in band-limited systems having a continuous range of values; an introduction to the use of signal space; information theory aspects of modulation and noise reduction; and linear correlation, filtering, and prediction. Numerous problems appear throughout the text, many with complete solutions. 1953 ed. |
Contents
INFORMATION THEORY OF DISCREET SYSTEMS | 1 |
THE ENTROPY OF CONTINUOUS DISTRIBUTIONS | 4 |
Exponential growth of the number of different messages | 7 |
Copyright | |
17 other sections not shown
Other editions - View all
Common terms and phrases
according actual alphabet amount analysis Appendix approximately assume average bandwidth binits calculate called channel completely components consider constraints continuous correlation defined definition derivation desired determined discussion distribution domain duration effect English ensemble entropy equal Equation ergodic ergodic ensemble error example expressed filter finite follows formula Fourier frequency function give given groups important impulse increased independent information theory input integral intersymbol influence language language information language transmission capacity length letter limited linear maximum mean measure method modulation obtained occur output particular possible practical prediction present probability problem properties pulse random noise range ratio received reduces represent result sample points sequence shown signal space spectrum Suppose symbols theorem tion transform transmission transmitted typical unit zero
References to this book
Mathematical Foundations of Information Theory Aleksandr I?Akovlevich Khinchin No preview available - 1957 |