Information TheoryStudents of electrical engineering or applied mathematics can find no clearer presentation of the principles of information theory than this excellent introduction. After explaining the nature of information theory and its problems, the author examines a variety of important topics: information theory of discrete systems; properties of continuous signals; ergodic ensembles and random noise; entropy of continuous distributions; the transmission of information in band-limited systems having a continuous range of values; an introduction to the use of signal space; information theory aspects of modulation and noise reduction; and linear correlation, filtering, and prediction. Numerous problems appear throughout the text, many with complete solutions. 1953 ed. |
Contents
INFORMATION THEORY OF DISCREET SYSTEMS | 1 |
THE ENTROPY OF CONTINUOUS DISTRIBUTIONS | 60 |
SOME PROPERTIES OF CONTINUOUS SIGNALS | 65 |
Copyright | |
14 other sections not shown
Other editions - View all
Common terms and phrases
alphabet amplitude Appendix approximately average information average quadiva average value bandwidth binits C. E. Shannon Chap code capacity code channel coherent consider correlation cross-correlation desired signal determined duration encoding English ensemble average ensemble of functions entropy power Equation ergodic ensemble ergodic sequence ergodic system example expressed filter finite fixed constraints foregoing formula Fourier series frequency domain frequency modulation G₁(t gaussian noise given Hilbert transform Hz(y independent information theory input intersymbol influence language transmission capacity large number linear liniva maximum entropy mean-square modulation number of different number of possible occur output signal physically realizable power spectrum prediction probability constraints probability distribution pulse quadratic content random noise rate of transmission ratio received signal sample points sampling theorem shown signal-to-noise ratio superimposed superposition Suppose T₁ tion transducer transform transmission of information transmitted signal typical function variables zero ηπ πη Σπη ΣΡ
References to this book
Mathematical Foundations of Information Theory Aleksandr I?Akovlevich Khinchin No preview available - 1957 |