The mathematical theory of communication 
What people are saying  Write a review
User ratings
5 stars 
 
4 stars 
 
3 stars 
 
2 stars 
 
1 star 

Review: The Mathematical Theory of Communication
User Review  Luke  GoodreadsClassic. Read full review
Review: The Mathematical Theory of Communication
User Review  David  GoodreadsShannon's original 1948 paper on information theory. A relevant read, even today. Read full review
Related books
An Introduction to Information Theory: Symbols, Signals & Noise John Robinson Pierce Limited preview  1980 
Common terms and phrases
approximation arbitrarily small average power band binary digits binary number bits per second calculated channel capacity chosen coding communication system communication theory conditional entropy conditional probability consider constraints continuous corresponding defined definition digram dimensional discrete channel distribution duration encoding English ensemble of functions entropy power equal equivocation ergodic example fidelity finite number frequency of errors Gaussian Gaussian distribution given graph Hence high probability Hy(x Hy{x independent information source joint entropy letter frequencies letters limited logarithm Markoff process mathematical maximizing maximum entropy meaning measure noise power noiseless number of possible number of symbols obtain output p(xi perturbed pi log pi prob probability measure problem produced random rate of transmission received signal redundancy relative entropy samples semantic Shannon situation space statistical structure stochastic process subset Suppose telegraphy Theorem tion trans transducer transition probabilities transmitted signal uncertainty white noise white thermal noise words zero