Behind the familiar surfaces of the telephone, radio, and television lies a sophisticated and intriguing body of knowledge known as information theory. This is the theory that has permeated the rapid development of all sorts of communication, from color television to the clear transmission of photographs from the vicinity of Jupiter. Even more revolutionary progress is expected in the future. To give a solid introduction to this burgeoning field, J. R. Pierce has revised his well-received 1961 study of information theory for an up-to-date second edition. Beginning with the origins of the field, Dr. Pierce follows the brilliant formulations of Claude Shannon and describes such aspects of the subject as encoding and binary digits, entropy. language and meaning, efficient encoding , and the noisy channel. He then goes beyond the strict confines of the topic to explore the ways in which information theory relates to physics, cybernetics, psychology, and art. Mathematical formulas are introduced at the appropriate points for the benefit of serious students. A glossary of terms and an appendix on mathematical notation are provided to help the less mathematically sophisticated. J. R. Pierce worked for many years at the Bell Telephone Laboratories, where he became Director of Research in Communications Principles. He is currently affiliated with the engineering department of the California Institute of Technology. While his background is impeccable, Dr. Pierce also possesses an engaging writing style that makes his book all the more welcome. An Introduction to Information Theory continues to be the most impressive non-technical account available and a fascinating introduction to the subject for laymen. "An uncommonly good study. . . . Pierce's volume presents the most satisfying discussion to be found."? Scientific American.

Originally developed by Claude Shannon in the 1940s, information theory laid the foundations for the digital revolution, and is now an essential tool in telecommunications, genetics, linguistics, brain sciences, and deep space communication. In this richly illustrated book, accessible examples are used to introduce information theory in terms of everyday games like ‘20 questions’ before more advanced topics are explored. Online MatLab and Python computer programs provide hands-on experience of information theory in action, and PowerPoint slides give support for teaching. Written in an informal style, with a comprehensive glossary and tutorial appendices, this text is an ideal primer for novices who wish to learn the essential principles and applications of information theory.

Scientific knowledge grows at a phenomenal pace--but few books have had as lasting an impact or played as important a role in our modern world as The Mathematical Theory of Communication, published originally as a paper on communication theory more than fifty years ago. Republished in book form shortly thereafter, it has since gone through four hardcover and sixteen paperback printings. It is a revolutionary work, astounding in its foresight and contemporaneity. The University of Illinois Press is pleased and honored to issue this commemorative reprinting of a classic.

Random signals and noise are present in many engineering systems and networks. Signal processing techniques allow engineers to distinguish between useful signals in audio, video or communication equipment, and interference, which disturbs the desired signal. With a strong mathematical grounding, this text provides a clear introduction to the fundamentals of stochastic processes and their practical applications to random signals and noise. With worked examples, problems, and detailed appendices, Introduction to Random Signals and Noise gives the reader the knowledge to design optimum systems for effectively coping with unwanted signals. Key features: Considers a wide range of signals and noise, including analogue, discrete-time and bandpass signals in both time and frequency domains. Analyses the basics of digital signal detection using matched filtering, signal space representation and correlation receiver. Examines optimal filtering methods and their consequences. Presents a detailed discussion of the topic of Poisson processes and shot noise. An excellent resource for professional engineers developing communication systems, semiconductor devices, and audio and video equipment, this book is also ideal for senior undergraduate and graduate students in Electronic and Electrical Engineering.

This book contains a thorough treatment of phase noise, its relationship to thermal noise and associated subjects such as frequency stability. The design of low phase noise signal sources, including oscillators and synthesisers, is explained and in many cases the measured phase noise characteristics are compared with the theoretical predictions. Full theoretical treatments are combined with physical explanations, helpful comments, examples of manufactured equipment and practical tips. Overall system performance degradations due to unwanted phase noise are fully analysed for radar systems and for both analogue and digital communications systems. Specifications for the acceptable phase noise performance of signal sources to be used in such systems are derived after allowing for both technical and economic optimisation. The mature engineer whose mathematics may be somewhat rusty will find that every effort has been made to use the lowest level of mathematical sophistication that is compatible with a full analysis and every line of each mathematical argument has been set out so that the book may be read and understood even in an armchair. Due to a novel approach to the analytical treatment of narrow band noise, the book is simple to understand while simultaneously carrying the analysis further in several areas than any existing publication.

First comprehensive introduction to information theory explores the work of Shannon, McMillan, Feinstein, and Khinchin. Topics include the entropy concept in probability theory, fundamental theorems, and other subjects. 1957 edition.

Highly useful text studies logarithmic measures of information and their application to testing statistical hypotheses. Includes numerous worked examples and problems. References. Glossary. Appendix. 1968 2nd, revised edition.

Additive and multiplicative noise in the information signal can significantly limit the potential of complex signal processing systems, especially when those systems use signals with complex phase structure. During the last few years this problem has been the focus of much research, and its solution could lead to profound improvements in applications of complex signals and coherent signal processing. Signal Processing Noise sets forth a generalized approach to signal processing in multiplicative and additive noise that represents a remarkable advance in signal processing and detection theory. This approach extends the boundaries of the noise immunity set by classical and modern signal processing theories, and systems constructed on this basis achieve better detection performance than that of systems currently in use. Featuring the results of the author's own research, the book is filled with examples and applications, and each chapter contains an analysis of recent observations obtained by computer modelling and experiments. Tables and illustrations clearly show the superiority of the generalized approach over both classical and modern approaches to signal processing noise. Addressing a fundamental problem in complex signal processing systems, this book offers not only theoretical development, but practical recommendations for raising noise immunity in a wide range of applications.