Elements of information theory /

The latest edition of this classic is updated with new systems and materials problems The second edition of this book maintains the tradition fundamental text book clear instructions, reflection. Readers are provided once again with an instructive mix of mathematics, physics, statistics and informat...

Full description

Bibliographic Details
Main Author: Cover, Thomas M. (autor)
Other Authors: Thomas, Joy A. (autor)
Format: Book
Language:English
Published: Hoboken: John Wiley y Sons, 2006.
Edition:Segunda edición
Subjects:
Table of Contents:
  • Preface to the Second Edition
  • Preface to the first edition
  • Acknowledgments for the second edition
  • Acknowledgments for the first edition
  • 1. Introduction and Preview
  • Entropy, relative entropy and mutual information
  • Entropy
  • Joint Entropy and Conditional Entropy
  • The relative entropy and mutual information
  • Relationship between entropy and mutual information
  • 3. Asymptotic Equipartition Property
  • 4. Entropy Rates of a Stochastic Process
  • 5. Data Compression
  • 6. Gambling and Data Comprenssion
  • 7. Channel Capacity
  • 8. Differential Entropy
  • 9. Gaussian Channel
  • 10. Rate Distortion Theory
  • 11. Information Theory and Statistics
  • 12. Maximum entropy
  • 13. Universal Source Coding
  • 14. Kolmogorov Complexity
  • 15. Network Information Theory
  • 16. Information Theory and Portfolio Theory
  • 17. Inequalities in Information Theory.