Information Theory

Here you can find lists of great Information Theory books are or have been used to teach courses at Stanford.





Elements of Information Theory 2nd Edition

By: Thomas M. Cover, Joy A. Thomas

2006

Source Coding Theory

By: Robert M. Gray

1989

Information Theory, Inference and Learning Algorithms

By: David J. C. MacKay

2003

Network Information Theory

By: Abbas El Gamal, Young-Han Kim

2012

Universal Compression and Retrieval

By: R. Krichevsky

1994

Mathematics of Information and Coding

By: Te Sun Han and Kingo Kobayashi

2007

Information Theory

By: Imre Csiszár

2016

Entropy and Information Theory

By: Robert M. Gray

2011

Prediction, Learning, and Games

By: Nicolo Cesa-Bianchi, Gabor Lugosi

2006

High-Dimensional Statistics: A Non-Asymptotic Viewpoint

By: Martin J. Wainwright

2019

Introduction to Nonparametric Estimation

By: Alexandre B. Tsybakov

2008

Concentration Inequalities

By: Stephane Boucheron, Gabor Lugosi, Pascal Massart

2016