A mini-introduction to information theory
A mini-introduction to information theory
E. Witten
2018 · DOI: 10.1007/s40766-020-00004-5
163 Citations
TLDR
Basic properties of the classical Shannon entropy and the quantum von Neumann entropy are described, along with related concepts such as classical and quantum relative entropy, conditional entropy, and mutual information.
Abstract
This article consists of a very short introduction to classical and quantum information theory. Basic properties of the classical Shannon entropy and the quantum von Neumann entropy are described, along with related concepts such as classical and quantum relative entropy, conditional entropy, and mutual information. A few more detailed topics are considered in the quantum case.