Measuring information. Entropy, mutual information and their meaning. Probabilistic source models and the source coding theorem. Data compression. Noisy channels and the channel coding theorem. Error correcting codes and their decoding. Applications to inference, learning, data structures and communication complexity.