Machine learning

Information theory in machine learning

Learning from information; information about learning.

Synergy and information in complex neural systems

An ambitious research programme using complexity science to link brains and machines.

Learning, compression, and leakage: Minimizing classification error via meta-universal compression principles

Connections between information theory, supervised learning, and privacy

The partial information decomposition of generative neural network models

Tracking the information decomposition of neural networks as they learn.