Information theory in machine learning

Source: Dilokthanakul et al. (2016)

Statistical inference and information theory are intimately related. So much so, that we typically jump from one to the other without even noticing (or paying attention to) the differences between them.

In part of my work I exploit this connection in two ways: using information theory to design better machine learning algorithms; and studying machine learning systems from the lens of information theory.

Pedro Mediano
Pedro Mediano
Coffee-powered beast-machine

Computational neuroscientist interested in synergy, information theory, and complexity.

Related