information theory history and applications, information measures, entropy

​

entropy, convexity, submodularity, divergence

​

differential entropy, conditional divergence, mutual information

​

mutual information, conditional mutual information, geometric interpretation of mutual information

​

variational characterization of divergence, sufficient statistics

​

statistical decision theory: basics

​

risk functions

​

tensor product of experiments, sample complexity

​

sample complexity, f-divergence, hypothesis testing, connection between f-divergences

​

connection between f-divergences, variational form of f-divergence

​

f-divergence, parameter estimation, HCR bound, CR lower bound, fisher information

​

Fisher information, multivariate HCR bound

​