Information theory and statistics


 * Method of Types
 * Sanov's Theorem


 * Large Deviations Theory


 * Hypothesis Testing
 * Decentralized Detection
 * Likelihood Ratio Test
 * Neyman-Pearson Lemma


 * Conditional Limit Theorem


 * Applications in probability
 * Concentration of measure (tensorization of the entropy)


 * Connections to Machine Learning