Separate the complicated from the complex
Instructor: Simon DeDeo
Sometimes the best description of a system is one that acknowledges our ignorance. Maximum entropy methods provide a coherent framework for doing this in a rigorous fashion, and their success has been felt in everything from physics to ecology to machine learning.
In this tutorial, Simon DeDeo introduces MaxEnt through a series of examples, taking students from the basics of the subject up to its applications in science and engineering. Basic comfort with the use of probabilities, and familiarity with exponentials and logarithms, is required. By the end of the course, students will have a tool for modeling complex systems, and a new set of concepts for thinking about what models are meant to do in the first place.
This tutorial is designed for more advanced math students. Math prerequisites for this course are an understanding of calculus, partial derivatives, shannon entropy; basic probability.