For the first part of the meetup, we will be following David Silver's UCL course on RL. Links to the videos and slides of this course are given in the schedule. This course gives a good overview of reinforcement learning (RL), where Silver gives many examples of applications to games. Throught the videos we will see that RL is not limited to games but a wide array of problems where there is sequential decision making under uncertainty.
Following Silver's course, we will follow OpenAI's Spinning Up RL for an introduction to deep RL.
The reference text we will use is Sutton and Barto's Reinforcement Learning: An Introduction, which has a free PDF version.
There are a number of courses on RL with lecture videos available from. Each of the below courses also have good resources linked in their webpages.
- Stanford's CS234: Another intro to RL course. Winter 2019 course videos
- Berkeley's CS285: Introduction to Deep RL. Fall 2018 course videos
Meeting times 12PM Pacific Time. The schedule is subject to change based on user participation.
To sign up to lead a session, indicate your interest on the signup sheet.
| Date | Topic | Resources | Leader |
|---|---|---|---|
| 06/21/20 | Introduction to Reinforcement Learning | Video; Slides; Chapter 1 - Sutton; Meetup slides | Chase |
| 06/28/20 | Markov Decision Process | Video Slides Chapter 3 - Sutton | Harish |
| 07/12/20 | Planning by Dynamic Programming | Video Slides Chapter 4 - Sutton | Shubhangi |
| 07/19/20 | Model Free Prediction | Video Slides Chapter 6&7 - Sutton | Saeid A. |
| 07/26/20 | Model Free Control | Video Slides Chapter 6&7 - Sutton | Carlos |
| 08/02/20 | Value Function Approximation | Video Slides Chapter 9 - Sutton | Tyler |
| 08/09/20 | Policy Gradient Methods | Video Slides Chapter 13 - Sutton | Joe S. |
| 08/16/20 | Integrating Learning and Planning | Video Slides | |
| 08/23/20 | Exploration vs Exploitation | Video Slides | Adam |
| 09/06/20 | Hands on – Use Spinning Up | OpenAI's Spinning Up RL | |
| 09/13/20 | Hands on – Use Spinning Up | ||
| 09/20/20 | Hands on – Use Spinning Up | ||
| 09/27/20 | Hands on – Use Spinning Up | ||
| 10/04/20 | Hands on – Use Spinning Up | Kaushik P. | |
- Halite by Two Sigma Kaggle competition: Use RL to solve a resource management game.