CS234: Reinforcement Learning, Stanford

Reinforcement Learning (Agent and environment). image source: Unity's blog on Unity Machine Learning Agents Toolkit

This repo contains homework, exams and slides I collected from internet without solutions. This repo is only for students / developers who are interested in this topic. If this repo conflicts your right, please do not hesitate to contact me. I promise I will delete this (both repo and history) ASAP.

Course Description

To realize the dreams and impact of AI requires autonomous systems that learn to make good decisions. Reinforcement learning is one powerful paradigm for doing so, and it is relevant to an enormous range of tasks, including robotics, game playing, consumer modeling and healthcare. This class will provide a solid introduction to the field of reinforcement learning and students will learn about the core challenges and approaches, including generalization and exploration. Through a combination of lectures, and written and coding assignments, students will become well versed in key ideas and techniques for RL. Assignments will include the basics of reinforcement learning as well as deep reinforcement learning — an extremely promising new area that combines deep learning techniques with reinforcement learning. In addition, students will advance their understanding and the field of RL through a final project.

Textbooks

There is no official textbook for the class but a number of the supporting readings will come from:

• Reinforcement Learning: An Introduction, Sutton and Barto, 2nd Edition. This is available for free here and references will refer to the final pdf version available here.

Some other additional references that may be useful are listed below:

• Reinforcement Learning: State-of-the-Art, Marco Wiering and Martijn van Otterlo, Eds. [link]
• Artificial Intelligence: A Modern Approach, Stuart J. Russell and Peter Norvig. [link]
• Deep Learning, Ian Goodfellow, Yoshua Bengio, and Aaron Courville. [link]
• David Silver's course on Reinforcement Learning. [link]

Course Materials

Lecture notes & slides could be found [here].