IU:Template
Revision as of 12:33, 17 November 2021 by R.sirgalina (talk | contribs)
Reinforcement Learning
- Course name: Reinforcement Learning
- Course number: R-01
Course Characteristics
Key concepts of the class
- Fundamentals of Reinforcement Learning
- Sample-based Learning Methods
- Prediction and Control with Function Approximation
What is the purpose of this course?
Harnessing the full potential of artificial intelligence requires adaptive learning systems. Reinforcement learning (RL) is one powerful paradigm for doing so, and it is relevant to an enormous range of tasks, including robotics, game playing, consumer modeling and healthcare.
Course objectives based on Bloom’s taxonomy
- What should a student remember at the end of the course?
By the end of the course, the students should be able to
- Markov Decision Processes
- Exploration vs. Exploitation
- Value Functions
- Temporal-difference Learning
- Q-learning
- Expected Sarsa
- Actor-Critic
- What should a student be able to understand at the end of the course?
By the end of the course, the students should be able to
- How to build an RL system for sequential decision making
- How to formalize a task as an RL problem
- the space of RL algorithms
- What should a student be able to apply at the end of the course?
By the end of the course, the students should be able to
- RL for solving real-world problems
- TD-algorithms for estimating value functions
- Expected Sarsa and Q-Learning
- Actor-Critic Method
Course evaluation
| Type | Points |
|---|---|
| Labs/seminar classes | 20 |
| Interim performance assessment | 50 |
| Exams | 30 |
Grades range
| Grade | Points |
|---|---|
| A. Excellent | [85, 100] |
| B. Good | [70, 84] |
| C. Satisfactory | [55, 69] |
| D. Poor | [0, 54] |
Resources and reference material
- Reinforcement Learning: An Introduction, Sutton and Barto, 2nd Edition.
- Reinforcement Learning: State-of-the-Art, Marco Wiering and Martijn van Otterlo, Eds
Course Sections
The main sections of the course and approximate hour distribution between them is as follows:
| Section | Section Title | Teaching Hours |
|---|---|---|
| 1 | Fundamentals of RL | … |
| 2 | Sample based Learning | |
| 3 | Prediction and Control with Function Approximation |