X
X
X

X
Courses » Reinforcement Learning

Reinforcement Learning

ABOUT THE COURSE

Reinforcement learning is a paradigm that aims to model the trial-and-error learning process that is needed in many problem situations where explicit instructive signals are not available. It has roots in operations research, behavioral psychology and AI. The goal of the course is to introduce the basic mathematical foundations of reinforcement learning, as well as highlight some of the recent directions of research.


INTENDED AUDIENCE

All

INDUSTRY SUPPORT – LIST OF COMPANIES/INDUSTRY THAT WILL RECOGNIZE/VALUE THIS ONLINE COURSE

Data analytics/data science/robotics

1634 students have enrolled already!!

COURSE INSTRUCTOR



Prof. Ravindran is currently an associate professor in Computer Science at IIT Madras. He has nearly two decades of research experience in machine learning and specifically reinforcement learning. Currently his research interests are centered on learning from and through interactions and span the areas of data mining, social network analysis, and reinforcement learning.

MORE DETAILS ABOUT THE COURSE

Course url: https://onlinecourses.nptel.ac.in/noc18_cs27
Course duration : 12 weeks
Date and Time of Exams: April 28 (Saturday) and April 29 (Sunday) : Morning session 9am to 12 noon; Afternoon session: 2pm to 5pm
Exam for this course will be available in one session on both 28 and 29 April. The exact session it will be available in (FN/AN) - we shall inform by first week of January 2018.
Registration url: Will be announced shortly


COURSE LAYOUT

Week 1    Introduction
Week 2    Bandit algorithms – UCB, PAC
Week 3    Bandit algorithms –Median Elimination, Policy Gradient
Week 4    Full RL & MDPs
Week 5    Bellman Optimality
Week 6    Dynamic Programming & TD Methods
Week 7    Eligibility Traces
Week 8    Function Approximation
Week 9    Least Squares Methods
Week 10  Fitted Q, DQN & Policy Gradient for Full RL
Week 11  Hierarchical RL
Week 12  POMDPs

REFERENCE BOOKS

R. S. Sutton and A. G. Barto. Reinforcement Learning - An Introduction. MIT Press. 1998.

CERTIFICATION EXAM
  • The exam is optional for a fee.
  • Date and Time of Exams: April 28 (Saturday) and April 29 (Sunday) : Morning session 9am to 12 noon; 
  • Exam for this course will be available in one session on both 28 and 29 April. 
  • Registration url: Announcements will be made when the registration form is open for registrations.
  • The online registration form has to be filled and the certification exam fee needs to be paid. More details will be made available when the exam registration form is published.

CERTIFICATE
  • Final score will be calculated as : 25% assignment score + 75% final exam score
  • 25% assignment score is calculated as 25% of average of Best 8 out of 12 assignments
  • E-Certificate will be given to those who register and write the exam and score greater than or equal to 40% final score. Certificate will have your name, photograph and the score in the final exam with the breakup. It will have the logos of NPTEL and IIT MADRAS. It will be e-verifiable at nptel.ac.in/noc.