Markov Decision Process (MDP)

Markov decision process

A Markov decision process (MDP) is a mathematical framework for modeling decision making in situations where outcomes are partly random and partly under the control of a decision maker. It involves choosing actions in different states, which result in rewards and transitions to new states. MDPs are an extension of Markov chains, but with the addition of actions and rewards.

7 courses cover this concept

AA 174B / AA 274B / CS 237B / EE 260B Principles of Robot Autonomy II

Stanford University

Winter 2023

This course provides a deeper understanding of robot autonomy principles, focusing on learning new skills and physical interaction with the environment and humans. It requires familiarity with programming, ROS, and basic robot autonomy techniques.

No concepts data

+ 13 more concepts

COS 324: Introduction to Machine Learning

Princeton University

Spring 2019

This introductory course focuses on machine learning, probabilistic reasoning, and decision-making in uncertain environments. A blend of theory and practice, the course aims to answer how systems can learn from experience and manage real-world uncertainties.

No concepts data

+ 21 more concepts

CS 221 Artificial Intelligence: Principles and Techniques

Stanford University

Autumn 2022-2023

Stanford's CS 221 course teaches foundational principles and practical implementation of AI systems. It covers machine learning, game playing, constraint satisfaction, graphical models, and logic. A rigorous course requiring solid foundational skills in programming, math, and probability.

No concepts data

+ 88 more concepts

CS 188 Introduction to Artificial Intelligence

UC Berkeley

Fall 2022

UC Berkeley's CS 188 course covers the basic ideas and techniques for designing intelligent computer systems, emphasizing statistical and decision-theoretic modeling. By the course's end, students will have built autonomous agents that can make efficient decisions in a variety of settings.

No concepts data

+ 20 more concepts

CS 294-40: Learning for robotics and control

UC Berkeley

Fall 2008

This advanced course focuses on the applications of machine learning in the robotics and control field. It covers a wide range of topics including Markov Decision Processes, control theories, estimation methodologies, and robotics principles. Recommended for graduate students.

No concepts data

+ 27 more concepts

10-401 Introduction to Machine Learning

Carnegie Mellon University

Spring 2018

A comprehensive exploration of machine learning theories and practical algorithms. Covers a broad spectrum of topics like decision tree learning, neural networks, statistical learning, and reinforcement learning. Encourages hands-on learning via programming assignments.

No concepts data

+ 55 more concepts

15-381 Artificial Intelligence

Carnegie Mellon University

Spring 2019

This course from Carnegie Mellon University provides a deep understanding of AI's theory and practice, covering methods for decision-making, problem-solving, and handling uncertainty. Topics include search algorithms, computational game theory, and AI ethics.

No concepts data

+ 24 more concepts