Computer Science
>
>

CS 221 Artificial Intelligence: Principles and Techniques

Autumn 2022-2023

Stanford University

Stanford's CS 221 course teaches foundational principles and practical implementation of AI systems. It covers machine learning, game playing, constraint satisfaction, graphical models, and logic. A rigorous course requiring solid foundational skills in programming, math, and probability.

Course Page

Overview

The goal of artificial intelligence (AI) is to tackle complex real-world problems with rigorous mathematical tools. In this course, you will learn the foundational principles and practice implementing various AI systems. Specific topics include machine learning, search, Markov decision processes, game playing, constraint satisfaction, graphical models, and logic.

Prerequisites

This course is fast-paced and covers a lot of ground, so it is important that you have a solid foundation in a number of areas. Here are the basic skills that you need and the classes that teach those skills:

It is less important that you know particular things (e.g., we don't use eigenvectors in this course even though that's a pillar of any linear algebra course), and more important that you've done enough related things that you feel at ease with it. While it is possible to fill in the gaps, this course does move quickly, and ideally you want to be focusing your energy on learning AI rather than catching up on prerequisites. We have made a few prerequisite modules that you can review to refresh your memory, and the first homework (foundations) will allow you to also get some practice on these basics.

Learning objectives

No data.

Textbooks and other notes

Further Reading

There are no required textbooks for this class, and you should be able to learn everything from the lecture notes and homeworks. However, if you would like to pursue more advanced topics or get another perspective on the same material, here are some great resources:

Note that some of these books use different notation and terminology from this course, so it may take some effort to make the appropriate connections.

Other courses in Artificial Intelligence

Courseware availability

Lecture slides available at Modules

Videos partially available on YouTube at Modules

Videos from 2019 offering available on YouTube

Homeworks available at Coursework

No other materials available

Covered concepts

AC-3 algorithmAlpha-beta pruningBackpropagationBacktracking searchBayesian networkBig-O notationBreadth-first search (BFS)CompletenessComputation graphsComputational complexityConditional distributionContinuous optimizationContradictionCross-validation (statistics)Deep Reinforcement LearningDeep learning models compositionDepth-first search (DFS)Design and organization of featuresDice gameDiscounting factorDiscrete random variablesDot productDynamic programmingEntailmentEpsilon-greedy explorationEquitable performanceExhaustive searchFactor graphsFirst-order logicFunction approximationGame theoryGeneralizationGeometric interpretationsGibbs samplingGradient descentHalving gameHidden Markov Model (HMM)Hinge lossHistories of AIHorn clausesK-means clusteringLaplace smoothingLinear classificationLinear regressionLogicLoss minimizationMachine learningMarginal distributionsMarkov Decision Process (MDP)Markov random fieldMaximum Likelihood Estimation (MLE)MeanMinimax algorithmModel checkingModel-based Monte CarloModel-free Monte CarloModus ponensNash equilibriumNeural networkNon-linear functionsObjective functionsPolicy evaluationProbability distributionsPropositional calculus (Propositional logic)PythonQ-learningRecurrence relationReinforcement learning (RL)Relaxed search problemsSatisfiabilitySearch problemSkolem functionsSocietal impacts of AISoundnessState–action–reward–state–action (SARSA)Stochastic gradient descent (SGD)Substitution (logic)Taking gradientsTemporal difference (TD) learningTransportation problemUCS correctnessUCS heuristicsUnification (computer science)Uniform cost search (UCS)Value iterationVariable-based modelsVarianceVector (mathematics and physics)