Partially Observable Markov Decision Processes

Tutorial | Papers | Talks | Code | Repository
POMDP Home | Papers | Repository | Code

POMDPs for Dummies

Subtitled: POMDPs and their algorithms, sans formula!

This is a tutorial aimed at trying to build up the intuition behind solution procedures for partially observable Markov decision processes (POMDPs). It sacrifices completeness for clarity. It tries to present the main problems geometrically, rather than with a series of formulas. In fact, we avoid the actual formulas altogether, try to keep notation to a minimum and rely on pictures to build up the intuition.

We try to keep the required background to a minimum and provide some brief mini-tutorials on the required background material. Select one of these below

Here is a complete index of all the pages in this tutorial.

Last modified: Sun Jul 26 14:25:16 MDT 2009