POMDP Example Domains

Tony's POMDP File Repository Page

This page contains links to download various POMDP parameter files that have appeared in the literature. A description of the format of these files can be found on the POMDP File Format Page, with the corrresponding more formal POMDP File Grammar Page

Problems from the literature

ejs.tar.gz

Examples from Ed Sondik's 1971 thesis and OR papers

cheng-examples.tar.gz

Hsien-Te Cheng's 1988 thesis examples

tiger.aaai.POMDP

Cassandra, Littman and Kaelbling's AAAI-94 Tiger problem

1d.POMDP

Littman's 1D maze

4x3.95.POMDP

Russell and Norvig's 4x3 maze

cheese.95.POMDP

McCallum's cheese maze

shuttle.95.POMDP

Chrisman's shuttle docking problem

mini-hall2.POMDP

Navigation problem from Littman, Cassandra and Kaelbling's ML-95 paper

hallway.POMDP.gz

Navigation problem from Littman, Cassandra and Kaelbling's ML-95 paper

hallway2.POMDP.gz

Navigation problem from Littman, Cassandra and Kaelbling's ML-95 paper

tiger-grid.POMDP.gz

Navigation problem from Littman, Cassandra and Kaelbling's ML-95 paper

parr95.95.POMDP

This example is from Parr and Russell's paper on the SPOVA RL algorithm from IJCAI'95.

paint.95.POMDP

Part painting problem inspired by the Buridan planner paper example

4x4.95.POMDP

Cassandra, Littman and Kaelibling's AAAI-94 4x4 grid

network.POMDP

Littman's network problem

bridge-repair.POMDP.gz

A bridge inspection and repair problem of Hugh Ellis, et al.

cit.POMDP.gz

Hallway navigation problem from Cassandra, Kurien and Kaelbling's IROS-96 paper

mit.POMDP.gz

Hallway navigation problems from Cassandra, Kurien and Kaelbling's IROS-96 paper

sunysb.POMDP.gz

Hallway navigation problem from Cassandra, Kurien and Kaelbling's IROS-96 paper

pentagon.POMDP.gz

Hallway navigation problem from Cassandra, Kurien and Kaelbling's IROS-96 paper

fourth.POMDP.gz

Hallway navigation problem from Cassandra, Kurien and Kaelbling's IROS-96 paper

milos-aaai97.POMDP.gz

20 state maze from Milos Hauskrecht's AAAI-97 paper.

Other Problems

1d.noisy.POMDP

Noisy transition version of Littman's 1D maze

concert.POMDP

Michael Littman's concert problem

tiger.95.POMDP

Version of AAAI-94 Tiger problem with 0.95 discount factor (instead of 0.75)

stand-tiger.95.POMDP

Slight extension of the tiger problem

line4-2goals.POMDP

A line of uniquely appearing states with a goal at both ends

4x5x2.95.POMDP.gz

A 2 floor 4x5 navigation problem

bulkhead.A.POMDP.gz

Non-destructive testing problem of a titanium aircraft engine bulkhead

marking.POMDP

One of two versions of a problem proposed by Tom Dean about a robot that can mark its environment.

marking2.POMDP

One of two versions of a problem proposed by Tom Dean about a robot that can mark its environment.

mcc-example1.POMDP

Variations of an example of choosing advertisements for web pages based on user actions (made for MCC job talk)

mcc-example2.POMDP

Variations of an example of choosing advertisements for web pages based on user actions (made for MCC job talk)

web-ad.POMDP

Variations of an example of choosing advertisements for web pages based on user actions (made for MCC job talk)

web-mall-example1.POMDP

Variations of an example of choosing advertisements for web pages based on user actions (made for MCC job talk)

saci-s12-a6-z5.95.POMDP.gz

Aircraft identification problem with 12 states, 6 actions and 5 observations

saci-s100-a10-z31.POMDP.gz

Aircraft identification problem with 100 states, 10 actions and 31 observations

query.s2.POMDP.gz

Problems for distributed querying decisions with 2 resources

query.s3.POMDP.gz

Problems for distributed querying decisions with 3 4 resources

query.s4.POMDP.gz

Problems for distributed querying decisions with 4 resources

learning.c2.POMDP.gz

Problem of teaching policies for trying to learn 2 concepts

learning.c3.POMDP.gz

Problem of teaching policies for trying to learn 3 concepts

learning.c4.POMDP.gz

Problem of teaching policies for trying to learn 4 concepts