Value-Based Planning for Teams of Agents in Stochastic Partially Observable Environments

Front Cover
Amsterdam University Press, 2010 - Business & Economics - 222 pages
Annotation. A key requirement of decision support systems is the ability to reason about uncertainty. This is a complex problem, especially when multiple decision makers are involved. For instance, consider a team of fire fighting agents whose goal is to extinguish a large fire in a residential area using only local observations. In this case, the environment is stochastic because the agents may be uncertain with respect to: 1) the effect of their actions, 2) the true state of the environment, and 3) the actions the other agents take. These uncertainties render the problem computationally intractable. In this thesis such decision-making problems are formalized using a stochastic discrete-time model called decentralized partially observable Markov decision process (Dec-POMDP). The first part of this thesis describes a value-based (i.e. based on value functions) approach for Dec-POMDPs, making use of Bayesian games. In the second part, different forms of structure in this approach are identified and exploited to realize better scaling behavior. This title can be previewed in Google Books -

What people are saying - Write a review

We haven't found any reviews in the usual places.

Common terms and phrases

About the author (2010)

Frans Oliehoek (1981) studied Computer Science at the University of Amsterdam. In 2005 he obtained his M.Sc. in Artificial Intelligence and started his Ph.D. within the Intelligent Autonomous Systems group. This thesis brings together a selection of his research.

Bibliographic information