Heuristic anytime approaches to stochastic decision processes

Author： Fernández Joaquín   Sanz Rafael   Simmons Reid   Diéguez Amador  

Publisher： Springer Publishing Company

ISSN： 1381-1231

Source： Journal of Heuristics, Vol.12, Iss.3, 2006-05, pp. : 181-209

Disclaimer: Any content in publications that violate the sovereignty, the constitution or regulations of the PRC is not accepted or approved by CNPIEC.

Previous Menu Next

Abstract

This paper proposes a set of methods for solving stochastic decision problems modeled as partially observable Markov decision processes (POMDPs). This approach (Real Time Heuristic Decision System, RT-HDS) is based on the use of prediction methods combined with several existing heuristic decision algorithms. The prediction process is one of tree creation. The value function for the last step uses some of the classic heuristic decision methods. To illustrate how this approach works, comparative results of different algorithms with a variety of simple and complex benchmark problems are reported. The algorithm has also been tested in a mobile robot supervision architecture.

Related content

An Interior Point Heuristic for the Hamiltonian Cycle Problem via Markov Decision Processes

By Ejov Vladimir   Filar Jerzy   Gondzio Jacek  

Journal of Global Optimization, Vol. 29, Iss. 3, 2004-07 ,pp. : 315-334 (20)

Springer Publishing Company

Access to resources Recommend Favorite

Financial scenario generation for stochastic multi-stage decision processes as facility location problems

By Hochreiter Ronald  

Annals of Operations Research, Vol. 152, Iss. 1, 2007-07 ,pp. : 257-272 (16)

Springer Publishing Company

Access to resources Recommend Favorite

A provably convergent heuristic for stochastic bicriteria integer programming

By Gutjahr Walter  

Journal of Heuristics, Vol. 15, Iss. 3, 2009-06 ,pp. : 227-258 (32)

Springer Publishing Company

Access to resources Recommend Favorite

Heuristic algorithms for job-shop scheduling problemswith stochastic precedence constraints

By Neumann K.   Schneider W.G.  

Annals of Operations Research, Vol. 92, Iss. 1, 1999-01 ,pp. : 45-63 (19)

Springer Publishing Company

Access to resources Recommend Favorite

Heuristic procedures for parallel-machine schedulingproblems with stochastic precedence constraints

By Neumann K.   Zimmermann J.  

Annals of Operations Research, Vol. 83, Iss. 1, 1998-01 ,pp. : 115-136 (22)

Springer Publishing Company

Access to resources Recommend Favorite