Perfect information two-person zero-sum markov games with imprecise transition probabilities

Author: Chang Hyeong  

Publisher: Springer Publishing Company

ISSN: 1432-2994

Source: Mathematical Methods of Operations Research, Vol.64, Iss.2, 2006-10, pp. : 335-351

Disclaimer: Any content in publications that violate the sovereignty, the constitution or regulations of the PRC is not accepted or approved by CNPIEC.

Previous Menu Next

Abstract

Based on an extension of the controlled Markov set-chain model by Kurano et al. (in J Appl Prob 35:293–302, 1998) into competitive two-player game setting, we provide a model of perfect information two-person zero-sum Markov games with imprecise transition probabilities. We define an equilibrium value for the games formulated with the model in terms of a partial order and then establish the existence of an equilibrium policy pair that achieves the equilibrium value. We further analyze finite-approximation error bounds obtained from a value iteration-type algorithm and discuss some applications of the model.