A dynamic programming approach for finite Markov processes and algorithms for the calculation of the limit matrix in Markov chains

Author： Pickl Stefan

Publisher： Taylor & Francis Ltd

ISSN： 0233-1934

Source： Optimization, Vol.60, Iss.10-11, 2011-10, pp. : 1339-1358

Disclaimer: Any content in publications that violate the sovereignty, the constitution or regulations of the PRC is not accepted or approved by CNPIEC.

Previous Menu Next

Abstract

Related content

On a result for finite Markov chains

By Kulathinal Sangita

International Journal of Mathematical Education in Science and Technology, Vol. 37, Iss. 4, 2006-06 ,pp. : 498-502

Taylor & Francis Ltd

Access to resources Recommend Favorite

Limit Theorems for General Markov Chains

By Korshunov D.A.

Siberian Mathematical Journal, Vol. 42, Iss. 2, 2001-03 ,pp. : 301-316

Springer Publishing Company

Access to resources Recommend Favorite

A characterization of exponential functionals in finite Markov chains

By Cavazos–Cadena Rolando

Mathematical Methods of Operations Research, Vol. 60, Iss. 3, 2004-12 ,pp. : 399-414

Springer Publishing Company

Access to resources Recommend Favorite

Numerical Approach for Assessing System Dynamic Availability Via Continuous Time Homogeneous Semi-Markov Processes

By Moura Márcio

Methodology And Computing In Applied Probability, Vol. 12, Iss. 3, 2010-09 ,pp. : 431-449

Springer Publishing Company

Access to resources Recommend Favorite

On the convergence of nonlinear Markov chains

By Butkovsky O.

Doklady Mathematics, Vol. 86, Iss. 3, 2012-11 ,pp. : 824-826

MAIK Nauka/Interperiodica

Access to resources Recommend Favorite