Simulation-based optimization of Markov reward processes

Peter Marbach, John Tsitsiklis

Proceedings of the 37th IEEE Conference on Decision and Control, , December 1998

 

Abstract

We propose a simulation-based algorithm for optimizing the average reward in a Markov reward process that depends on a set of parameters. As a special case, the method applies to Markov decision processes where optimization takes place within a parametrized set of policies. The algorithm involves the simulation of a single sample path, and can be implemented online. A convergence result (with probability 1) is provided

 

Bibtex

Bib