Rolling horizon procedures in Semi-Markov Games: The Discounted Case

We study the properties of the rolling horizon and the approximate rolling horizon procedures for the case of two-person zero-sum discounted semi-Markov games with infi nite horizon, under several assumptions on the reward function, when the state space is a borelian set and the action spaces are considered compact. Under suitable conditions, we prove that the equilibrium is the unique solution of its dynamic programming equation, and we prove bounds which imply the convergence of the procedures when the horizon length tends to in finity. The approach is based on the formalism for Semi-Markov games developed by Luque-Vásquez, together with extensions of the results of Hernández-Lerma and Lasserre for Markov Decision Processes and Chang and Marcus for Markov Games, both in discrete time. In this way we generalize the results on the rolling horizon and approximate rolling horizon procedures previously obtained for discrete-time problems.

Data and Resources

Additional Info

Field Value
Source https://inria.hal.science/hal-00720351
Author Della Vecchia, Eugenio, Di Marco, Silvia C., Jean-Marie, Alain
Maintainer CCSD
Last Updated May 5, 2026, 10:30 (UTC)
Created May 5, 2026, 10:30 (UTC)
Identifier Report N°: RR-8019
Language en
Rights https://about.hal.science/hal-authorisation-v1/
contributor Facultad de Ciencias Exactas, Ingenieria y Agrimensura [Rosario] (FCEIA) ; Universidad Nacional de Rosario [Santa Fe]
creator Della Vecchia, Eugenio
date 2012-07-24T00:00:00
harvest_object_id 7e56c198-60e4-4637-8561-78a00c3026ee
harvest_source_id 3374d638-d20b-4672-ba96-a23232d55657
harvest_source_title test moissonnage SELUNE
metadata_modified 2025-08-26T00:00:00
set_spec type:REPORT