Adaptative transfer in reinforcement learning : application for simulation of game situations

A possible way to accelerate reinforcement learning process is to guide the exploration process using prior domain knowledge. This called knowledge transfer, and most transfer algorithms are based on an implicit assumption. They suppose that prior knowledge has a good quality for the current task. If this condition is not true, the learning process will be worse than standard reinforcement learning algorithm (negative transfer). This thesis put forwards some transfer algorithms to avoid this problem, whose can adapts learning process to prior knowledge quality. More precisely, we introduce a parameter called transfer rate, which controls how much prior knowledge will be used. In addition, we propose to optimize the transfer rate in order to make the best use of this policy. Thus, the proposed algorithms provide some robustness, working for all prior knowledge quality level, which was not the case with previous approaches. These algorithms are evaluated in two different problems: a toy problem (the gridworld), and a real complex one (a coach assistant tool). The latter application offers a coach to seize tactical patterns with a graphical interface, and then allows agents to view players doing the same patterns. To meet within a reasonable time, the request of the coach. The reinforcement learning alone is not enough, and transfer our algorithms have been applied to this area with success

Data and Resources

Additional Info

Field Value
Source https://theses.hal.science/tel-00814207
Author Pamponet Machado, Aydano
Maintainer CCSD
Last Updated May 11, 2026, 11:13 (UTC)
Created May 11, 2026, 11:13 (UTC)
Identifier NNT: 2009PA066209
Language fr
Rights https://about.hal.science/hal-authorisation-v1/
contributor Systèmes Multi-Agents (SMA) ; Laboratoire d'Informatique de Paris 6 (LIP6) ; Université Pierre et Marie Curie - Paris 6 (UPMC)-Centre National de la Recherche Scientifique (CNRS)-Université Pierre et Marie Curie - Paris 6 (UPMC)-Centre National de la Recherche Scientifique (CNRS)
creator Pamponet Machado, Aydano
date 2009-06-24T00:00:00
harvest_object_id 409532ad-e16a-49db-8b85-a216fca36ed4
harvest_source_id 3374d638-d20b-4672-ba96-a23232d55657
harvest_source_title test moissonnage SELUNE
metadata_modified 2025-03-01T00:00:00
set_spec type:THESE