Distributed Lazy Q-learning for Cooperative Mobile Robots - Aix-Marseille Université Access content directly
Journal Articles International Journal of Advanced Robotic Systems Year : 2004

Distributed Lazy Q-learning for Cooperative Mobile Robots

Claude Touzet


Compared to single robot learning, cooperative learning adds the challenge of a much larger search space (combined individual search spaces), awareness of other team members, and also the synthesis of the individual behaviors with respect to the task given to the group. Over the years, reinforcement learning has emerged as the main learning approach in autonomous robotics, and lazy learning has become the leading bias, allowing the reduction of the time required by an experiment to the time needed to test the learned behavior performance. These two approaches have been combined together in what is now called lazy Q-learning, a very efficient single robot learning paradigm. We propose a derivation of this learning to team of robots : the «pessimistic» algorithm able to compute for each team member a lower bound of the utility of executing an action in a given situation. We use the cooperative multi-robot observation of multiple moving targets (CMOMMT) application as an illustrative example, and study the efficiency of the Pessimistic Algorithm in its task of inducing learning of cooperation.
Fichier principal
Vignette du fichier
Distributed_lazy_Q.pdf (360.84 Ko) Télécharger le fichier
Origin : Publisher files allowed on an open archive

Dates and versions

hal-01337605 , version 1 (27-06-2016)



Claude Touzet. Distributed Lazy Q-learning for Cooperative Mobile Robots. International Journal of Advanced Robotic Systems, 2004, 1, pp.5-13. ⟨10.5772/5614⟩. ⟨hal-01337605⟩
65 View
100 Download



Gmail Facebook Twitter LinkedIn More