UPDF AI

Show me What you want: Inverse Reinforcement Learning to Automatically Design Robot Swarms by Demonstration

Ilyes Gharbi,Jonas Kuckling,D. G. Ramos,M. Birattari

2023 · DOI: 10.1109/ICRA48891.2023.10160947
IEEE International Conference on Robotics and Automation · 9 Citations

TLDR

Demo-Cho is developed, an automatic design method that combines inverse reinforcement learning with automatic modular design of control software for robot swarms that successfully generated control software to perform four missions.

Abstract

Automatic design is a promising approach to generating control software for robot swarms. So far, automatic design has relied on mission-specific objective functions to specify the desired collective behavior. In this paper, we explore the possibility to specify the desired collective behavior via demonstrations. We develop Demo-Cho, an automatic design method that combines inverse reinforcement learning with automatic modular design of control software for robot swarms. We show that, only on the basis of demonstrations and without the need to be provided with an explicit objective function, Demo-Cho successfully generated control software to perform four missions. We present results obtained in simulation and with physical robots.