UPDF AI

Data Driven UAV Racing with Deep Reinforcemnet learning

Shaik Mohammad Ansari,Dhulipalla pujaveni,Muddineni Kumar,N. Kumar

2026 · DOI: 10.36948/ijfmr.2026.v08i01.66805
International Journal For Multidisciplinary Research · 0 Citations

TLDR

Deep reinforcement learning provides a scalable and flexible framework for autonomous drone racing, advancing the development of intelligent, high-speed aerial robots and contributing valuable insights applicable to broader domains such as autonomous navigation, search and rescue, and agile robotic systems.

Abstract

Autonomous drone racing has emerged as a challenging benchmark for high-speed robotic perception, decision-making, and control, requiring systems to operate at the limits of agility and safety in complex, dynamic environments. This work presents an abstract overview of autonomous drone racing using deep reinforcement learning (DRL), where an agent learns end-to-end control policies that map raw sensory inputs directly to flight commands through trial-and-error interactions with the environment. Unlike traditional model-based or trajectory

optimization approaches that rely on accurate system models and prior knowledge of the racing track, DRL enables drones to learn adaptive strategies that generalize across varying track layouts, gate configurations, and environmental conditions. By formulating drone racing as a sequential decision-making problem, the learning agent is trained to maximize a reward function that balances speed, stability, collision avoidance, and successful gate traversal.

Advanced DRL algorithms such as Deep Q-Networks, Proximal Policy Optimization, and Soft Actor-Critic are commonly employed to handle continuous control, high-dimensional state spaces, and stochastic dynamics. Training is typically conducted in high-fidelity simulation environments that incorporate realistic aerodynamics, sensor noise, and delays, followed by sim-to-real transfer techniques to deploy learned policies on physical drones. The use of domain randomization, curriculum learning, and imitation learning from expert demonstrations further improves training efficiency and robustness. Experimental results reported in recent studies demonstrate that DRL-based autonomous drones can achieve competitive lap times, smooth trajectories, and resilient performance under disturbances, often rivaling or surpassing traditional planning-based methods. Overall, deep reinforcement learning provides a scalable and flexible framework for autonomous drone racing, advancing the development of intelligent, high-speed aerial robots and contributing valuable insights applicable to broader domains such as autonomous navigation, search and rescue, and agile robotic