Design of a turret stabilization system using reinforcement learning with external disturbance compensation
Dolya A. Kolumbetov B. Tulembayev A. Buldeshov A. Saltanat N.
11 June 2025Research and Development Academy
Sustainable Engineering and Innovation
2025#7Issue 2619 - 630 pp.
Reinforcement Learning (RL), in particular, Proximal Policy Optimization (PPO), and Twin Delayed Deep Deterministic Policy Gradient (TD3), to stabilize a weapon turret system with a set of external disturbances was considered in this study. Compared to traditional control algorithms such as proportional-integral-derivative (PID) controllers, they have their limits in dynamic settings because of manual tuning and a lack of a durable response to disturbances. This research will compare RL-based controllers and PID in a simulated scenario in which the turret will experience disturbances related to recoil, vibrations, and angular oscillations. A kinematic model of the turret was designed, and Lagrangian mechanics were used to model the disturbances of the turret. The run was done in PyBullet alongside the evaluation of the performance via mean absolute error (MAE) and root mean square error (RMSE). These findings show that RL controllers, particularly PPO and TD3, performed better than the PID one in terms of faster stabilization, reduced errors, and compensation of disturbances. RL agents simulated independently to different patterns of disturbances in a noisy and dynamic environment, and performed better than conventional systems. The results prove that RL-based control systems can be used in real-world applications, especially where accuracy is necessary.
Disturbance compensation , Proximal policy optimization , Reinforcement learning , Turret stabilization , Twin delayed deep deterministic policy
Text of the article Перейти на текст статьи
Research & Development Center Kazakhstan Engineering LLP, Astana, Kazakhstan
SP Kaztechnology, Astana, Kazakhstan
Research & Development Center Kazakhstan Engineering LLP
SP Kaztechnology
10 лет помогаем публиковать статьи Международный издатель
Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026