Study of the Possibility to Combine Deep Learning Neural Networks for Recognition of Unmanned Aerial Vehicles in Optoelectronic Surveillance Channels
Semenyuk V. Kurmashev I. Alyoshin D. Kurmasheva L. Serbin V. Cantelli-Forti A.
December 2024Multidisciplinary Digital Publishing Institute (MDPI)
Modelling
2024#5Issue 41773 - 1788 pp.
This article explores the challenges of integrating two deep learning neural networks, YOLOv5 and RT-DETR, to enhance the recognition of unmanned aerial vehicles (UAVs) within the optical-electronic channels of Sensor Fusion systems. The authors conducted an experimental study to test YOLOv5 and Faster RT-DETR in order to identify the average accuracy of UAV recognition. A dataset in the form of images of two classes of objects, UAVs, and birds, was prepared in advance. The total number of images, including augmentation, amounted to 6337. The authors implemented training, verification, and testing of the neural networks exploiting PyCharm 2024 IDE. Inference testing was conducted using six videos with UAV flights. On all test videos, RT-DETR-R50 was more accurate by an average of 18.7% in terms of average classification accuracy (Pc). In terms of operating speed, YOLOv5 was 3.4 ms more efficient. It has been established that the use of RT-DETR as the only module for UAV classification in optical-electronic detection channels is not effective due to the large volumes of calculations, which is due to the relatively large number of parameters. Based on the obtained results, an algorithm for combining two neural networks is proposed, which allows for increasing the accuracy of UAV and bird classification without significant losses in speed.
drones , inference , neural networks , sensor fusion , training , vision transformers
Text of the article Перейти на текст статьи
Power Engineering and Radioelectronics Department, M. Kozybayev North Kazakhstan University, Petropavl, 150000, Kazakhstan
Information and Communication Technologies Department, M. Kozybayev North Kazakhstan University, Petropavl, 150000, Kazakhstan
Natural Sciences, Head of Scientific Research Organization Department, M. Kozybayev North Kazakhstan University, Petropavl, 150000, Kazakhstan
Cyber Security, Information Processing and Storage Department, K.I. Satpayev Kazakh National Research Technical University, Petropavl, 150000, Kazakhstan
Radar and Surveillance Systems, National Laboratory, Pisa, 56124, Italy
Power Engineering and Radioelectronics Department
Information and Communication Technologies Department
Natural Sciences
Cyber Security
Radar and Surveillance Systems
10 лет помогаем публиковать статьи Международный издатель
Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026