ENHANCING SKELETON-BASED ACTION RECOGNITION WITH HYBRID REAL AND GAN-GENERATED DATASETS
Islamgozhayev T. Amirgaliyev B. Kozhirbayev Z.
2024Technology Center
Eastern-European Journal of Enterprise Technologies
2024#6Issue 2(132)14 - 22 pp.
This research addresses the critical challenge of recognizing mutual actions involving multiple individuals, an important task for applications such as video surveillance, human-computer interaction, autonomous systems, and behavioral analysis. Identifying these actions from 3D skeleton motion sequences poses significant challenges due to the necessity of accurately capturing intricate spatial and temporal patterns in diverse, dynamic, and often unpredictable environments. To tackle this, a robust neural network framework was developed that combines Convolutional Neural Networks (CNNs) for efficient spatial feature extraction with Long Short-Term Memory (LSTM) networks to model temporal dependencies over extended sequences. A distinguishing feature of this study is the creation of a hybrid dataset that which combines real-world skeleton motion data with synthetically generated samples, produced using Generative Adversarial Networks (GANs). This dataset enriches variability, enhances generalization, and mitigates data scarcity challenges. Experimental findings across three different network architectures demonstrate that our method significantly enhances recognition accuracy, mainly due to the integration of CNNs and LSTMs alongside the broadened dataset. Our approach successfully identifies complex interactions and ensures consistent performance across different perspectives and environmental conditions. The improved reliability in recognition indicates that this framework can be effectively utilized in practical applications suchas security systems, crowdmonitoring, and other areas where precise detection of mutual actions is critical, particularly in real-time and dynamic environments Copyright
action recognition , convolutional neural network , generative adversarial networks , LSTM
Text of the article Перейти на текст статьи
National Laboratory Astana, Nazarbayev University, Qabanbay ave., 53, Astana, 010000, Kazakhstan
Science and Innovation, Astana IT University, Mangilik El ave., 55/11, Astana, 010017, Kazakhstan
National Laboratory Astana
Science and Innovation
10 лет помогаем публиковать статьи Международный издатель
Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026