Aviation Profiling Method Based on Deep Learning Technology for Emotion Recognition by Speech Signal


Koshekov K.T. Savostin A.A. Seidakhmetov B.K. Anayatova R.K. Fedorov I.O.
1 November 2021Sciendo

Transport and Telecommunication
2021#22Issue 4471 - 481 pp.

This paper proposes a method of automatic speaker-independent recognition of human psycho-emotional states by analyzing the speech signal based on Deep Learning technology to solve the problems of aviation profiling. For this purpose, an algorithm to classify seven human psycho-emotional states, including anger, joy, fear, surprise, disgust, sadness, and neutral state was developed. The algorithm is based on the use of Mel-frequency cepstral coefficients and Mel spectrograms as informative features of speech signals audio recordings. These informative features are used to train two deep convolutional neural networks on the generated dataset. The developed classifier testing on a delayed verification dataset showed that the metric for the multiclass fraction of correct answers accuracy is 0.93. The solution proposed in the paper can be in demand in human-machine interfaces creation, medicine, marketing, and in the field of air transportation.

aviation profiling , emotion recognition , neural network , speech signal

Text of the article Перейти на текст статьи

JSC Civil Aviation Academy, Akhmetov str., 44, Almaty, 050039, Kazakhstan
M. Kozybayev North-Kazakhstan University, Pushkin str., 86, Petropavlovsk, 150000, Kazakhstan

JSC Civil Aviation Academy
M. Kozybayev North-Kazakhstan University

10 лет помогаем публиковать статьи Международный издатель

Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026