Kazakh Speech Recognition: Wav2vec2.0 vs. Whisper
Kozhirbayev Z.
2023Engineering and Technology Publishing
Journal of Advances in Information Technology
2023#14Issue 61382 - 1389 pp.
In recent years, the progress made in neural models trained on extensive multilingual text or speech data has shown great potential for improving the status of underresourced languages. This paper focuses on experimenting with three state-of-the-art speech recognition models, namely Facebook’s Wav2Vec2.0 and Wav2Vec2-XLS-R, OpenAI’s Whisper, on the Kazakh language. The objective of this research is to investigate the effectiveness of these models in transcribing Kazakh speech and to compare their performance with existing supervised Automatic Speech Recognition (ASR) systems. The study also aims to explore the possibility of using data from other languages for pre-training and to test whether fine-tuning the target language data can improve model performance. Thus, this work can provide insights into the effectiveness of using pretrained multilingual models in underresourced language settings. The wav2vec2.0 model achieved a Character Error Rate (CER) of 2.8 and a Word Error Rate (WER) of 8.7 on the test set, which closely matches the best result achieved by the end-to-end Transformer model. The large whisper model achieves a CER of approximately 4 on the test set. The results of this study can contribute to the development of robust and efficient ASR systems for the Kazakh language, benefiting various applications, including speech-to-text translation, voice assistants, and speech-based communication tools.
automatic speech recognition , pretrained transformer models , speech representation models , Wav2Vec 2.0 , Wav2Vec2-XLS-R , whisper
Text of the article Перейти на текст статьи
National Laboratory Astana, Nazarbayev University, Kazakhstan
National Laboratory Astana
10 лет помогаем публиковать статьи Международный издатель
Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026