A COMPARISON OF KAZAKH LANGUAGE PROCESSING MODELS FOR IMPROVING SEMANTIC SEARCH RESULTS
Aitim A. Satybaldiyeva R.
2025Technology Center
Eastern-European Journal of Enterprise Technologies
2025#1Issue 2(133)66 - 75 pp.
The object of the study is the text classification and semantic search tailored to the unique linguistic features of the Kazakh language. The research addresses the challenge of improving the accuracy, relevance, and efficiency of semantic search. This study focuses on improving semantic search for the Kazakh language by analyzing computational models tailored to its unique linguistic features, such as agglutinative morphology and rich inflectional systems. The research compares traditional rule-based approaches and advanced transformer architectures, including fine-tuned models like RoBERTa, for their ability to handle semantic nuances, contextual relationships, and user intent. The results reveal that fine-tuned transformer models achieved significant advancements, with the RoBERTa model attaining a Precision@10 of 89.4 %, a Mean Reciprocal Rank (MRR) of 85.6 %, and an F1-Score of 88.0 %. Additionally, the semantic search system developed in this study demonstrated a precision of 88.4 %, recall of 87.6 %, and an F1-score of 88.0 % on a domain-specific Kazakh dataset. Key to these improvements were innovations in preprocessing pipelines, including custom tokenization and lemmatization tailored to Kazakh’s agglutinative morphology, and the integration of contextual embeddings to resolve issues such as synonymy and homonymy. Computational efficiency was enhanced through resource optimization techniques, enabling the deployment of these advanced models in constrained environments. These findings underscore the potential of tailored transformer models to bridge the gap in semantic search capabilities for underrepresented languages like Kazakh, advancing the inclusivity of natural language processing technologies Copyright
information retrieval systems , Kazakh language , natural language processing , semantic search
Text of the article Перейти на текст статьи
Department of Information Systems, International IT University, Manas str., 34/1, Almaty, 050020, Kazakhstan
Department of Cybersecurity, Information Processing and Storage, Satbayev University, Satbayev str., 22, Almaty, 050000, Kazakhstan
Department of Information Systems
Department of Cybersecurity
10 лет помогаем публиковать статьи Международный издатель
Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026