Grammatical Categories Determination For Turkish And Kazakh Languages Based On Machine Learning Algorithms And Fulfilling Dictionaries Of Link Grammar Parser

Yerimbetova A. Tussupova M. Sambetbayeva M. Turdalyuly M. Sakenov B.
2021 Technology Center

Eastern-European Journal of Enterprise Technologies
2021 #5 Issue 2-113 55 - 65 pp.

This research is aimed at identifying the parts of speech for the Kazakh and Turkish languages in an information retrieval system.The proposed algorithms are based on machine learning techniques. In this paper, we considerthe binary classification of words according to parts of speech. We decided to take the most popular machine learning algorithms. In this paper, the following approaches and well-known machine learning algorithms are studied and considered. We defined 7 dictionaries and tagged 135 million words in Kazakh and 9 dictionaries and 50 million words in the Turkish language. The main problem considered in the paper is to create algorithms for the execution of dictionaries of the so-called Link Grammar Parser (LGP) system, in particular for the Kazakh and Turkish languages, using machine learning techniques. The focus of the research is on the review and comparison of machine learning algorithms and methods that have accomplished results on various natural language processing tasks such as grammatical categories determination. For the operation of the LGP system, a dictionary is created in which a connector for each word is indicated – the type of connection that can be created using this word. The authors considered methods of filling in LGP dictionaries using machine learning. The complexities of natural language processing, however, do not exclude the possibility of identifying narrower tasks that can already be solved algorithmically: for example, determining parts of speech or splitting texts into logical groups. However, some features of natural languages significantly reduce the effectiveness of these solutions. Thus, taking into account all word forms for each word in the Kazakh and Turkish languages increases the complexity of text processing by an order of magnitude

agglutinative language , machine learning algorithms , natural language processing , part-of-speech , Word2vec

Text of the article Перейти на текст статьи

Institute of Information and Computational Technologies, Shevchenko str,28, Almaty, 050010, Kazakhstan
ENGIE IT, Bd Simon Bolivar,34, Bruxelles, 1000, Belgium
Department of Software Engineering, Institute of Automation and Information Technologies, Satbayev University, Satbayev str,22a, Almaty, 050013, Kazakhstan

Institute of Information and Computational Technologies
ENGIE IT
Department of Software Engineering

10 лет помогаем публиковать статьи Международный издатель

Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026