Offensive Language Identification in Low Resource Languages using Bidirectional Long-Short-Term Memory Network
Toktarova A. Abushakhma A. Adylbekova E. Manapova A. Kaldarova B. Atayev Y. Kassenova B. Aidarkhanova A.
2023Science and Information Organization
International Journal of Advanced Computer Science and Applications
2023#14Issue 6814 - 821 pp.
Offensive language identification is a critical task in todays digital era, enabling the development of effective content moderation systems. However, it poses unique challenges in low resource languages where limited annotated data is available. This research paper focuses on addressing the problem of offensive language identification specifically in the context of a low resource language, namely the Kazakh language. To tackle this challenge, we propose a novel approach based on Bidirectional Long-Short-Term Memory (BiLSTM) networks, which have demonstrated strong performance in natural language processing tasks. By leveraging the bidirectional nature of the BiLSTM architecture, we capture both contextual dependencies and long-term dependencies in the input text, enabling more accurate offensive language identification. Our approach further utilizes transfer learning techniques to mitigate the scarcity of annotated data in the low resource setting. Through extensive experiments on a Kazakh offensive language dataset, we demonstrate the effectiveness of our proposed approach, achieving state-of-the-art results in offensive language identification in the low resource Kazakh language. Moreover, we analyze the impact of different model configurations and training strategies on the performance of our approach. The findings from our study provide valuable insights into offensive language identification techniques in low resource languages and pave the way for more robust content moderation systems tailored to specific linguistic contexts.
classification , deep learning , low resource language , machine learning , natural language processing , Offensive language
Text of the article Перейти на текст статьи
Khoja Akhmet Yassawi International Kazakh, Turkish University, Turkistan, Kazakhstan
Khoja Akhmet Yassawi International Kazakh, Turkish University, Turkistan, Kazakhstan
South Kazakhstan State Pedagogical University, Shymkent, Kazakhstan
Narxoz University, Almaty, Kazakhstan
Kokshetau University named after Sh. Ualijhanov, Kazakhstan
Khoja Akhmet Yassawi International Kazakh
Khoja Akhmet Yassawi International Kazakh
South Kazakhstan State Pedagogical University
Narxoz University
Kokshetau University named after Sh. Ualijhanov
10 лет помогаем публиковать статьи Международный издатель
Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026