Learning sign language with mixed reality applications - the exploratory case study with deaf students


Imashev A. Kydyrbekova A. Oralbayeva N. Kenzhekhan A. Sandygulova A.
September 2024Springer

Education and Information Technologies
2024#29Issue 1317261 - 17292 pp.

The current body of scholarly literature highlights the increasing importance of Mixed Reality (MR) in the field of education since it provides an alternative way through visual stimuli inside an immersive environment. In recent years, the possibility for educators to use Mixed Reality as an additional pedagogical instrument has witnessed notable growth. Furthermore, the implementation of MR technology enhances the perceived benefits of employing it as a solution to the challenges encountered in educating and acquiring sign language skills among children who have hearing impairments or are deaf. The development and testing of deaf-friendly techniques for teaching sign language to Deaf or Hard-of-Hearing (DHH) pupils utilizing modern MR technology is the key endeavor of our research. In light of the specific aspects of the pilot study and the suggestions and preferences expressed by the participants, as outlined in previous attempts, we have endeavored to develop a series of instructional modules on the topic of animals. These modules employ various methods of sign demonstration and incorporate visual representations and concise encyclopedic descriptions. To achieve our research objectives, a total of 21 deaf students, ranging in age from 9 to 14 years, were selected for this study. These students study in a mainstream school that have inclusive educational programs. The participants have been offered two options for evaluation: a laptop and the application specifically designed for the HoloLens 2.

human-computer interaction , human-robot interaction , Mixed reality , sign language

Text of the article Перейти на текст статьи

Department of Robotics Engineering, School of Engineering and Digital Sciences, Nazarbayev University, 53 Kabanbay Batyr Avenue, Astana, 010000, Kazakhstan
Department of Informatics, Faculty of Information Technologies, L. N. Gumilyov Eurasian National University, 2 Satbayeva Street, Astana, 010000, Kazakhstan
Graduate School of Education, Nazarbayev University, 53 Kabanbay Batyr Avenue, Astana, 010000, Kazakhstan

Department of Robotics Engineering
Department of Informatics
Graduate School of Education

10 лет помогаем публиковать статьи Международный издатель

Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026