A Multi-criteria-Based Expert Modeling for Assessing the Textbook Quality


Nurbekova Z. Sembayev T. Dossymbek D. Baigusheva K. Omarov S. Nurlanov Y.
Sep 2023International Journal of Information and Education Technology

International Journal of Information and Education Technology
2023#13Issue 91408 - 1421 pp.

This research considers the application of a multi-criteria approach to assess the quality of textbook content. The issues of determining evaluation criteria and organizing the work of experts are brought to the fore, as these factors directly affect the objectivity and efficiency of the evaluation process. The definition of criteria consisted of reviewing common mistakes and comments on the quality of textbooks, forming a preliminary and final list of criteria. The organization of the work of the experts consisted in the development of a platform with the introduction of a multi-criteria approach. As a result, 39 criteria were formulated and proposed, grouped into 10 main sections such as “Structure and organization”, “Content”, “Didactic aspects”, “Methodological aspects”, “Language level”, “Psychological and psycholinguistic aspects”, “Cultural and Value Aspects”, “ICT Integration”, “Differentiation Aspects”, and “Layout and Design”. The work of experts in the developed expert system is described, which helps in making a decision. The implementation of the multi-criteria approach in this expert system is the main contribution of the research work, which helps to improve the process of evaluating textbooks. The paper presents the results of the survey among 44 experts that helped to identify the most significant criteria which affect the evaluation a textbook. The paper presents the results of the survey among 44 experts that helped to identify the most significant criteria which affect the evaluation a textbook. Moreover, the base of allowed errors was formulated for the following types: for illustrations, QR codes, for texts, for the language of presentation, technical errors, content errors, errors for multimedia objects.

Assessment , descriptors , multicriteria assessment , textbook

Text of the article Перейти на текст статьи

Department of Informatics and Informatization of education, Institute of Mathematics, Physics and Informatics, Abai Kazakh National Pedagogical University, Almaty, Kazakhstan
Department of Physical-Mathematical Sciences and Informatics, Faculty of Natural Sciences and Mathematics, Shakarim University, Semey, Kazakhstan
Department of Computer Science, Information Technologies Faculty, L.N. Gumilyov, Eurasian National University, Astana, Kazakhstan
LLP ―Digital Experts Group‖, Astana, Kazakhstan
Republican Research-to-practice Center for Educational Content Expertise under the Ministry of Education of the Republic of Kazakhstan, Astana, Kazakhstan

Department of Informatics and Informatization of education
Department of Physical-Mathematical Sciences and Informatics
Department of Computer Science
LLP ―Digital Experts Group‖
Republican Research-to-practice Center for Educational Content Expertise under the Ministry of Education of the Republic of Kazakhstan

10 лет помогаем публиковать статьи Международный издатель

Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026