Developing Students’ HOTS Digital Literacy Profile by Using IRT

Begimbetova G.A. Retnawat H. Kassymova G.K. Triyono M.B. Azman M.N.A. Sodikin R.A.
11 August 2025 OpenED Network

Journal of Curriculum Studies Research
2025 #7 Issue 2 155 - 176 pp.

This study aimed to develop and validate a digital literacy higher-order thinking skills (HOTS) cognitive test for engineering students at Universitas Negeri Yogyakarta in Indonesia. Utilising a quantitative research design, the study involved 95 participants and employed expert judgement to assess content validity through the Aiken V Index, which yielded a high average validity score of 1.783. Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) confirmed a single factor structure with strong fit indices (CFI = 0.98, TLI = 0.97, RMSEA = 0.08), indicating robust construct validity. Reliability analysis revealed a high internal consistency (α = 0.92). Item Response Theory (IRT) calibration demonstrated satisfactory model fit, with moderate discrimination and average difficulty indices for the test items. The findings affirm that the developed test is both reliable and valid, effectively capturing students digital literacy HOTS profiles, thereby providing valuable insights for educational interventions aimed at enhancing digital literacy skills in engineering education. KEYWORDS.

Digital literacy , education , HOTS cognitive test , item characteristics , reliability , students , validity

Text of the article Перейти на текст статьи

Graduate School, Yogyakarta State University, Yogyakarta, Indonesia
Faculty of Pedagogy and Psychology, Abai Kazakh National Pedagogical University, Almaty, Kazakhstan
Institute of Metallurgy and Ore Beneficiation JSC, Satbayev University Almaty, Kazakhstan
Department Engineering Technology, Faculty of Technical and Vocational, Sultan Idris Education University, Malaysia
Education of System and Information Technology, Indonesia University of Education, Bandung, Indonesia

Graduate School
Faculty of Pedagogy and Psychology
Institute of Metallurgy and Ore Beneficiation JSC
Department Engineering Technology
Education of System and Information Technology

10 лет помогаем публиковать статьи Международный издатель

Книга Публикация научной статьи Волощук 2026 Book Publication of a scientific article 2026