Development and psychometric evaluation of a formative assessment instrument for higher order thinking skills in Akidah Akhlak Phase E
Keywords:
Formative assessment, Higher Order Thinking Skills, Instrument development, Psychometric evaluation, Akidah AkhlakAbstract
Formative assessment plays an essential role in fostering Higher Order Thinking Skills (HOTS); however, the development of HOTS assessment instruments for Akidah Akhlak supported by comprehensive psychometric evaluation remains limited. This study aimed to develop a formative HOTS assessment instrument for Akidah Akhlak Phase E and evaluate its psychometric quality. An instrument development study was employed through construct analysis, instrument development, content validation by two experts, field testing involving 35 students, and psychometric evaluation using Aiken's V, Product Moment correlation, Cronbach's Alpha, and ITEMAN. The findings revealed a mean Aiken's V of 0.846, 34 of 35 items (97.14%) met the empirical validity criteria, a reliability coefficient of 0.929, and item characteristics were dominated by moderate difficulty, very good discrimination, and fully functioning distractors. This study contributes a valid and reliable HOTS assessment instrument and a psychometric-based instrument development framework to support evidence-based formative assessment in Akidah Akhlak learning.
Abstrak
Asesmen formatif berperan penting dalam mengembangkan Higher Order Thinking Skills (HOTS), namun pengembangan instrumen pada mata pelajaran Akidah Akhlak yang disertai evaluasi psikometrik secara komprehensif masih terbatas. Penelitian ini bertujuan mengembangkan instrumen asesmen formatif HOTS pada mata pelajaran Akidah Akhlak Fase E serta mengevaluasi kualitas psikometriknya. Penelitian menggunakan pendekatan instrument development study melalui analisis konstruk, pengembangan instrumen, validasi isi oleh dua ahli, uji coba kepada 35 peserta didik, serta evaluasi psikometrik menggunakan Aiken's V, korelasi Product Moment, Cronbach's Alpha, dan ITEMAN. Hasil penelitian menunjukkan nilai rata-rata Aiken's V sebesar 0,846, sebanyak 34 dari 35 butir (97,14%) memenuhi validitas empiris, reliabilitas sebesar 0,929, serta karakteristik butir didominasi tingkat kesukaran sedang, daya beda sangat baik, dan distraktor yang seluruhnya berfungsi efektif. Penelitian ini berkontribusi menyediakan instrumen HOTS yang valid, reliabel, serta model pengembangan instrumen berbasis evaluasi psikometrik untuk mendukung evidence-based formative assessment pada pembelajaran Akidah Akhlak.
Downloads
References
Abadiga, Z. A., Tola, K. K., & Tulu, A. H. (2025). Development and validation of self-report questionnaire to assess higher-order thinking skills in secondary school mathematics. School Science and Mathematics. https://doi.org/10.1111/ssm.18400
Aiken, L. R. (1985). Three coefficients for analyzing the reliability and validity of ratings. Educational and Psychological Measurement, 45(1), 131–142. https://doi.org/10.1177/0013164485451012
Al-Htaybat, K., von Alberti-Alhtaybat, L., & Alhatabat, Z. (2018). Educating digital natives for the future: Accounting educators’ evaluation of the accounting curriculum. Accounting Education, 27(4), 333–357. https://doi.org/10.1080/09639284.2018.1437758
Albarqouni, L., Hoffmann, T., & Glasziou, P. (2018). Evidence-based practice educational intervention studies: A systematic review of what is taught and how it is measured. BMC Medical Education, 18(1), 177. https://doi.org/10.1186/s12909-018-1284-1
Arafah, K., Amin, B. D., Sari, S. S., & Hakim, A. (2021). The development of higher order-thinking skills (HOTS) instrument assessment in physics study. Journal of Physics: Conference Series, 1899(1), 012140. https://doi.org/10.1088/1742-6596/1899/1/012140
Arlianty, W. N., Febriana, B. W., Diniaty, A., & Fauzi’ah, L. (2018). Student profile in completing questions based on cognitive level of Bloom’s taxonomy by Anderson and Krathwohl. 2nd International Conference on Chemistry, Chemical Process and Engineering (IC3PE), 020063. https://doi.org/10.1063/1.5065023
Astin, A. W., & Antonio, A. L. (2012). Assessment for excellence: The philosophy and practice of assessment and evaluation in higher education. Bloomsbury Publishing PLC.
Clark, L. A., & Watson, D. (2019). Constructing validity: New developments in creating objective measuring instruments. Psychological Assessment, 31(12), 1412–1427. https://doi.org/10.1037/pas0000626
Connell, J., Carlton, J., Grundy, A., Taylor Buck, E., Keetharuth, A. D., Ricketts, T., Barkham, M., Robotham, D., Rose, D., & Brazier, J. (2018). The importance of content and face validity in instrument development: Lessons learnt from service users when developing the Recovering Quality of Life measure (ReQoL). Quality of Life Research, 27(7), 1893–1902. https://doi.org/10.1007/s11136-018-1847-y
Friatma, A., & Anhar, A. (2019). Analysis of validity, reliability, discrimination, difficulty and distraction effectiveness in learning assessment. Journal of Physics: Conference Series, 1387(1), 012063. https://doi.org/10.1088/1742-6596/1387/1/012063
Gärtner, F. R., Bomhof-Roordink, H., Smith, I. P., Scholl, I., Stiggelbout, A. M., & Pieterse, A. H. (2018). The quality of instruments to assess the process of shared decision making: A systematic review. PLOS ONE, 13(2), e0191747. https://doi.org/10.1371/journal.pone.0191747
Gupta, K. (2023). Validity and reliability of students’ assessment: Case for recognition as a unified concept of valid reliability. International Journal of Applied & Basic Medical Research, 13(3), 129–132. https://doi.org/10.4103/ijabmr.ijabmr_382_23
Hauer, K. E., Park, Y. S., Bullock, J. L., & Tekian, A. (2023). “My assessments are biased!” Measurement and sociocultural approaches to achieve fairness in assessment in medical education. Academic Medicine, 98, S16–S27. https://doi.org/10.1097/ACM.0000000000005245
Isnaeni, W., Rudyatmi, E., Ridlo, S., Ingesti, S., & Adiani, L. R. (2021). Improving students’ communication skills and critical thinking ability with ICT-oriented problem-based learning and the assessment instruments with HOTS criteria on the immune system material. Journal of Physics: Conference Series, 1918(5), 052048. https://doi.org/10.1088/1742-6596/1918/5/052048
Landers, R. N., Armstrong, M. B., Collmus, A. B., Mujcic, S., & Blaik, J. (2022). Theory-driven game-based assessment of general cognitive ability: Design theory, measurement, prediction of performance, and test fairness. Journal of Applied Psychology, 107(10), 1655–1677. https://doi.org/10.1037/apl0000954
Leenknecht, M., Wijnia, L., Köhlen, M., Fryer, L., Rikers, R., & Loyens, S. (2021). Formative assessment as practice: The role of students’ motivation. Assessment & Evaluation in Higher Education, 46(2), 236–255. https://doi.org/10.1080/02602938.2020.1765228
Merle, M. H. (1998). Methodological studies: Instrument development. In Advanced design in nursing research (pp. 235–286).
Reynders, G., Lantz, J., Ruder, S. M., Stanford, C. L., & Cole, R. S. (2020). Rubrics to assess critical thinking and information processing in undergraduate STEM courses. International Journal of STEM Education, 7(1), 9. https://doi.org/10.1186/s40594-020-00208-5
Safrudin, A. M. (2025). Learning assessment as a strategic tool for improving educational quality. Islamic Journal of Education, 4(2), 84–112. https://doi.org/10.54801/k22g7k67
Schuwirth, L. W. T., & van der Vleuten, C. P. M. (2018). How to design a useful test. In Understanding medical education (pp. 275–289). Wiley. https://doi.org/10.1002/9781119373780.ch20
Solihin, R. R., Susanto, T. T. D., Fauziyah, E. P., Yanti, N. V. I., & Ramadhania, A. P. (2024). The efforts of Indonesian government in increasing teacher quality based on PISA result in 2022: A literature review. Perspektif Ilmu Pendidikan, 38(1), 57–65. https://doi.org/10.21009/PIP.381.6
Sugiyono, S., Lastariwati, B., Budiastuti, E., & Yudianto, A. (2018). Development of authentic assessment instruments for saintifical learning in tourism vocational high schools. Jurnal Pendidikan Teknologi dan Kejuruan, 24(1), 52–61. https://doi.org/10.21831/jptk.v24i1.16670
Zhou, Y., Ning, Y., Chen, J., Zhang, W., & Wijaya, T. T. (2024). Development and validation of Mathematical Higher-Order Thinking Scale for high school students. Psychology in the Schools, 61(8), 3160–3192. https://doi.org/10.1002/pits.23213
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Chamelia Nurani, Rizki Rahmawati (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
