Data-driven design requirements for adaptive non-cognitive assessment: A mixed-methods needs analysis in primary education
DOI:
https://doi.org/10.58524/jasme.v6i4.1633Keywords:
Adaptive Assessment, Differentiated Instruction, Needs Analysis, Non-Cognitive Diagnostic Assessment, Primary School TeachersAbstract
Background: Non-cognitive diagnostic assessment supports differentiated instruction by providing insights into students’ motivation, emotional conditions, and learning needs. However, limited assessment instruments, technological constraints, and difficulties interpreting diagnostic evidence hinder its systematic implementation in primary education.
Aims: This study aimed to establish evidence-informed design requirements for a proposed adaptive digital assessment platform by examining teachers’ practices, challenges, technological readiness, and preferences in Indonesian border primary schools.
Methods: A convergent mixed-methods needs analysis was conducted with 15 purposively selected teachers from five public primary schools in West Kalimantan, Indonesia. Data were collected using a 25-item questionnaire incorporating open-ended responses and analysed through descriptive statistics, Wilson 95% confidence intervals, qualitative content analysis, and joint displays.
Results: Most teachers (80.0%) employed manual or combined assessment methods, while 66.7% experienced difficulties constructing non-cognitive instruments. Although 93.3% reported usable internet access, 80.0% encountered device limitations. All participants expressed a need for the proposed platform, prioritising individualised reports with instructional recommendations (60.0%) and automated processing (46.7%). Qualitative findings identified students’ reluctance to disclose emotional experiences (8/15 teachers) as a major challenge to obtaining reliable diagnostic evidence.
Conclusion: The findings identify provisional requirements for multi-informant assessment, adaptive questioning, shared-device accessibility, and transparent diagnostic reporting. Prioritising evidence quality and instructional interpretation over automation may strengthen data-informed assessment practices, although platform feasibility and effectiveness require empirical validation.
References
Ackerlauer, P., Diego-Mantecón, J.-M., & Lavicza, Z. (2026). Digital assessment data to provide formative feedback in mathematics: A longitudinal study of teachers' engagement with Quop in Austria. Teacher Development. Advance online publication. https://doi.org/10.1080/13664530.2026.2616491
Adiguzel, O. C., Potvin, P., Blanchette Sarrasin, J., Vanhoolandt, C., Corfdir, A., Japashov, N., Mansurova, A., Tsai, C.-C., Wu, C.-L., Elmas, R., Atik-Kara, D., Kucukkayhan, S., Zaid, A.-K., Kouchou, I., Voulgari, A., Sy, O., Sakho, I., Ng, S. B., Charland, P., & Létourneau, A. (2025). Belief in neuromyths among primary school teachers: A cross-national study of 11 countries. Trends in Neuroscience and Education, 40, Article 100264. https://doi.org/10.1016/j.tine.2025.100264
Affognon, D. A. (2026). The theory that cannot learn: A conceptual-analytical critique of modality-based learning styles. Social Sciences & Humanities Open, 13, Article 102989. https://doi.org/10.1016/j.ssaho.2026.102989
Alfageh, D. H., York, C. S., Hodge-Zickerman, A., & Xie, Y. (2024). Elementary teachers' use of adaptive diagnostic assessment to improve mathematics teaching and learning: A case study. International Electronic Journal of Mathematics Education, 19(1), Article em0768. https://doi.org/10.29333/iejme/14190
Althubyani, A. R. (2024). Digital competence of teachers and the factors affecting their competence level: A nationwide mixed-methods study. Sustainability, 16(7), 2796. https://doi.org/10.3390/su16072796
Armijo, I. (2025). Balanced profiles: The role of cognitive and non-cognitive competencies in Chilean higher education academic achievement. Discover Education, 4(1), 302. https://doi.org/10.1007/s44217-025-00546-y
Bassachs, M., Cañabate, D., Serra, T., & Colomer, J. (2020). Interdisciplinary cooperative educational approaches to foster knowledge and competences for sustainable development. Sustainability, 12(20), 8624. https://doi.org/10.3390/su12208624
Beardsley, M., Albó, L., Aragón, P., & Hernández-Leo, D. (2021). Emergency education effects on teacher abilities and motivation to use digital technologies. British Journal of Educational Technology, 52(4), 1455–1477. https://doi.org/10.1111/bjet.13101
Blasco-Magraner, J. S., Bernabe-Valero, G., Marín-Liébana, P., & Moret-Tatay, C. (2021). Effects of the educational use of music on 3- to 12-year-old children's emotional development: A systematic review. International Journal of Environmental Research and Public Health, 18(7), 3668. https://doi.org/10.3390/ijerph18073668
Brown, L. D., Cai, T. T., & DasGupta, A. (2001). Interval estimation for a binomial proportion. Statistical Science, 16(2), 101–133. https://doi.org/10.1214/ss/1009213286
Buabeng, I., & Amo-Darko, B. (2025). Curriculum reforms without foundation: The effects of inadequate preparation in curriculum reforms on Ghanaian teachers and the education system. Curriculum Perspectives, 45(2), 133–147. https://doi.org/10.1007/s41297-025-00309-7
Chen, J., Zhang, Q., Yin, Y., Turner, J. E., Luo, L., & Yang, C. (2026). Explaining individual differences in metacognitive monitoring: A multilevel analysis of person-level predictors across academic assessments. Journal of Intelligence, 14(8), 178. https://doi.org/10.3390/jintelligence14080178
Eysink, T. H. S., & Schildkamp, K. (2021). A conceptual framework for assessment-informed differentiation (AID) in the classroom. Educational Research, 63(3), 261–278. https://doi.org/10.1080/00131881.2021.1942118
Farisia, H., Santoso, A., Suyono, & Kusumaningrum, S. R. (2025). Assessing the differentiated learning practice within Islamic primary schools: Challenges in the absence of technology. Cogent Education, 12(1), Article 2563706. https://doi.org/10.1080/2331186X.2025.2563706
Fetters, M. D., Curry, L. A., & Creswell, J. W. (2013). Achieving integration in mixed methods designs: Principles and practices. Health Services Research, 48(6, Pt. 2), 2134–2156. https://doi.org/10.1111/1475-6773.12117
Goto, T., Kano, K., & Shiose, T. (2023). Students' acceptance on computer-adaptive testing for achievement assessment in Japanese elementary and secondary school. Frontiers in Education, 8, Article 1107341. https://doi.org/10.3389/feduc.2023.1107341
Halimi, F., AlShammari, I., & Navarro, C. (2020). Emotional intelligence and academic achievement in higher education. Journal of Applied Research in Higher Education, 13(2), 485–503. https://doi.org/10.1108/JARHE-11-2019-0286
Halkiopoulos, C., & Gkintoni, E. (2024). Leveraging AI in e-learning: Personalized learning and adaptive assessment through cognitive neuropsychology-A systematic analysis. Electronics, 13(18), 3762. https://doi.org/10.3390/electronics13183762
Hardy, I., Meschede, N., & Mannel, S. (2022). Measuring adaptive teaching in classroom discourse: Effects on student learning in elementary science education. Frontiers in Education, 7. https://doi.org/10.3389/feduc.2022.1041316
Hernández-Campos, M., Hilliger, I., & García-Peñalvo, F. J. (2026). Assessing 21st century competencies: A two-case study on curriculum analytics to inform continuous improvement in higher education. Journal of Learning Analytics, 13(1), 57–73. https://doi.org/10.18608/jla.2026.9131
Hsieh, H.-F., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277–1288. https://doi.org/10.1177/1049732305276687
Imawan, O. R., Retnawati, H., Haryanto, & Ismail, R. (2025). The challenges of implementing computerized adaptive testing in Indonesia. Journal of Education and e-Learning Research, 12(2), 124–144. https://doi.org/10.20448/jeelr.v12i2.6677
Ingram, P. B., & Herring, T. T. (2026). Broadband symptom validity testing: Evaluating contemporary challenges and symptom-domain specificity. Current Treatment Options in Psychiatry, 13(1), 28. https://doi.org/10.1007/s40501-026-00399-8
Jeon, J., Jang, J., & Jung, S. K. (2026). Beyond student outputs: Design requirements for teacher-facing process analytics in AI-assisted block-based programming. IEEE Transactions on Learning Technologies, 19, 791–803. https://doi.org/10.1109/TLT.2026.3718805
Joshi, A., Vinay, M., & Bhaskar, P. (2020). Impact of coronavirus pandemic on the Indian education sector: Perspectives of teachers on online teaching and assessments. Interactive Technology and Smart Education, 18(2), 205–226. https://doi.org/10.1108/ITSE-06-2020-0087
Kahmann, R., Droop, M., & Lazonder, A. W. (2026). Differentiating elementary science education: Dutch teachers' perceived practices. Research in Science Education, 56(5), 1209–1223. https://doi.org/10.1007/s11165-026-10318-9
Kartianom, Retnawati, H., Hidayati, K., & Dewantara, A. H. (2026). Understanding teachers' experiences with large-scale diagnostic assessments in Indonesian Islamic primary schools: A phenomenological study. Journal of Teaching and Learning, 20(2), 376–389. https://doi.org/10.22329/jtl.v20i1.9250
Kim, H.-J., & Kim, M.-S. (2025). A needs analysis of elementary school teachers on AI-based digital English textbooks. English Teaching, 80(3), 79–99. https://doi.org/10.15858/engtea.80.3.202509.79
Kim, J., Lee, H., & Cho, Y. H. (2022). Learning design to support student-AI collaboration: Perspectives of leading teachers for AI in education. Education and Information Technologies, 27(5), 6069–6104. https://doi.org/10.1007/s10639-021-10831-6
Kogler, A., Gasteiger-Klicpera, B., Prinz, K., & Paleczek, L. (2025). Digitally assessing social-emotional skills in early school years: Initial validation of a screening instrument. Frontiers in Psychology, 16, Article 1529083. https://doi.org/10.3389/fpsyg.2025.1529083
Kron, S., Sommerhoff, D., Achtner, M., & Ufer, S. (2021). Selecting mathematical tasks for assessing student's understanding: Pre-service teachers' sensitivity to and adaptive use of diagnostic task potential in simulated diagnostic one-to-one interviews. Frontiers in Education, 6. https://doi.org/10.3389/feduc.2021.604568
Lane, R. D., & Smith, R. (2021). Levels of emotional awareness: Theory and measurement of a socio-emotional skill. Journal of Intelligence, 9(3), 42. https://doi.org/10.3390/jintelligence9030042
Levy-Feldman, I. (2025). The role of assessment in improving education and promoting educational equity. Education Sciences, 15(2), 224. https://doi.org/10.3390/educsci15020224
Liao, X., Zhang, X., Wang, Z., & Luo, H. (2024). Design and implementation of an AI-enabled visual report tool as formative assessment to promote learning achievement and self-regulated learning: An experimental study. British Journal of Educational Technology, 55(3), 1253–1276. https://doi.org/10.1111/bjet.13424
Magano, J., Silva, C., Figueiredo, C., Vitória, A., Nogueira, T., & Pimenta Dinis, M. A. (2020). Generation Z: Fitting project management soft skills competencies-A mixed-method approach. Education Sciences, 10(7), 187. https://doi.org/10.3390/educsci10070187
Martín-Rodríguez, A., & Madrigal-Cerezo, R. (2025). Technology-enhanced pedagogy in physical education: Bridging engagement, learning, and lifelong activity. Education Sciences, 15(4), 409. https://doi.org/10.3390/educsci15040409
Molnár, G., & Kocsis, Á. (2024). Cognitive and non-cognitive predictors of academic success in higher education: A large-scale longitudinal study. Studies in Higher Education, 49(9), 1610–1624. https://doi.org/10.1080/03075079.2023.2271513
Navrátilová, J. (2026). Where do the didactic efforts of teachers lead? When grouping replaces differentiation. Improving Schools, 28(1), 181–201. https://doi.org/10.1177/13654802261417520
Niman, E. M., & Divan, S. (2026). Diagnosing or documenting? Diagnostic assessment practice in primary social studies. Journal of Curriculum and Teaching, 15(3), 71–80. https://doi.org/10.5430/jct.v15n3p71
Nishida, C., Ishimoto, Y., Takizawa, Y., Katayama, T., & Matsumoto, Y. (2021). Preliminary evidence for the reliability and validity of the Stirling Children's Well-Being Scale (SCWBS) with Japanese children. International Journal of Educational Research Open, 2, Article 100034. https://doi.org/10.1016/j.ijedro.2021.100034
Ofem, U. J., Orim, F. S., Edam-Agbor, I. B., Amanso, E. O. I., Eni, E., Ukatu, J. O., Ovat, S. V., Osang, A. W., Dien, C., & Abuo, C. B. (2025). Teachers' preparedness for the utilization of artificial intelligence in classroom assessment: The contributory effects of attitude toward technology, technological readiness, and pedagogical beliefs with perceived ease of use and perceived usefulness as mediators. Frontiers in Education, 10. https://doi.org/10.3389/feduc.2025.1568306
Olofsson, A. D., Fransson, G., & Lindberg, J. O. (2020). A study of the use of digital technology and its conditions with a view to understanding what 'adequate digital competence' may mean in a national policy initiative. Educational Studies, 46(6), 727–743. https://doi.org/10.1080/03055698.2019.1651694
Oudman, S., van de Pol, J., & van Gog, T. (2023). Effects of cue availability on primary school teachers' accuracy and confidence in their judgments of students' mathematics performance. Teaching and Teacher Education, 122, Article 103982. https://doi.org/10.1016/j.tate.2022.103982
Palmer, C., Patterson, P., & Tuomainen, H. (2026). Identification matters: How data sharing affects pupil honesty and engagement in universal school well-being assessments. Journal of Adolescent Health, 79(4), 564–572. https://doi.org/10.1016/j.jadohealth.2026.06.002
Peters, M. T., Hebbecker, K., & Souvignier, E. (2022). Effects of providing teachers with tools for implementing assessment-based differentiated reading instruction in second grade. Assessment for Effective Intervention, 47(3), 157–169. https://doi.org/10.1177/15345084211014926
Rana, K., Greenwood, J., & Henderson, R. (2022). Teachers' experiences of ICT training in Nepal: How teachers in rural primary schools learn and make progress in their ability to use ICT in classrooms. Technology, Pedagogy and Education, 31(3), 275–291. https://doi.org/10.1080/1475939X.2021.2014947
Raudenbush, S. W., Hernandez, M., Goldin-Meadow, S., Carrazza, C., Foley, A., Leslie, D., Sorkin, J. E., & Levine, S. C. (2020). Longitudinally adaptive assessment and instruction increase numerical skills of preschool children. Proceedings of the National Academy of Sciences of the United States of America, 117(45), 27945–27953. https://doi.org/10.1073/pnas.2002883117
Reardon, T., Ukoumunne, O. C., Ball, S., Brown, P., Ford, T., Gray, A., Hill, C., Jasper, B., Larkin, M., Macdonald, I., Morgan, F., Sancho, M., Sniehotta, F. F., Spence, S. H., Stainer, J., Stallard, P., Violato, M., iCATS, T., & Creswell, C. (2025). Development of a brief assessment tool to identify children with probable anxiety disorders. JCPP Advances, 5(2), Article e12265. https://doi.org/10.1002/jcv2.12265
Rincon-Flores, E. G., Castano, L., Guerrero Solis, S. L., Olmos Lopez, O., Rodríguez Hernández, C. F., Castillo Lara, L. A., & Aldape Valdés, L. P. (2024). Improving the learning-teaching process through adaptive learning strategy. Smart Learning Environments, 11(1), 27. https://doi.org/10.1186/s40561-024-00314-9
Salem, M. A. (2026). An explainable educational data mining framework for misconception detection and differentiated instruction. Algorithms, 19(9), 719. https://doi.org/10.3390/a19090719
Sandoval-Ríos, F., Gajardo-Poblete, C., & López-Núñez, J. A. (2025). Role of data literacy training for decision-making in teaching practice: A systematic review. Frontiers in Education, 10. https://doi.org/10.3389/feduc.2025.1485821
Schelling, N., & Rubenstein, L. D. (2021). Elementary teachers' perceptions of data-driven decision-making. Educational Assessment, Evaluation and Accountability, 33(2), 317–344. https://doi.org/10.1007/s11092-021-09356-w
Splett, J. W., Brann, K. L., Trainor, K. M., & Shen, Z. (2023). Examining utility and impact of social, emotional, and behavioral screening to identify and address needs. School Psychology, 38(3), 137–147. https://doi.org/10.1037/spq0000540
Spyropoulou, E., Wallace, M., & Poulopoulos, V. (2025). Differentiated education using technology in junior and high school classrooms. Encyclopedia, 5(2), 71. https://doi.org/10.3390/encyclopedia5020071
Sultanova, G. (2025). Introducing non-cognitive load to the educational discourse. Frontiers in Psychology, 15. https://doi.org/10.3389/fpsyg.2024.1411102
Tsortanidou, X., Daradoumis, T., & Barberá, E. (2022). Developing social-emotional skills through imaginative teaching methods in elementary education. Early Child Development and Care, 192(8), 1201–1216. https://doi.org/10.1080/03004430.2020.1854241
van Leeuwen, A., & Rummel, N. (2022). The function of teacher dashboards depends on the amount of time pressure in the classroom situation: Results from teacher interviews and an experimental study. Unterrichtswissenschaft, 50(4), 561–588. https://doi.org/10.1007/s42010-022-00156-9
Wilson, J., Ahrendt, C., Fudge, E. A., Raiche, A., Beard, G., & MacArthur, C. (2021). Elementary teachers' perceptions of automated feedback and automated scoring: Transforming the teaching and learning of writing using automated writing evaluation. Computers & Education, 168, 104208. https://doi.org/10.1016/j.compedu.2021.104208
Xie, J., Shao, J., Wang, C., Shi, X., Miao, Q., Yip, C. C., & Ye, J. (2026). Visual cueing and adaptive learning for teaching thyroid eye disease diagnostic assessment to ophthalmology residents. Frontiers in Medicine, 13. https://doi.org/10.3389/fmed.2026.1934529
Yan, H., Lin, F., & Kinshuk. (2021). Including learning analytics in the loop of self-paced online course learning design. International Journal of Artificial Intelligence in Education, 31(4), 878–895. https://doi.org/10.1007/s40593-020-00225-z
Yavuz, E. (2026). Validity and fairness of the PISA 2018 global competence assessment: An argument-based evaluation via explanatory item response models. Humanities and Social Sciences Communications, 13(1), 570. https://doi.org/10.1057/s41599-026-06979-6
Zurbriggen, C. L. A., Schwab, S., Kalkusch, I., Neuhauser, A., Lanfranchi, A., & Klaver, P. (2025). Explaining teachers' judgement accuracy of students' subjective well-being by students' individual characteristics and the teacher-student relationship. Learning and Individual Differences, 122, Article 102754. https://doi.org/10.1016/j.lindif.2025.102754
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Agung Hartoyo, Hairida, Dona Fitriawan, Rody Putra Sartika, Davi Maelani Putri, Anggi Fatmadiwi, Rachmad Kurniawan

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.