Data-driven design requirements for adaptive non-cognitive assessment: A mixed-methods needs analysis in primary education

Authors

  • Agung Hartoyo Universitas Tanjungpura, Indonesia
  • Hairida Universitas Tanjungpura, Indonesia
  • Dona Fitriawan Universitas Tanjungpura, Indonesia
  • Rody Putra Sartika Universitas Tanjungpura, Indonesia
  • Davi Maelani Putri Universitas Tanjungpura, Indonesia
  • Anggi Fatmadiwi Universitas Tanjungpura, Indonesia
  • Rachmad Kurniawan Universitas Tanjungpura, Indonesia

DOI:

https://doi.org/10.58524/jasme.v6i4.1633

Keywords:

Adaptive Assessment, Differentiated Instruction, Needs Analysis, Non-Cognitive Diagnostic Assessment, Primary School Teachers

Abstract

Background: Non-cognitive diagnostic assessment supports differentiated instruction by providing insights into students’ motivation, emotional conditions, and learning needs. However, limited assessment instruments, technological constraints, and difficulties interpreting diagnostic evidence hinder its systematic implementation in primary education.

Aims: This study aimed to establish evidence-informed design requirements for a proposed adaptive digital assessment platform by examining teachers’ practices, challenges, technological readiness, and preferences in Indonesian border primary schools.

Methods: A convergent mixed-methods needs analysis was conducted with 15 purposively selected teachers from five public primary schools in West Kalimantan, Indonesia. Data were collected using a 25-item questionnaire incorporating open-ended responses and analysed through descriptive statistics, Wilson 95% confidence intervals, qualitative content analysis, and joint displays.

Results: Most teachers (80.0%) employed manual or combined assessment methods, while 66.7% experienced difficulties constructing non-cognitive instruments. Although 93.3% reported usable internet access, 80.0% encountered device limitations. All participants expressed a need for the proposed platform, prioritising individualised reports with instructional recommendations (60.0%) and automated processing (46.7%). Qualitative findings identified students’ reluctance to disclose emotional experiences (8/15 teachers) as a major challenge to obtaining reliable diagnostic evidence.

Conclusion: The findings identify provisional requirements for multi-informant assessment, adaptive questioning, shared-device accessibility, and transparent diagnostic reporting. Prioritising evidence quality and instructional interpretation over automation may strengthen data-informed assessment practices, although platform feasibility and effectiveness require empirical validation.

References

Ackerlauer, P., Diego-Mantecón, J.-M., & Lavicza, Z. (2026). Digital assessment data to provide formative feedback in mathematics: A longitudinal study of teachers' engagement with Quop in Austria. Teacher Development. Advance online publication. https://doi.org/10.1080/13664530.2026.2616491

Adiguzel, O. C., Potvin, P., Blanchette Sarrasin, J., Vanhoolandt, C., Corfdir, A., Japashov, N., Mansurova, A., Tsai, C.-C., Wu, C.-L., Elmas, R., Atik-Kara, D., Kucukkayhan, S., Zaid, A.-K., Kouchou, I., Voulgari, A., Sy, O., Sakho, I., Ng, S. B., Charland, P., & Létourneau, A. (2025). Belief in neuromyths among primary school teachers: A cross-national study of 11 countries. Trends in Neuroscience and Education, 40, Article 100264. https://doi.org/10.1016/j.tine.2025.100264

Affognon, D. A. (2026). The theory that cannot learn: A conceptual-analytical critique of modality-based learning styles. Social Sciences & Humanities Open, 13, Article 102989. https://doi.org/10.1016/j.ssaho.2026.102989

Alfageh, D. H., York, C. S., Hodge-Zickerman, A., & Xie, Y. (2024). Elementary teachers' use of adaptive diagnostic assessment to improve mathematics teaching and learning: A case study. International Electronic Journal of Mathematics Education, 19(1), Article em0768. https://doi.org/10.29333/iejme/14190

Althubyani, A. R. (2024). Digital competence of teachers and the factors affecting their competence level: A nationwide mixed-methods study. Sustainability, 16(7), 2796. https://doi.org/10.3390/su16072796

Armijo, I. (2025). Balanced profiles: The role of cognitive and non-cognitive competencies in Chilean higher education academic achievement. Discover Education, 4(1), 302. https://doi.org/10.1007/s44217-025-00546-y

Bassachs, M., Cañabate, D., Serra, T., & Colomer, J. (2020). Interdisciplinary cooperative educational approaches to foster knowledge and competences for sustainable development. Sustainability, 12(20), 8624. https://doi.org/10.3390/su12208624

Beardsley, M., Albó, L., Aragón, P., & Hernández-Leo, D. (2021). Emergency education effects on teacher abilities and motivation to use digital technologies. British Journal of Educational Technology, 52(4), 1455–1477. https://doi.org/10.1111/bjet.13101

Blasco-Magraner, J. S., Bernabe-Valero, G., Marín-Liébana, P., & Moret-Tatay, C. (2021). Effects of the educational use of music on 3- to 12-year-old children's emotional development: A systematic review. International Journal of Environmental Research and Public Health, 18(7), 3668. https://doi.org/10.3390/ijerph18073668

Brown, L. D., Cai, T. T., & DasGupta, A. (2001). Interval estimation for a binomial proportion. Statistical Science, 16(2), 101–133. https://doi.org/10.1214/ss/1009213286

Buabeng, I., & Amo-Darko, B. (2025). Curriculum reforms without foundation: The effects of inadequate preparation in curriculum reforms on Ghanaian teachers and the education system. Curriculum Perspectives, 45(2), 133–147. https://doi.org/10.1007/s41297-025-00309-7

Chen, J., Zhang, Q., Yin, Y., Turner, J. E., Luo, L., & Yang, C. (2026). Explaining individual differences in metacognitive monitoring: A multilevel analysis of person-level predictors across academic assessments. Journal of Intelligence, 14(8), 178. https://doi.org/10.3390/jintelligence14080178

Eysink, T. H. S., & Schildkamp, K. (2021). A conceptual framework for assessment-informed differentiation (AID) in the classroom. Educational Research, 63(3), 261–278. https://doi.org/10.1080/00131881.2021.1942118

Farisia, H., Santoso, A., Suyono, & Kusumaningrum, S. R. (2025). Assessing the differentiated learning practice within Islamic primary schools: Challenges in the absence of technology. Cogent Education, 12(1), Article 2563706. https://doi.org/10.1080/2331186X.2025.2563706

Fetters, M. D., Curry, L. A., & Creswell, J. W. (2013). Achieving integration in mixed methods designs: Principles and practices. Health Services Research, 48(6, Pt. 2), 2134–2156. https://doi.org/10.1111/1475-6773.12117

Goto, T., Kano, K., & Shiose, T. (2023). Students' acceptance on computer-adaptive testing for achievement assessment in Japanese elementary and secondary school. Frontiers in Education, 8, Article 1107341. https://doi.org/10.3389/feduc.2023.1107341

Halimi, F., AlShammari, I., & Navarro, C. (2020). Emotional intelligence and academic achievement in higher education. Journal of Applied Research in Higher Education, 13(2), 485–503. https://doi.org/10.1108/JARHE-11-2019-0286

Halkiopoulos, C., & Gkintoni, E. (2024). Leveraging AI in e-learning: Personalized learning and adaptive assessment through cognitive neuropsychology-A systematic analysis. Electronics, 13(18), 3762. https://doi.org/10.3390/electronics13183762

Hardy, I., Meschede, N., & Mannel, S. (2022). Measuring adaptive teaching in classroom discourse: Effects on student learning in elementary science education. Frontiers in Education, 7. https://doi.org/10.3389/feduc.2022.1041316

Hernández-Campos, M., Hilliger, I., & García-Peñalvo, F. J. (2026). Assessing 21st century competencies: A two-case study on curriculum analytics to inform continuous improvement in higher education. Journal of Learning Analytics, 13(1), 57–73. https://doi.org/10.18608/jla.2026.9131

Hsieh, H.-F., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277–1288. https://doi.org/10.1177/1049732305276687

Imawan, O. R., Retnawati, H., Haryanto, & Ismail, R. (2025). The challenges of implementing computerized adaptive testing in Indonesia. Journal of Education and e-Learning Research, 12(2), 124–144. https://doi.org/10.20448/jeelr.v12i2.6677

Ingram, P. B., & Herring, T. T. (2026). Broadband symptom validity testing: Evaluating contemporary challenges and symptom-domain specificity. Current Treatment Options in Psychiatry, 13(1), 28. https://doi.org/10.1007/s40501-026-00399-8

Jeon, J., Jang, J., & Jung, S. K. (2026). Beyond student outputs: Design requirements for teacher-facing process analytics in AI-assisted block-based programming. IEEE Transactions on Learning Technologies, 19, 791–803. https://doi.org/10.1109/TLT.2026.3718805

Joshi, A., Vinay, M., & Bhaskar, P. (2020). Impact of coronavirus pandemic on the Indian education sector: Perspectives of teachers on online teaching and assessments. Interactive Technology and Smart Education, 18(2), 205–226. https://doi.org/10.1108/ITSE-06-2020-0087

Kahmann, R., Droop, M., & Lazonder, A. W. (2026). Differentiating elementary science education: Dutch teachers' perceived practices. Research in Science Education, 56(5), 1209–1223. https://doi.org/10.1007/s11165-026-10318-9

Kartianom, Retnawati, H., Hidayati, K., & Dewantara, A. H. (2026). Understanding teachers' experiences with large-scale diagnostic assessments in Indonesian Islamic primary schools: A phenomenological study. Journal of Teaching and Learning, 20(2), 376–389. https://doi.org/10.22329/jtl.v20i1.9250

Kim, H.-J., & Kim, M.-S. (2025). A needs analysis of elementary school teachers on AI-based digital English textbooks. English Teaching, 80(3), 79–99. https://doi.org/10.15858/engtea.80.3.202509.79

Kim, J., Lee, H., & Cho, Y. H. (2022). Learning design to support student-AI collaboration: Perspectives of leading teachers for AI in education. Education and Information Technologies, 27(5), 6069–6104. https://doi.org/10.1007/s10639-021-10831-6

Kogler, A., Gasteiger-Klicpera, B., Prinz, K., & Paleczek, L. (2025). Digitally assessing social-emotional skills in early school years: Initial validation of a screening instrument. Frontiers in Psychology, 16, Article 1529083. https://doi.org/10.3389/fpsyg.2025.1529083

Kron, S., Sommerhoff, D., Achtner, M., & Ufer, S. (2021). Selecting mathematical tasks for assessing student's understanding: Pre-service teachers' sensitivity to and adaptive use of diagnostic task potential in simulated diagnostic one-to-one interviews. Frontiers in Education, 6. https://doi.org/10.3389/feduc.2021.604568

Lane, R. D., & Smith, R. (2021). Levels of emotional awareness: Theory and measurement of a socio-emotional skill. Journal of Intelligence, 9(3), 42. https://doi.org/10.3390/jintelligence9030042

Levy-Feldman, I. (2025). The role of assessment in improving education and promoting educational equity. Education Sciences, 15(2), 224. https://doi.org/10.3390/educsci15020224

Liao, X., Zhang, X., Wang, Z., & Luo, H. (2024). Design and implementation of an AI-enabled visual report tool as formative assessment to promote learning achievement and self-regulated learning: An experimental study. British Journal of Educational Technology, 55(3), 1253–1276. https://doi.org/10.1111/bjet.13424

Magano, J., Silva, C., Figueiredo, C., Vitória, A., Nogueira, T., & Pimenta Dinis, M. A. (2020). Generation Z: Fitting project management soft skills competencies-A mixed-method approach. Education Sciences, 10(7), 187. https://doi.org/10.3390/educsci10070187

Martín-Rodríguez, A., & Madrigal-Cerezo, R. (2025). Technology-enhanced pedagogy in physical education: Bridging engagement, learning, and lifelong activity. Education Sciences, 15(4), 409. https://doi.org/10.3390/educsci15040409

Molnár, G., & Kocsis, Á. (2024). Cognitive and non-cognitive predictors of academic success in higher education: A large-scale longitudinal study. Studies in Higher Education, 49(9), 1610–1624. https://doi.org/10.1080/03075079.2023.2271513

Navrátilová, J. (2026). Where do the didactic efforts of teachers lead? When grouping replaces differentiation. Improving Schools, 28(1), 181–201. https://doi.org/10.1177/13654802261417520

Niman, E. M., & Divan, S. (2026). Diagnosing or documenting? Diagnostic assessment practice in primary social studies. Journal of Curriculum and Teaching, 15(3), 71–80. https://doi.org/10.5430/jct.v15n3p71

Nishida, C., Ishimoto, Y., Takizawa, Y., Katayama, T., & Matsumoto, Y. (2021). Preliminary evidence for the reliability and validity of the Stirling Children's Well-Being Scale (SCWBS) with Japanese children. International Journal of Educational Research Open, 2, Article 100034. https://doi.org/10.1016/j.ijedro.2021.100034

Ofem, U. J., Orim, F. S., Edam-Agbor, I. B., Amanso, E. O. I., Eni, E., Ukatu, J. O., Ovat, S. V., Osang, A. W., Dien, C., & Abuo, C. B. (2025). Teachers' preparedness for the utilization of artificial intelligence in classroom assessment: The contributory effects of attitude toward technology, technological readiness, and pedagogical beliefs with perceived ease of use and perceived usefulness as mediators. Frontiers in Education, 10. https://doi.org/10.3389/feduc.2025.1568306

Olofsson, A. D., Fransson, G., & Lindberg, J. O. (2020). A study of the use of digital technology and its conditions with a view to understanding what 'adequate digital competence' may mean in a national policy initiative. Educational Studies, 46(6), 727–743. https://doi.org/10.1080/03055698.2019.1651694

Oudman, S., van de Pol, J., & van Gog, T. (2023). Effects of cue availability on primary school teachers' accuracy and confidence in their judgments of students' mathematics performance. Teaching and Teacher Education, 122, Article 103982. https://doi.org/10.1016/j.tate.2022.103982

Palmer, C., Patterson, P., & Tuomainen, H. (2026). Identification matters: How data sharing affects pupil honesty and engagement in universal school well-being assessments. Journal of Adolescent Health, 79(4), 564–572. https://doi.org/10.1016/j.jadohealth.2026.06.002

Peters, M. T., Hebbecker, K., & Souvignier, E. (2022). Effects of providing teachers with tools for implementing assessment-based differentiated reading instruction in second grade. Assessment for Effective Intervention, 47(3), 157–169. https://doi.org/10.1177/15345084211014926

Rana, K., Greenwood, J., & Henderson, R. (2022). Teachers' experiences of ICT training in Nepal: How teachers in rural primary schools learn and make progress in their ability to use ICT in classrooms. Technology, Pedagogy and Education, 31(3), 275–291. https://doi.org/10.1080/1475939X.2021.2014947

Raudenbush, S. W., Hernandez, M., Goldin-Meadow, S., Carrazza, C., Foley, A., Leslie, D., Sorkin, J. E., & Levine, S. C. (2020). Longitudinally adaptive assessment and instruction increase numerical skills of preschool children. Proceedings of the National Academy of Sciences of the United States of America, 117(45), 27945–27953. https://doi.org/10.1073/pnas.2002883117

Reardon, T., Ukoumunne, O. C., Ball, S., Brown, P., Ford, T., Gray, A., Hill, C., Jasper, B., Larkin, M., Macdonald, I., Morgan, F., Sancho, M., Sniehotta, F. F., Spence, S. H., Stainer, J., Stallard, P., Violato, M., iCATS, T., & Creswell, C. (2025). Development of a brief assessment tool to identify children with probable anxiety disorders. JCPP Advances, 5(2), Article e12265. https://doi.org/10.1002/jcv2.12265

Rincon-Flores, E. G., Castano, L., Guerrero Solis, S. L., Olmos Lopez, O., Rodríguez Hernández, C. F., Castillo Lara, L. A., & Aldape Valdés, L. P. (2024). Improving the learning-teaching process through adaptive learning strategy. Smart Learning Environments, 11(1), 27. https://doi.org/10.1186/s40561-024-00314-9

Salem, M. A. (2026). An explainable educational data mining framework for misconception detection and differentiated instruction. Algorithms, 19(9), 719. https://doi.org/10.3390/a19090719

Sandoval-Ríos, F., Gajardo-Poblete, C., & López-Núñez, J. A. (2025). Role of data literacy training for decision-making in teaching practice: A systematic review. Frontiers in Education, 10. https://doi.org/10.3389/feduc.2025.1485821

Schelling, N., & Rubenstein, L. D. (2021). Elementary teachers' perceptions of data-driven decision-making. Educational Assessment, Evaluation and Accountability, 33(2), 317–344. https://doi.org/10.1007/s11092-021-09356-w

Splett, J. W., Brann, K. L., Trainor, K. M., & Shen, Z. (2023). Examining utility and impact of social, emotional, and behavioral screening to identify and address needs. School Psychology, 38(3), 137–147. https://doi.org/10.1037/spq0000540

Spyropoulou, E., Wallace, M., & Poulopoulos, V. (2025). Differentiated education using technology in junior and high school classrooms. Encyclopedia, 5(2), 71. https://doi.org/10.3390/encyclopedia5020071

Sultanova, G. (2025). Introducing non-cognitive load to the educational discourse. Frontiers in Psychology, 15. https://doi.org/10.3389/fpsyg.2024.1411102

Tsortanidou, X., Daradoumis, T., & Barberá, E. (2022). Developing social-emotional skills through imaginative teaching methods in elementary education. Early Child Development and Care, 192(8), 1201–1216. https://doi.org/10.1080/03004430.2020.1854241

van Leeuwen, A., & Rummel, N. (2022). The function of teacher dashboards depends on the amount of time pressure in the classroom situation: Results from teacher interviews and an experimental study. Unterrichtswissenschaft, 50(4), 561–588. https://doi.org/10.1007/s42010-022-00156-9

Wilson, J., Ahrendt, C., Fudge, E. A., Raiche, A., Beard, G., & MacArthur, C. (2021). Elementary teachers' perceptions of automated feedback and automated scoring: Transforming the teaching and learning of writing using automated writing evaluation. Computers & Education, 168, 104208. https://doi.org/10.1016/j.compedu.2021.104208

Xie, J., Shao, J., Wang, C., Shi, X., Miao, Q., Yip, C. C., & Ye, J. (2026). Visual cueing and adaptive learning for teaching thyroid eye disease diagnostic assessment to ophthalmology residents. Frontiers in Medicine, 13. https://doi.org/10.3389/fmed.2026.1934529

Yan, H., Lin, F., & Kinshuk. (2021). Including learning analytics in the loop of self-paced online course learning design. International Journal of Artificial Intelligence in Education, 31(4), 878–895. https://doi.org/10.1007/s40593-020-00225-z

Yavuz, E. (2026). Validity and fairness of the PISA 2018 global competence assessment: An argument-based evaluation via explanatory item response models. Humanities and Social Sciences Communications, 13(1), 570. https://doi.org/10.1057/s41599-026-06979-6

Zurbriggen, C. L. A., Schwab, S., Kalkusch, I., Neuhauser, A., Lanfranchi, A., & Klaver, P. (2025). Explaining teachers' judgement accuracy of students' subjective well-being by students' individual characteristics and the teacher-student relationship. Learning and Individual Differences, 122, Article 102754. https://doi.org/10.1016/j.lindif.2025.102754

Downloads

Published

2026-11-14