UPDF AI

Systematizing Research on AI-Based Automated Assessment: A Two-Axis Review Framework for Open-Ended Responses

2026 · DOI: 10.30534/ijacst/2026/011532026
International Journal of Advances in Computer Science and Technology · 0 Citations

TLDR

A two-axis classification framework is proposed that organizes existing research by research focus and level of implementation, from offline benchmark studies to learning management system (LMS)-integrated systems, and reveals an uneven pattern of development.

Abstract

Automated assessment of open-ended responses has evolved from rule-based and statistical approaches to large language model (LLM)-based and hybrid architectures. Despite this progress, the literature remains fragmented across scoring, formative feedback, contextual grounding, reliability, and system integration. This review proposes a two-axis classification framework that organizes existing research by research focus and level of implementation, from offline benchmark studies to learning management system (LMS)-integrated systems. The framework identifies six analytical categories and reveals an uneven pattern of development: scoring-oriented studies are methodologically more mature, while grounding, formative feedback, and institutional deployment often remain at the pilot stage. The review also highlights key gaps, including the lack of end-to-end architectures, limited reactive LMS integration, weakly structured outputs, and underdeveloped workflow-oriented perspectives. The central limitation of current research is not the absence of promising components, but their insufficient integration into coherent and reproducible assessment systems.