A Meta-Analysis of Machine Learning-Based Science Assessments: Factors Impacting Machine-Human Score Agreements
A Meta-Analysis of Machine Learning-Based Science Assessments: Factors Impacting Machine-Human Score Agreements
X. Zhai,Lehong Shi,R. Nehm
2020 · DOI: 10.1007/s10956-020-09875-z
Journal of Science Education and Technology · 70 Citations
TLDR
A meta-analysis of 110 studies of MHAs revealed substantial heterogeneity in Cohen's kappa, suggesting that technical features and assessment external features might be primary targets for improving MHAs and ML-based science assessments.