Designing, evaluating, and deploying automated scoring systems with validity in mind: Methodological design decisions

Criteria for collecting, interpreting, and synthesizing empirical evidence during the design, deployment, and operational quality-control phases for automated scoring systems are discussed, highlighting how this work is a blend of scientific rigor and artful practice.