全球智库信息集成服务系统

Consistent course placement decisions can be made using all three of the replacement strategies, although much depends on the district context

• Regression-based replacement methods improve as the number of tested students increases; the districts with the least-consistent placement recommendations had fewer than 250 tested students.
• Simple replacement strategies might result in high rates of misclassification for students who have significant changes in achievement or content mastery between testing periods.
• Students whose actual scores are just above or just below the criterion for course recommendations are likely to end up with different recommendations if their replacement scores differ even slightly from their actual scores.

Assuming average school quality can be problematic for course placement decisions that are based on regression-based methods

• Because school quality varies considerably, such an assumption can have the effect of systematically overestimating some students' future achievement and underestimating other students' future achievement.

There is evidence of differential method performance based on student race and ethnicity and school poverty

• The simple replacement and multiple replacement methods do not seem to induce bias based on student demographics or school poverty, but the regression-based methods do.
• The regression models that do not include school prior achievement systematically underestimate scores for white and Asian students and systematically overestimate scores for black and Hispanic students.
• Regression-based methods tend to overestimate scores for students in high-poverty contexts and underestimate scores for their more advantaged peers.

The novel coronavirus disease 2019 (COVID-19) pandemic has created an unprecedented set of obstacles for schools and exacerbated existing structural inequalities in public education. In spring 2020, as schools went to remote learning formats or closed completely, end-of-year assessment programs ground to a halt. As a result, schools began the 2020–2021 school year without student assessment data, which typically play a role in selecting students for specialized programming or placing students into courses. Although conceptual research has emerged to support school and district decisionmaking regarding assessment during the pandemic, there has been relatively little empirical research to help guide schools and school districts on handling the impacts of the pandemic on the availability and interpretability of assessment data.

To address this gap, the authors of this report provide empirical evidence to inform schools' and districts' approaches to course placement in the absence of end-of-year assessment data. The authors compare and contrast three potential strategies that use older assessment data to estimate missing test scores: simple replacement, regression-based replacement, and multiple replacement. The authors examine the ways in which the pandemic may have influenced the consistency of decisionmaking under these strategies and the extent to which these strategies work equally well for all students, regardless of student race and ethnicity or school poverty. They also discuss these strategies' implications for schools and districts.

• Chapter One

  Introduction

• Chapter Two

  Study Background and Context

• Chapter Three

  Study Approach

• Chapter Four

  Results

• Chapter Five

  Implications for Decisionmaking in the Absence of Large-Scale Test Scores

• Appendix A

  Data Sources for This Report

• Appendix B

  Analytic Methods

• Appendix C

  Complete Results