What Can Be Learned from Educational Testing?

The Atlanta school system’s focus on test results became counter-productive, driving well-intentioned teachers to cheat so scores would improve sufficiently to avoid closure of their school, which was doing well in ways insufficiently reflected in test scores. Rachel Aviv’s excellent account of this debacle in Wrong Answer provides a good example of how concentration on measurement can lead to gaming of the system that interferes with progress. Here’s an excerpt:

One afternoon in the spring of 2006, Damany Lewis, a math teacher at Parks Middle School, in Atlanta, unlocked the room where standardized tests were kept. It was the week before his students took the Criterion-Referenced Competency Test, which determined whether schools in Georgia had met federal standards of achievement. … He photocopied the math, reading, and language-arts sections—the subjects that would determine, under the No Child Left Behind guidelines, whether Parks would be classified as a “school in need of improvement” for the sixth year in a row. Unless fifty-eight per cent of students passed the math portion of the test and sixty-seven per cent passed in language arts, the state could shut down the school. …

According to a 2013 report by the Government Accountability Office, forty states detected instances of cheating by educators in the previous two years. But Atlanta is one of the few districts in which educators have been subpoenaed. “It’s hard to find anyone in the system who wants to look under the rock and see what’s there,” Jennifer Jennings, a sociology professor at N.Y.U. who studies standardized tests, said. She noted that even in Texas, whose reform model inspired No Child Left Behind, scholars doubted whether students had progressed as rapidly as the data suggested—administrators exempted low-performing students from taking the test and underreported dropouts. …

Tim Callahan, the spokesman for the Professional Association of Georgia Educators… told me, “Our teachers’ best qualities—their sense of humor, their love for the subject, their excitement, their interest in students as individuals—are not being honored or valued, because those qualities aren’t measurable.”