Speaking Out: High-Stakes Misfits

By Matthew Militello
Principal, January/February 2011

It started out like any normal day—that is, until 3:15 p.m., when I went to pick up our three boys from school. I left my office and picked up sixth grader Dominic first. Next, I headed to get kindergartner Gabriel and then Luke, who is in the third grade. As they jumped into the car, my heart sank as Luke asked his older brother, “Dominic, do you have to pass the EOGs to get into middle school?”

I was dumbstruck.

Luke was referring to the end-of­ grade assessments (EOGs). Like all states, North Carolina created an assessment system as the metric of school success as per the No Child Left Behind Act. As a result, North Carolina became a high-stakes testing state, where students are not promot­ed or do not receive a diploma with­out meeting the EOG requirements.

An Educator’s Impotence

I had such a visceral reaction to Luke’s question because I knew what it meant. As an educator and researcher, I am aware of the research on high-stakes testing. Students are anxious over test­ing and clear signs of depression are becoming common. Reports indicate that students as early as elementary school begin lying about test results, commence asking siblings how they did on tests, and start showing more traditional signs of test anxiety such as stomachaches and fear.

Perhaps I was over-reacting. When I worked as a school principal, I too created a data-driven environment for my teachers, and now as a university professor I teach future school leaders how to achieve data-based leadership. I conduct research on the thought­ful, meaningful, and efficient use of school data to drive decision-making in leadership and pedagogy.

While we know these assessments are increasing anxiety and stress, states continue to promote the test as unavoidable, and administrators capit­ulate by pressing teachers to prepare their students and by encouraging test performance as early as elementary school. In fact, Luke recently brought home a flier publicizing an “EOG Power Night” that stated, “We will be sharing strategies to prepare your child mentally and emotionally for the EOGs.” Even Gabe’s kindergarten class is decorating and wearing shirts to support EOG week. T-shirts and mental and emotional preparation— are we still talking about early elemen­tary education?

A Researcher’s Dilemma

So, what’s the alternative? Tests that fit. Through my own research on the form and function of assessment systems in schools, I discovered the importance of “fit,” meaning the pur­pose of an assessment (e.g., psycho­metric properties) and the intended uses by local educators (e.g., informed lesson planning, student placement, student growth). When assessment characteristics do not match use, there is a misfit.

This is the case in North Carolina. The EOGs are given at the end of the academic year and provide data that are not useful. North Carolina is not the only place guilty of this type of misfit. My work in Michigan and Massachusetts and my research on California, Florida, New Jersey, New Mexico, and Texas also indicate that many teachers are pressed to use data to inform their pedagogy—and they most often reach for the data that are most readily available: state assess­ment results. This use is considered a misfit for two reasons: it is old data since results are from a teacher’s pre­vious year’s students, often referred to as “autopsy” data; and the results are not designed to provide local educa­tors with enough item-level detail to make pedagogical adjustments. In other words, the data are not statisti­cally designed to be used for day-to­day pedagogical decision-making.

Thus, these results are most useful to policymakers as political weaponry to wage battles (see arguments for charter schools, vouchers, and merit pay). All might be legitimate and worthwhile debates, but should our students be the anvils as such policies are forged?

What are assessments that fit? For policymakers, the answer is assess­ments that provide statistically reliable data about student achievement. For local educators, the answer is assessments that generate real-time, student-level diagnostic data. Can assessments do both? In 2001, the National Research Council made a compelling case that such assessments can and should be created. In Know­ing What Students Know, the council calls for assessments designed around modern principles of learning and rooted in strong statistical standards.

A Father’s Fear

As a father, I felt fear because of Luke’s comment. Luke expresses stress with thoughtful inquiry; I knew the test was haunting him. What, then, were my options? My first reac­tion was to pull Luke from the test. I called the school and was told, “We never had a student not take the tests.” I next began reading the myr­iad reports from the Department of Public Instruction. North Carolina law states that the EOGs are mandatory. Students who fail to meet a certain level must retake the EOG. If the stu­dent again fails to meet the standard, he or she will receive targeted inter­vention (determined by each school) before another test. Then I found an out: A review committee of teach­ers (from a different school) can be requested to review samples of the student’s work to make a recommen­dation to the school principal regard­ing promotion.

Was boycotting the test truly the best solution? I had to ask myself whether I was waging this righteous fight vicariously through my 8-year­old child. I also wondered how other parents, with less access and experi­ence in navigating educational policy, would know about options they might have for their children.

Some of the American Recovery and Reinvestment Act stimulus money has been earmarked for states to further refine their assessment systems. If data are conceived of holistically and not just focused on one large-scale achievement test, and if classroom-level teachers and parents are provided with information about student perfor­mance that can be used for immediate improvement, there is a chance that assessment can be used to improve teaching in order to affect student achievement. We must not miss this opportunity to reinvest in our assess­ment systems. This will mean assess­ments that are designed on modern principles of learning should fulfill the federal testing mandates of NCLB. Rather than adding another test, cog­nitive diagnostic assessments should replace current state assessments. Instead of only working with assess­ment companies and the psychometric community, policymakers should seek input from what the cognitive psycho­logical community has to offer and what local school educators say they need. Perhaps then, students will see and appreciate the use of the assess­ments as a teaching tool, not as barrier to the next grade that breeds insecurity and anxiety.

Matthew Militello, a former principal, is an assistant professor in educational leadership and policy studies at North Carolina State University in Raleigh.

Here’s Your Chance to Speak Out

The author feels conflicted about high-stakes testing because although NCLB requires it and principals are expected to use the resulting data to inform their decision-making, the process adds undue stress to students and the data from a single achievement test are not representative of a student’s abilities. What’s your take on the issue? Submit your thoughts at www.naesp.org/blog and click on “Speaking Out.”

Copyright © National Association of Elementary School Principals. No part of the articles in NAESP magazines, newsletters, or Web site may be reproduced in any medium without the permission of the National Association of Elementary School Principals. For more information, view NAESP's reprint policy.

AttachmentSize
Militello_JF11.pdf250.63 KB