« NCTQ Reviews Math-, Reading-Teacher Prep in 3 States | Main | Ed. Dept. Official Says Teacher Evaluations Shouldn't Rest on Test Scores Alone »

UPDATED: Some Academics Push Back on Teacher-Student Link in 'Race to the Top'

| 4 Comments | No Recommendations

It isn't just the teachers' unions that are nervous about the draft guidelines for the Race to the Top.

I've been making my way through the thousands of Race to the Top comments, and there are a handful from some academics who argue that there isn't a strong enough research base to support the use of "value added" data for decisions involving teachers.

The inclusion of such measures in the Race to the Top guidelines appears to fly in the face of the Obama administration's promises to fund research-based approaches in the Race to the Top, these scholars contend.

Helen Ladd, a scholar at Duke University, argues that the proposed criteria would lead teachers to focus even more heavily on standardized tests, and that the value-added measures themselves are not reliable.

"Even the most sophisticated approaches typically cannot distinguish the contribution of teachers from the classroom context, and they generate estimates of a teacher’s quality that jump around from one year to the next, largely because of the small sample sizes for individual teachers," she writes.

Ladd has been involved in a number of studies associated with this research group at the Urban Institute that makes use of value-added data.

Two scholars at the Economic Policy Institute, Sean Corcoran and Joydeep Roy, reiterate a lot of the methodological issues, add that teacher effectiveness can be affected by school culture and peers (see this story for more), and contend that "teacher effects" don't seem to persist after one year. They add that there isn't a lot of data to show how such value-added data would be used to improve teacher effectiveness or instruction.

Paul Barton, a former director of ETS' policy-information center, has issues with the quality of tests now in place, the definition of growth (what does a year of growth or one grade level mean, anyway?), and the ability of value-added methodologies to separate out teacher effects from other types, such as the orderliness of schools, the adequacy of materials, instructional programs, leadership, and so forth.

"It is, I believe, an impossible task to separate the effects of each of these elements so as to assign quantitative values to each, and use this for accountability or to control for them to isolate teacher effects," he writes.

And the folks at the American Educational Research Association say that the use of test scores for teacher accountability contravenes prescribed standards in the measurement field for the use of assessments.

There is no doubt that this is a highly complicated area. The solution, if there is one to be had in this field, is that the value-added data should be incorporated with other measures of teacher effectiveness.

That's essentially the position of the teachers' union in Wisconsin, which has supported the undoing of a law in that state that blocks a teacher-student data link. My understanding is that it's also the position of the Obama administration that evaluations should consist of multiple measures.

In this blog item, I wrote about how that might be accomplished: by looking at the value-added data only at the top and bottom quartiles of effectiveness, over several years, and by incorporating information from teacher observations based on a solid set of performance standards. (Think Charlotte Danielson's framework or those used by Teach For America or those that ground the national-board certification process.)

Perhaps there is something to be learned from the Teacher Advancement Program, which uses value-added data as part of its system, and, I'm told, is doing some work to figure out whether observational ratings of teachers correlate to the value-added scores.

As a national policy agenda, though, this is only going to work if teachers think that it's doable. So if you're a teacher, what do you think? Write in and tell us.

UPDATE: Don't forget to check out Debbie Viadero's recent story on methodological issues with teacher value-added.

4 Comments

As a former teacher, I certainly agree that test scores should not be the only piece of evaluation, however, I do believe that it should be part of the equation. The best evaluation system should include multiple sources of information: standardized test data, classroom assessment data, sample lessons and units, meaningful peer and principal observations, etc.

Why not treat classroom teachers as other professionals? Physicians and attorneys are evaluated on their protocol: how well do they follow accepted practice. Think the Merck manual.

The strange thing about all this is that it is not difficult to evaluate a teacher, but of course it can't be done with a single test. Multiple measures must be used: examination of student work over time, classroom observations by senior teachers and administrators, and tests designed to measure student growth during an academic year.

People who want to measure teacher effectiveness with a single standardized test either know nothing about the subject or they have another agenda.

This is welcome news. We should also be careful about lumping all tests together. Jonathan (above) suggests standardized test scores should be part of evaluation, and I'm sure he has good reason to say so given his experience. As a high school English teacher, I have yet to see or administer a standardized test that would have any use at all to evaluate my teaching. It is impossible to use those tests in a way that separates out my influence from that of all the other teachers my students have currently and had in the past, because none of the tests cover skills or content that were introduced first in my class or practiced exclusively in my class.

Comments are now closed for this post.

Follow This Blog

Advertisement

Most Viewed on Education Week

Categories

Archives

Recent Comments

  • lauren: cell phones are what kids crave on they need a read more
  • enjoyjd: One of the most frustrating things for me, when my read more
  • marty: I was once a superb teacher. Students loved me, parents read more
  • J. S. Gephardt: I totally agree that teachers should be evaluated on a read more
  • Lisa: Senority... most parents want their children in a seasoned teachers read more