Cutting Edge or Blunt Instrument?
I don't need any new kitchen knives, but when a former student or kid from church calls and asks to come do a knife demonstration. I warn them that while I won't buy another knife, I am happy to let them practice their presentation on me and offer them a critique on their sales pitch. So every summer I watch and am asked to evaluate just how effectively those fine knives can cut through rope with a single stroke and how powerful those all purpose kitchen shears must be to cut a penny in half. And while I watch, I wonder: When and why would I need a kitchen knife that slices rope? We almost never have rope for dinner? Under what circumstances I would I cut up my spare change?
Still, it's a smart presentation design because the focus is on the tools, not the skill of person doing the demonstration. This makes sense, because while the knives are really are high quality tools, the college age sales representatives bring more enthusiasm than knife handling skill to the process. In fact, I can vividly recall the night that night Amy came to do the demonstration. While she cut the rope with a single stroke, she also managed to slice open her finger. She bled all over my kitchen table; she nearly pass out; and it took us half an hour to get her bandaged, cleaned up and calmed down.
These home demonstrations that are designed to evaluate the efficacy of kitchen knives can provide insight into why teachers are a bit skeptical of the accolades heaped on some of the new teacher evaluation systems by education reformers. Excellent tools are important; but sometimes it's important to make sure a tool is appropriate for the job. And, no matter how good the tool and how well intended and highly motivated the user may be, the outcome is still dependent of that individual's knowledge and skill. Ttwo new teacher evaluation scenarios have received a great deal of media attention lately have been Washington, D.C. and New Haven, Connecticut, so let's take a look at those. A spokesperson for DC schools says,
What saves IMPACT is that it's clear for both teachers and evaluators. . . . There is no way a teacher can say, 'I don't understand how they expect me to plan lessons.' It's all there: setting ambitious and measurable goals, aligning each lesson with content standards, communicating goals to students." Allan Odden, a University of Wisconsin educational leadership expert, said IMPACT was "sophisticated, well thought through and, if executed well, will represent one of the most rigorous systems in the country."
Sounds like a good thing, but the Washington Teachers' Union is wary of IMPACT. Why? Because, the Washington Teachers Union has limited confidence in the skill of the those who will use the tool and have what seems to be legitimate concerns that a good evaluation tool can, and might be, used inappropriately. Some would say that unions are just like that-- resistant to accountability and protective of their least effective members. But while WTU is locked in a bitter battle over teacher evaluation with D.C. Chancellor Michelle Rhee, it's sister AFT affliate represents teachers in New Haven, Connecticut where
So what's the difference? It seems to me that the issue is not so much the instrument, but the credibility of the evaluators and a degree of trust that the evaluation results will be objective and that the outcome will be used appropriately. Here''s what my good friend, Renee Moore, who works in Mississippi, where there is no union collective bargaining for teachers recently sat on a panel for the Forum for Education and Democracy's Capitol Hill briefing. Renee said that
This is why teachers submit themselves to processes such as National Board for Professional Teaching Standards assessment, even when they have to pay for the process out of their own pocket and receive no additional compensation for this validation of their expertise. That's why it's frustrating when an editorial on the New Haven contract in the New York Times cautions that,
Now that confuses me. Does the writer really believe that teachers are obstructionists who have no stake in advancing teacher quality? Did he do his investigative work and ask teachers what they thought? Or did he just parrot what some school reform pundit told him?Teachers are regularly accused of just caring about the money and protecting their own jobs, but let's not forget that there's serious money to be made in school reform; and in order to get press, prestige, power, and a paycheck as a reformer, you need to frame the problem and come up with a solution and teachers are an easy mark. But after the children, who pay the highest price for all the adult bickering, teachers have the most to lose. Yet,
I believe most teachers value meaningful assessment of their practice, and a well designed and thoughtfully administered evaluation can be the cutting edge tool to accomplish that goal. When that evaluation comes from peers, it sets a level of expectation for all participants, it creates an opportunity for meaningful professional sharing and growth, and it empowers skilled classroom practitioners to become part of the answer and gives them ownership of their profession rather than hired labor. But, teachers have a legitimate concern that best cutting edge evaluation tool, when placed in unskilled or unbiased hands could turn out to be nothing more than a blunt object for teacher bashing.


Comments
I have heard the same thing - that teachers are tougher on each other than adminstrators - from a district in Poway, CA, that has teachers forming the majority of an evaluative panel at the district level.
Well done, Susan!
Posted by: David B. Cohen | November 6, 2009 5:05 PM
It's the old "black box" argument: we don't care how teachers teach--we care only about the results. Completely missing the point, of course: it's the instructional effectiveness that causes the student learning gain. Let me say that again: good instruction improves student learning, whether the kids are in deepest poverty or taking AP Calculus. We have to care about evaluating instruction. What happens in the black box (which is much harder to pin down, in research design) matters, very much.
Great analogy, Susan. Good tools, inept users.
Posted by: Nancy Flanagan | November 8, 2009 10:03 AM
Nicely stated, Susan, as you usually do. I appreciate your sophisticated approach to sensitive issues.
Are you suggesting that if teachers do the evaluating of each other, then it's more likely that students will increase learning as expected by parents, state, and Federal programs? Since school administrators are also mostly certified teachers, that seems like a closed evaluation circuit. So, how do you see that loop increasing the odds for student learning meeting or exceeding minimum state academic performance standards?
Posted by: Bob Heiny | November 12, 2009 10:57 AM
Ah, excellent question, Bob. From many perspectives, a principal may look pretty much a teacher with a tie and a bigger paycheck; but I would argue that while the majority of principals may have once been certified teachers, my guess is that most of them have been out of the classroom a long time. Times change and skills go rusty and that's not an indictment, it's just what happens. At twenty-one I certified for a commercial license driving a standard transmission van, but I'm pretty sure that I'd lurch down the street grinding gears today and administrator teacher knowledge and skills can get rusty from lack of use and continuing education.
Besides, we ask too much of our principals. They are expected to head of finance, facilities, personnel, security, legal, research and development,and anything else that comes along. They simply do not have time to do in depth teacher evaluations. Their ongoing professional learning has had an administrative rather than an instructional focus, so they may have only a cursory knowledge the instructional initiatives in which their teachers are being trained.
Peer assessors are probably more familiar with current curriculum content and organization. If the peer assessors are true teacher leaders, they have credibility as a colleague who demonstrates walking the walk as well as talking the talk.
Here's what I'd really like to see:
External initial and ongoing assessment of content knowledge, because content knowledge needs to accurate and current. Peer assessment of instructional skills. Parent and/or student assessment of teacher dispositions and classroom management.Administrator assessment student records and professionalism. Guided, reflective self assessment for the purpose of improved practice.
If done right, the evaluative process would be diagnostic rather than judgmental and active rather than passive. What I'm wondering now is what sort of conditions, assurances, and safeguards would be necessary for peer evaluations to be attractive to all stakeholders? What barriers would have to be removed?
Posted by: Susan Graham | November 13, 2009 12:48 AM