May 2008 Archives

May 30, 2008

Welcome These New Edubloggers Aboard!

Here are two new blogs worth checking out:

* AccessAbility: Written by a special education writer, this blog hopes to encourage discussion on research-based special education interventions.

* Joel Packer Has All the Answers: In addition to a cheeky title, this blog will provide, "The Latest on No Child Left Behind from NEA's Top Policy Expert."

While we're talking about gender gaps - the ed policy blogosphere bears striking resemblance to "The Bachelorette." 75% of teachers are women, but 75% of ed policy bloggers are men. I'm just saying.

May 30, 2008

Cool People You Should Know: Mica Pollock

Mica_Pollock.jpg
Mica Pollock is an anthropologist who teaches at Harvard's Graduate School of Education, and studies how youth and adults struggle daily to discuss and address issues of racial difference, discrimination, and fairness in school and community settings. She has two new books coming out this summer: Everyday Antiracism: Getting Real about Race in School and Because of Race: How Americans Debate Harm and Opportunity in Our Schools. Her first book, Colormute: Race Talk Dilemmas in an American School, won AERA's 2005 book award. You can find an excerpt from Colormute below:

“This is a book about race talk – about people in one school and district struggling with the basic American choice of when and how to describe one another racially…..Americans confront the question of whether and how race should matter, as I argue in this book, every time we wonder whether to talk as if it does. As this book will demonstrate, we encounter, every day, the pitfalls inherent in this most basic act of racialization: using race labels to describe people…..Ultimately, we wrestle with the paradoxical reality that in a world in which racial inequality already exists, both talking and not talking about people in racial terms seem alternately necessary to make things ‘fair.’

Given the amount of worrying that race-label use seems to require in America, it is perhaps unsurprising that many Americans have proposed we solve our ‘race problems’ by talking as if race did not matter at all….Having witnessed three full years of struggles of talking and not talking in racial terms at Columbus [High School] – as a teacher in 1994-95 and as an anthropologist in 1995-1997 – I have come to argue explicitly what policy debates across the United States are currently implying: Race talk matters. All Americans, every day, are reinforced racial distinctions and racialized thinking by using race labels, but we are also reinforcing racial inequality by refusing to use them. By using race words carelessly and particularly by deleting race words, I am convinced, both policymakers and laypeople in America help reproduce the very racial inequalities that plague us. It is thus crucial that we learn to navigate together the American dilemmas of race talk and colormuteness rather than be at their mercy, and that is the overarching purpose of this book.”

May 30, 2008

Culture, Gender, and Math

i%20love%20math.gif
Larry Summers' fatal gaffe, in which he suggested that innate differences between men and women may explain why fewer women succeed in math and science careers, set of the latest round of the gender math wars. Though many are in a tizzy over a "boy crisis" in education, as early as the fall of kindergarten, boys outperform girls in math at the top of the distribution (i.e. if we compare girls at the 95th percentile with boys at the 95th percentile). By the end of third grade, boys outperform girls in math not just at the top, but throughout the entire distribution. These early differences persist through high school.

To pull apart culture and biology, authors of a study in this week's Science analyzed data from PISA, an international assessment which tested students in 40 countries (see USA Today coverage here). The authors linked PISA data to survey data on gender attitudes (questions like "Should women work outside the home?" and "Is it more important for a man to get a college education than a woman?"), rates of women's political and economic participation, and the World Economic Forum's gender gap index.

The gender gap in math varies substantially in size across countries, which suggests that innate factors alone cannot explain this gap. In more gender-neutral societies, girls do as well as boys in math. In Iceland, Sweden, and Norway, which are characterized by more gender equity, girls do as well or better in math. The largest gap was in Turkey. The authors also found that the reading gap favoring girls was widest in countries with more gender equity.

Here's the kicker - in a finding likely to incite those who believe girls' gains have come at the expense of boys, the authors found that overall scores in math and reading were highest in countries offering more advantages to women, and lowest in those with more gender inequities. Said study author Paola Sapienza, "This is important because it shows that advances for girls do not come at the expense of boys."

Gender equitable countries are also different in many other ways, so it's possible that other factors explain these findings. Nonetheless, these findings serve as a potent reminder that the gender gap in math achievement is not driven by nature alone.

May 29, 2008

Mike Petrilli and the Fat Police

sundae.jpg
Every April 1, the Education Gadfly releases its very funny April Fools issue, a collection of mock education-news stories that generates double-takes in readers’ offices around the country. Apparently April Fools Day falls a little late this year.

According to this week’s issue of the Education Gadfly, teachers unions are not only making teachers lazy, but also fat. In what Mike Petrilli dubs the “teacher obesity epidemic,” schools collectively spend more on health insurance costs to treat overweight teachers than the state of Maine spends on its entire K-12 system in a year.

The problem, Petrilli claims, lies in collective bargaining agreements with “overly-generous” health benefits. Petrilli’s prescription for fixing the teacher obesity epidemic is simple: “stop giving health care away for free.” When teachers are “oblivious to the cost of medical care,” he writes, they have little incentive to monitor their own health, leaving it to taxpayers to pick up the tab. Other industries ask employees to bear some of the burden of their healthcare costs through higher premiums, suggesting that incentives there are more properly aligned.

There are more things wrong with Petrilli’s analysis than can be covered here, so let’s just tackle a few:

1) Teachers’ health care is not free. Even if all teachers pay a zero out-of-pocket premium for health care services, this does not imply "free" health care.

Economics 101 demonstrates that employees will bear at least some of the burden of higher employer health costs through lower wages. (In other words, more attractive health benefits will be partly offset by lower wages.) To use Petrilli’s tax analogy, buyers are still affected by a tax—through higher prices—even when that tax is formally paid by the seller.

2) Teachers’ health care benefits are not that generous compared to other industries. Petrilli cites the BLS statistic that “schools spend about 16 cents on health insurance for every dollar they pay in salaries,” which he and others suggest is much higher than in other sectors. But this statistic ignores the fact that teachers are usually paid over 9 months, not 12. If insurance is provided year-round, but salaries cover 9 months, of course this ratio is going to be high.

3) In education or elsewhere, few health plans provide proper incentives to maintain a healthy weight. Yes, private firms make their employees pay higher premiums, but few health plans directly tie employee out-of-pocket costs to obesity (or smoking, drinking, or other negative health behaviors). In other words, a higher premium alone does not create an incentive to eat right.

There may or may not be a “teacher obesity epidemic” in the United States. But one would hope that a rigorous analysis of teacher weight would address factors such as differing work conditions in teaching, as opposed to simply taking yet another swipe at teachers and their unions. (And are teachers less overweight in non-collective bargaining states?!)

Teacher obesity aside, Mike and the Fat Police can sleep easy with the knowledge that my avatar's proportions are a healthy 34-24-34.

May 29, 2008

Educating a New Majority: The Condition of Education 2008

The National Center for Education Statistics released the 2008 Condition of Education report this morning. If you need any basic stats on education – early childhood through post-secondary – this 300+ page report is for you.

In this year's report, the NCES drew attention to the changing demography of American schoolchildren. Minority students make up 43 percent of American public school enrollment, and higher proportions in the South (48%) and West (55%). One in five children speak a language other than English at home. The graph below shows demographic enrollment trends from 1986-2006 by region.

Minority%20enrollment.jpg

Also striking is the extreme racial segregation of our schools. No, it’s not new news – but these figures never fail to astound me. 31% of African-American students attend schools that are 75% or more African-American, while 64% of white public school students attend schools that are 75% or more white. The graph below shows a slightly different cut of the segregation data – the proportion of students in each racial/ethnic group that attend schools with various concentrations of minority students.

Minority%20concentration.jpg

May 28, 2008

Kopp Out

pondiscio.jpg
Last week, Robert Pondiscio put forth an ingenious proposal to leverage the service of recent college grads who teach for two years through Teach for America:

Instead of throwing TFAers into the worst teaching situations in the cities you serve, place them in some of the best, highest-performing schools….Place them in that high-functioning school for two years as pinch-hitters for some of our best, most experienced teachers, and send those master teachers to the same schools to which you’re sending TFA corps members now. We can call it the Teach For America Fellowship, and throw in a nice extra chunk of change to incentivize those master teachers.

Kopp rejected the idea. Here’s her argument, and my thoughts on each point:

1) It is a rare person who has what it takes to excel as a teacher in a low-income community, and it’s not at all a given that teachers who do well in more privileged communities will do well in urban and rural areas.

Sure. But is there any reason to believe that the most talented experienced teachers who are willing to teach in a high-needs school for two years will do worse than recent college grads with no teaching experience?

2) The individuals who come to Teach For America are coming because they want to work with the nation’s most disadvantaged children (and it is unlikely that most of them would decide to channel their energy toward teaching in more privileged contexts).

This is an empirical question. Many recent college grads understand that they would be doing a greater service to disadvantaged kids by putting an exceptional experienced teacher in that classroom – certainly many of my undergrads who’ve considered TFA have thought about this issue. Those who want to teach for more than two years might value learning to teach in a supportive environment. And let’s be honest – many TFA applicants gravitate towards TFA simply because it is selective. Finally, Robert’s proposal need not supplant TFA’s current recruitment efforts; this fellowship could operate as a stand alone program.

3) The recent Urban Institute study that looked at the impact of high school teachers in the state of North Carolina over a six-year period provides evidence that our strategy has a positive impact for kids.

We have discussed the generalizability of this study at length on this blog (see Teach for America Study Wrap Up and In Which We Make Sweeping Generalizations from a Sample of 69 Teach for America Teachers in North Carolina). Beyond those caveats, this study provides little insight into the likely effects of Robert’s proposal.

Why not? The Urban Institute study does not examine the distribution of teacher effects for experienced teachers – i.e. how effective are the top 10% of experienced teachers? Instead, it focuses on the average effects of TFA teachers versus experienced non-TFA teachers. Average effects are not helpful in evaluating the potential effectiveness of a program that would select the most exceptional experienced teachers.

4) Our strategy of channeling the energy of the nation’s future leaders into urban and rural schools is important for the long-term effort to ensure educational excellence and equity…Their initial teaching experience in under-resourced communities is foundational to their lifelong commitment to effecting the systemic changes necessary to ensure educational opportunity for all.

If Kopp’s point 2 is correct – TFA applicants are dedicated to improving the lives of the most disadvantaged children – this commitment pre-dates, though perhaps is bolstered by, their TFA teaching experience. And as many other bloggers have suggested, the TFA commitment could be lengthened to three years – two years in a low-needs school, and one in a high-needs school.

Robert, you should run with this idea - whether it is supported by TFA or another organization. Worst case scenario - we would gather useful data on a number of important teacher quality questions. Best case scenario - this "classroom swap" helps staff the toughest schools with the best experienced teachers, and disadvantaged kids benefit immensely.

May 28, 2008

New Verbs to Describe City Council Hearings: Hissing, Spanking, Chasing

Hissing%20Cobra%20Small%20.MA183.jpg
Here's a round-up of yesterday's budget hearings: Chancellor Talks of Cuts for Schools, Amid Hissing (NYT), City Council Spanks Chancellor Klein Over School Aid Cuts (Daily News), School Budget Showdown (Gotham Gazette), and Rollback Set in Schooling of the Gifted (NY Sun). (Sidenote on City Council hearings: one Columbia Law School reader reports that the footage of The Great Liebman Chase of 2007 made rounds in his Criminal Law course.)

We still have scant details on the "$200 million in central cuts." As of this morning, David Cantor at the NYC Department of Education has not responded to a request for an itemized list of these "central cuts." Here's the best detail I've got (from Klein's powerpoint at yesterday's City Council hearing):

*$21 million from Central. For example,
- Reducing 80 positions (3% of central headcount)
- Reducing NYC Teaching Fellows tuition and stipends
- Reducing IT consultants

* $7 million from Field Offices. For example,
- Reducing 101 positions (4% of field staff)
- Reducing Integrated Service Center staff

* $30 million from Support Services. For example,
- Reducing custodial funding

* $120M from Operational efficiencies and savings. For example,
- Identifying purchasing efficiencies in buying things like trade books
- Reducing amounts of accrual budget at the end of the fiscal year

* $23M from Reduced Program expenditures. For example,
- Reducing Quality Review expenses by transitioning to in-house reviewers and moving to every 3 years for A/WD schools and every 2 years for B/P or higher schools
- Reducing number of periodic assessments in ELA and Math from 5 to 4 a year and shifting to more Web-based professional development

Do you have other ideas for central cuts? Could we spare a benchmark test? The Leadership Academy? Return the level of central staffing back to its 2004 level (a layoff of 366 Tweed staff)?

May 27, 2008

In NYC, Tis the Season for Sacrifice

breadline.jpg
A few weeks ago, a solemn President Bush revealed that he honors our soldiers' sacrifice by abstaining from golf. "I think playing golf during a war just sends the wrong signal," he explained.

It was in this spirit that Chancellor Joel Klein appeared before the City Council this morning. Klein dedicated his presentation to the heroic central cuts endured by his bureaucracy. While salty tears welled up in my eyes, I noticed that one slide was missing. Paragons of restraint that they are, the New York City Department of Education has only increased central staffing levels by 18% over the last three years. In October 2004, there were 1984 central staff. By February 2008 there were only 2350.

nyc_growth.jpg

Some administrative divisions of Tweed, though, are hurting more than others. Please stand while I salute these departmental role models:

* In October 2004, the Department of Assessment and Accountability had 19 staff. In February 2008, they had 80 - that's only a 321% increase.

* In October 2004, the Division of Human Resources had only 235 staff. In February 2008, they had 370 - a 57% increase.

* In October 2004, the Office of New Schools had 14 staff. In February 2008, its spawn, the Office of Portfolio Development, had 36 - a 157% increase. (See 2005 and 2008 data for all headcount figures; these are central staff paid for with tax-levied funds.)

As New York City schools face budget cuts of up to 6%, New York City parents and kids are grateful to the Department of Education for making the sacrifices necessary to send us the right signal.

May 23, 2008

skoolboy wonders: Could a Parrot Pass the New York State ELA Exam?

spiffboy2.jpg
A few days ago, A Voice in the Wilderness broke the story that the retest for the New York State English Language Arts exam had a task that required students to write a position paper arguing that inexperienced people can provide leadership, after listening to a speech by Wendy Kopp, founder of Teach For America. Some were appalled by the one-sided nature of the task, likening it to propaganda. eduwonkette’s take was that the task would be more defensible if students were given information on both sides and then asked to choose a side to argue.

The scoring guide for the task is now available on line, and it leads me in a different direction. I’m not close enough to high school English classrooms to know what a realistic level of competency is.

Here’s the task. Students were told that they would listen to a speech about young people who have become leaders in their communities. They were provided with the following situation:

Your leadership group has been debating whether leaders should have experience in their chosen fields. As part of this debate, you have decided to write a position paper in which you argue that inexperienced people can provide leadership. In preparation for your paper, listen to a speech by Wendy Kopp. Then use relevant information from the speech to write your position paper.

Students were instructed to be sure to : Tell your audience what they need to know about why inexperienced people can provide leadership; Use specific, accurate, and relevant information from the speech to support your argument; use a tone and level of language appropriate for a position paper for members of your leadership group; Organize your ideas in a logical and coherent manner; Indicate any words taken directly from the speech by using quotation marks or by referring to the speaker; and Follow the conventions of standard written English.

The passage, reproduced below, is from Wendy Kopp’s commencement speech at the University of North Carolina in 2006.

Thinking back to my own senior year in college, I wasn’t intending to start something like Teach for America—or to start anything at all for that matter. As a college senior I was applying to two-year corporate training programs, seeking out political internships, and generally struggling in my search for something that I really wanted to do. My generation was dubbed the “Me Generation.” People thought all we wanted to do was focus on ourselves and make a lot of money. But that didn’t strike me as right. I felt as if thousands of us talented, driven graduating seniors were searching for a way to make a social impact but simply couldn’t find the opportunity to do so.

Well, during my senior fall, I helped organize a conference about education reform, where one of the topics was the shortage of qualified teachers in urban and rural communities. It was at that conference that I thought of an idea: Why doesn’t our country have a national teacher corps that recruits us to teach in low-income communities the same way we’re being recruited to work on Wall Street?

From that moment, I was possessed by this idea—I thought it would make a huge difference in kids’ lives, and that ultimately it could change the very consciousness of our country, by influencing the thinking and career paths of a generation of leaders.

So I did the obvious thing. I wrote a long and very passionate letter to the President of the United States suggesting he start this corps. That didn’t get very far—I received a job rejection letter in response. So in my undergraduate senior thesis, I declared that I would try to create such a corps myself, as a non-profit organization. When my thesis advisor looked at my budget, which showed that to recruit 500 new teachers into this corps during the first year would cost two-and-a-half million dollars, he asked me if I knew how hard it was to raise $2,500, let alone two-and-a-half million dollars. Aided by my inexperience, I was unphased by his question. When school district officials and potential funders laughed at the notion that the Me Generation would jump at the chance to teach in urban and rural communities, their concerns, too, went unheard.

That year 2,500 graduating seniors competed to enter Teach For America, in response to a grassroots recruitment campaign—flyers under doors since there was no email back then! And one year after I graduated, with two-and-a-half million dollars in hand from the corporate and foundation community, I was looking out on an auditorium full of 489 recent college graduates who had joined Teach For America’s first corps.

My very greatest asset in reaching this point was that I simply did not understand what was impossible. I would soon learn the value of experience, but Teach For America would not exist today were it not for my naivete.

I see this same phenomenon every day as I watch 23-year-olds walking into classrooms and setting goals for themselves and their students that most people believe to be entirely unrealistic. The conventional wisdom is that there is only so much schools can do to overcome the challenges of poverty and the lack of student motivation and parental involvement that is perceived to come with it. But then there’s Liam Honigsberg, a Teach For America corps member in Phoenix whom I met a couple of weeks ago. His school’s vice principal saw that he had a degree in cognitive neuroscience and, naturally, called him the day before school started to ask him to teach a math class wholly comprised of seniors who were in danger of not graduating because they had not been able to pass the math portion of the state’s exit exam. It was a daunting task. Liam’s students seemed to be entirely uninterested in math. Their performance levels ranged from not having passed algebra to not having passed geometry. But Liam determined that they could and would gain the skills to graduate. The Arizona Republic estimated last year that 5,000 students didn’t graduate in Arizona because they didn’t pass that exit exam, and yet thanks to Liam’s idealism, all of his students will walk across the stage this spring.

Just over 100 miles from here, Tammi Sutton and Caleb Dolan were teaching middle schoolers in Gaston County. Tammi and Caleb were just 25 years old when they decided that to truly ensure their students had the opportunities they deserved, they would have to actually go out and start a new school in their community—a school that would set their students up to go to college. This was a pretty radical idea in Gaston County and there were many skeptics. In spite of the many who said it could not be done, Tammi and Caleb designed a program with rigorous expectations that would run from 7:30 in the morning until 5 at night, on two Saturdays a month and three weeks during the summer.

There were many who said this could not be done. Yet now their 8th graders—students who came to them in 5th grade performing anywhere between the 1st to the 4th grade levels—are performing at a level that places their school among the state’s top 15 schools in reading, writing, and math.

Teach For America’s story, and Liam, Tammi and Caleb, show us that your inexperience is a real asset. I hope you will put it to good use.

Here’s the anchor paper, scored 4, the top score (in a scale from 1 to 4). Text verbatim.

As shown in Wendy Kopp’s speech, experience is not required to be a leader. I believe leaders can be anyone who has the drive and motivation to be seccessful in the task that is at hand. Experience is aquired through years of doing the same thing over and over again, leadership does not require that.

Wendy Kopp, the woman who stated Teach for America, was inexperienced when she started the program, yet she was very seccessful. She had the drive and motavation necessary to be a leader and never gave up. Many people believed her program would never be a success because her generation was dubbed the “me” generation. The “me” generation is a generation in which money and themselves are all that matter. However, peoples thoughts about how her program would never be a sucess did not stop her. Wendy Kopp started out by writing a letter to the president, this was unseccessful. She decided to write her undergraduate thesis on her idea for Teach for America and the teacher told her it was not possible, it required too much money. Wendy was still determined, so she went to buisnesses to asked for donations and she got laughed at. They believed she could not do it. She believed her generation had people who wanted to make a social impact. Urban and rural areas needed experienced teachers and her program was designed to help. Once she finally got the money, her program was a success, about 489 recent graduates joined her program.

Liam is a part of Teach for America. He was determined to make every senior in his class graduate, although, he did not have much support because many people thought they were hopless cases. Liam taught in Arizona, in a class of seniors who needed to pass a math exam to graduate. In Arizona about five thousand students did not graduate last year. Liam’s did.

Then there was Tammy and Caleb. They started a new school in Gaston County to teach children that were considered hopeless. Tammy and Caleb took 5th graders who were considered at the 1st to 4th grade level and made them model students by 8th grade. Thier school is now a top school.

Experience is not needed to be a effective leader. Motivation and determination is all that is necessary. Wendy Kopp is the proof of that.

The scoring commentary states the following:

Meaning: The response reveals an in-depth analysis of the text making clear and explicit connection between information and ideas in the text and the assigned task.

Development: The response develops ideas clearly and fully, making effective use of relevant and specific details from the text to argue that inexperienced, but determined, people can provide leadership.

Organization: The response maintains a clear and appropriate focus on how motivation and determination, rather than experience, are necessary for leadership. The response exhibits a logical and coherent structure through use of appropriate transitions.

Language Use: The response uses appropriate language, with some awareness of audience and purpose. The response occasionally makes effective use of sentence structure or length.

Conventions: The response demonstrates partial control of conventions, exhibiting occasional errors in spelling, punctuation, capitalization, and grammar that may hinder comprehension.

So readers, what do you think? Is the problem here the task, or what’s scored as an excellent response to it, or both?

May 22, 2008

Sol Stern and the SUTVA Shenanigans

reading%20first.jpg
Sol Stern's new article on the Reading First study shenanigans offers a window into the central challenge of randomized experiments in education. That challenge is the violation of the Stable Unit Treatment Value Assumption (SUTVA) required for clean causal inference in randomized experiments. As articulated by ninja statistician Don Rubin, the most common violation of SUTVA involves "interference between units."

What does interference mean? The idea is that Serena's outcome should not be affected by whether her peers Blair and Vanessa were assigned to the treatment or control condition. In other words, one subject’s outcome should depend only on the treatment to which that subject is assigned, not on the treatment assignments of other subjects. But in many social settings, there are peer effects and social spillovers and, as a result, others' treatment assignments likely do affect one's own outcomes. Vaccinations provide another clear example - my risk of contracting a disease is dependent on my exposure, which is in turn affected by whether others have been vaccinated. In the case of Reading First, one school's treatment likely affected what other schools in the district did, as Stern details in his article.

The lesson here is not just about the Reading First study. Experiments in social science are fundamentally different than experiments in medicine, and it turns out gold standard is often more silver or bronze than we would have hoped. Don't get me wrong - I still dig experiments - but I'm not counting on them to solve all of the problems that vex our schools.

May 21, 2008

Suggestions for a Summer Reading List?

Koretz.jpg
It's about that time, folks - what are you planning to read this summer? I've just started this book by Dan Koretz, Measuring Up: What Educational Testing Really Tells Us, and I highly recommend it. Also on my list for the summer are:

* Finders and Keepers: Helping New Teachers Survive and Thrive in Our Schools (Susan Moore Johnson)
*Towards Excellence and Equity: An Emerging Vision for Closing the Achievement Gap (Ron Ferguson)
* Standards-Based Reform and the Poverty Gap: Lessons for No Child Left Behind (Adam Gamoran, editor)
* Learning in a New Land: Immigrant Students in American Society (Carola Suarez-Orozco, Marcelo Suarez-Orozco, and Irina Todorova)
* The Missing Class: Portraits of the Near Poor in America (Katherine Newman and Victor Chen)
* The Race Between Education and Technology (Claudia Goldin and Larry Katz)
* Marked: Race, Crime, and Finding Work in an Era of Mass Incarceration (Devah Pager)
* Because of Race: How Americans Debate Harm and Opportunity in Our Schools (Mica Pollock)
* Punishment and Inequality in America (Bruce Western)
* Race, Schools, and Hope: African-Americans and School Choice After Brown (Lisa Stulberg)
* Test Driven: High-Stakes Accountability in Elementary Schools (Linda Valli, Robert Croninger et al.)

Anyone have other suggestions? They need not be education books.

May 21, 2008

skoolboy's Platinum Law of Educational Research

spiffboy2.jpg
eduwonkette's "Iron Law of Qualitative Research in Education" is that the number of participants in the study should exceed the number of authors on the paper. Ha-ha, very funny, but the subtext is that (a) we cannot learn anything of value from studies that have small sample sizes; (b) qualitative research often has small samples; (c) therefore, we can't learn very much from qualitative research. Eduwonkette would protest that that's not what she's saying at all—"qualitative research is critical to educational research and policy," and I know that she does believe this. But poking fun at a paper reporting qualitative data without explaining why does her readers, and those who believe that qualitative research can be of great value, a disservice. I'd like to upgrade eduwonkette's Iron Law to skoolboy's Platinum Law of Educational Research: Poorly designed and conceived research is poorly designed and conceived research, regardless of the sample size.

I'll leave a defense of research using small samples for another day, and focus on why I think that the paper eduwonkette drew to our attention is poorly designed and conceived. I don't want to go on too long about this—there's a lot more to say than will hold the attention of casual readers—but here's the gist. The authors claim that teaching for social justice evokes a range of emotions in novice teachers, and they seek to understand the strategies that teachers use to navigate their emotional responses, and the implications of those strategies for their self-understandings and practices. I found the concept of socially just teaching confusing, but I'll accept the possibility that there are teacher education programs and novice teachers that are committed to the idea of teaching in ways that promote the life chances of members of marginalized groups in society, such as the poor and racial/ethnic minorities. In this paper, teaching for social justice is taken for granted as a good thing, which I know vexes some readers here, and the study seeks to build on previous work on emotions and emotional navigation in teaching. It's not news that teachers often express ambivalence about their work, and that they might struggle with how to respond to feelings of ambivalence.

The authors introduce the term critical emotional praxis to characterize the role of emotions in socially just teaching. This is not an analytic term emerging from their analysis of data on how teachers manage emotions in their work; rather it is a normative term—that is, a term that describes what the authors think the role of emotions in teaching for social justice should be. In their view, critical emotional praxis involves understanding the role of emotions in engaging with unequal power relations in classrooms and society; acknowledges the interplay between a teacher's local context and her emotional responses; and moves from a theoretical understanding of emotion to a practical set of relationships and teaching practices that promote teaching for social justice. I find this concept to be of minimal value for research purposes, since it has no apparent relationship with observations of teachers' practices and emotional states.

The purpose of the study is to describe how a novice teacher seeking to teach for social justice navigates her ambivalent emotions. The authors don't offer an explanation of why a case study of a single teacher is appropriate to address the questions they pose about emotional navigation in teaching. In this particular study, one of the authors observed the teacher for 80 minutes per day during the final 9-week period of her first year of teaching, and interviewed the teacher six times for two to three hours at a clip. The teacher's department chair and 10 students were interviewed as well. A year later, an author interviewed the teacher once for three hours, and did two more 80-minute classroom observations. Although the authors acknowledge some of the problems associated with the fact that the subject of the study was a former student of one of the authors, a teacher educator who taught her about socially just teaching, these problems are not adequately addressed in the research design.

What are some of the key findings of the research? One pertains to the teacher's mode of response to her emotions. The teacher, Sara, began seeing a professional counselor in December of her second year of teaching. She also enrolled in a course on nonviolent communication, and began sponsoring her school's forensics team. These three concrete modes of response, the authors contend, gave her insight into her self and emotions, and provided concrete strategies for relaxing, having fun, and balancing her feelings of sadness stemming from her observations of social injustice. With what consequences? She quit teaching, leaving her school and volunteering at an orphanage and school in a developing country.

What's wrong with this picture? I think the authors lacked a theory of when novice teachers might develop feelings of ambivalence and seek out strategies for coping with them. In this study, most of the action took place in the teacher's second year of teaching, and the primary source of data on these strategies is a retrospective interview conducted at the end of the second year. Therefore, the authors missed most of the action, and can only provide a bare-bones understanding of even this one case. Moreover, the fact that this teacher left the field of teaching raises serious questions about whether this case can inform teacher education in the ways that the authors hope. One reading of the results is that the teacher's leaving of the field is prima facie evidence that her strategies for coping with the feelings of ambivalence associated with seeking to teach for social justice didn't work; and although we can certainly learn from strategies that don't work, a study that shows strategies that do work would likely be more valuable.

The problem with this paper is that the intellectual payoff is nowhere near commensurate with the amount of space it took up in a major journal—45 journal pages, from start to finish. I agree with eduwonkette that it doesn't reflect well on the field of education research to have papers which make marginal contributions taking up so much airtime, and the time I spent reading this paper is lost forever—time that I could have spent in other, more valuable ways, like updating my Facebook page or grading papers.

But: the take-away message here is not that a study with a small sample—even an N of 1!—cannot contribute new knowledge to the field of educational research. It's that a badly designed and executed study won't contribute much. And bad design and execution have to do with a lot more than sample size.

May 20, 2008

Violation of the Iron Law of Qualitative Research in Education, #1,321

The Iron Law: The number of participants in the study should exceed the number of authors on the paper.

Yet I opened up the latest issue of the American Educational Research Journal to discover a violation of said rule in the article, "The Emotional Ambivalence of Socially Just Teaching: A Case Study of A Novice Urban Schoolteacher," which has two authors. Got to love the "convenience sample" - the novice teacher is a former student of one of the authors. Jay Greene, I am totally going to dominate your bingo game with one article only.

No disrespect to qualitative research intended here - in fact, I believe qualitative research is critical to educational research and policy. But qualitative research comes in many flavors (as does quantitative research), and studies like this one do not help the cause.

May 20, 2008

Gender Bender: The AAUW's New Report on Gender Equity

The American Association of University Women released a 124 page report this morning debunking the myth of a "boy crisis" in education. Lots of long-term NAEP and ACT/SAT trend data to mull over.

The real trend story, though, is not about test scores, but about how girls have overtaken boys in college completion. 65% of all bachelor’s degrees were awarded to men in 1960; by 2005, women received 58% of all bachelor’s degrees. Gender disparities are even greater among some minority groups, with women earning 66% of all bachelor’s degrees awarded to African-Americans, 61% of those awarded to Hispanics, 60% of those awarded to Native-Americans, versus 57% of those awarded to whites.

Beyond the impact of the women's movement, my money is on girls' advantage in non-cognitive skills (i.e. motivation, sticktoitiveness, engagement) which may have grown over time, or alternatively there may be increasing returns to non-cognitive skills in finishing college. No evidence for this assertion - just a hunch. Feel free to offer other interpretations of the graph below, which shows trends in BA attainment by race and gender from 1971-2006.

AAUW%20college.jpg

May 19, 2008

Geeked Out Monday Links

sirmixalotmackdaddy7pk.jpg
1) Oh data!/ I wanna get wit-cha/ Regress and fit-cha: More evidence that I am a nerd, but so are you, all you ed researchers and data-driven teachers who read this blog. "Baby Got Back" gets remixed as "Baby Got Stats, " i.e.: But when you get some data / And you put it in Stata/ And it’s spits out a beta of 10 / You get sprung. Can't Fordham put together a respectable rap about ed policy?

2) Seeing Like a State: The small world debate returns at Edwize.

3) Great Column on Value-Added: "On April 24, 2008, heteroskedasticity became my all-time favorite word." By the manager of program investments at the Chicago Public Education Fund.

4) The Ethics of Expert Mumbling: A Sherman Dorn confessional.

5) Newt Gingrich and Me: Dan Brown asks for Newt Gingrich's hand in marriage and then debriefs the ED in '08 blogger summit.

6) Worst of the Blogs: Corey of Thoughts on Ed Policy throws down.

7) What Will Have Less of an Impact on Ed Policy Than Tonight's Gossip Girl Finale? Probably Bill Ayers' tenure as VP of AERA, but Matthew Tabor and Mike Petrilli are still worried.

May 19, 2008

Should State Tests Require Students to Advocate for Specific Education Policies?: NY's ELA Test on Teach for America

kopp.jpg
A Voice Cries Out reports that this year's high school ELA retest required students to complete the following task:

Today’s ’situation’ told students that they were in a leadership team who has been debating ‘whether leaders should have experience in their chosen fields.’ They were instructed to write ‘a position paper in which you argue that inexperienced people can provide leadership.

They weren’t even given a choice about which position to take.

They then had to listen to a speech by-you guessed it-Wendy Kopp, about why she started Teach For America. In the speech, Kopp talks about how her lack of experience served to her advantage when creating Teach For America. In the speech she explains that TFA teachers, “challenge the conventional wisdom” that schools are limited in what they can do to ‘overcome the challenges of poverty and the lack of student motivation and parental involvement that is perceived.”


This takes us back to the social justice debate, in which we discussed how schools should and shouldn't deal with contentious issues in the classroom.

So is this fair game for a state test? Those who have pointed out schools' trespasses on social and political issues are generally cool with TFA, but what if the prompt instead instructed students to argue that schools need more funds to be effective, or that unions have a positive impact on public education? I reckon that some ed wonk/wonkettes' heads would explode.

To me, the problem with this question is that it didn't offer a counter-position, nor did it allow students to choose a side to argue.

May 19, 2008

School Closings and Teacher Salaries in New York City: There's Something For Everyone Here

Last fall, the New York City Department of Education graded each of its schools on an A-F scale. Schools were warned that those with Fs – there were 49 altogether - faced closure. Shortly thereafter, the New York City Department of Education announced its intention to close 14 schools. Somewhat perplexing was that 6 of these schools had earned Ds on their progress reports. Why would the Department of Education, we wondered, close D schools before F schools if it believed in its own Progress Report system?

Theories abounded. A widely circulated explanation reasoned that Klein et al. were hell-bent on rooting out experienced – and thus expensive – teachers. If this was the case, closing schools should have higher average salaries than other D and F schools that are not closing.

The tables below, derived from school-based average teacher salaries, do not suggest that schools with higher average salaries are more likely to be shuttered. Below, I’ve cut the data three ways – first looking at closing and non-closing salaries for both D and F schools, and then breaking these data out separately for D and F schools. One exception is among F high schools, where the school that is closing has the highest average teacher salary. There are 7 other F high schools with salaries ranging from $57,289 to $69,154; Canarsie High School has an average teacher salary of $72,370.

But there’s something in this post for everybody. Many have speculated that the district is closing large high schools and replacing them with smaller ones, in part, to drive out experienced teachers.

What’s clear is that smaller high schools have substantially lower average teacher salaries than the larger high schools that they’re replacing. (See the graph below.) Schools with fewer than 400 students have average salaries of $61,293, while those with more than 3000 students have average salaries of $71,296. While we can’t confirm the district’s intent, the effect of closing down large high schools has been to replace experienced teachers with inexperienced ones.

High%20school%20salary%20by%20size.jpg

Salary.jpg

* Note: The data I presented on Friday come directly from schools' Galaxy budgets; these data are from an aggregate Fair Student Funding file, and thus the salaries reported for individual schools are not identical.

May 16, 2008

Brain-Based Education: Don't Get Snookered!

Brain_Witelson.jpg
"Brain-based education" is K-12's latest fad. Dan Willingham, a professor of psychology at the University of Virginia, has put together a 10 minute video about what we know - and what we need to know - about brain-based education. If you know nothing about cognitive psychology (like me) but want to size up this trend, this video is a helpful introduction. Kudos to Dan Willingham for putting this resource together.

May 16, 2008

In Which We Make Sweeping Generalizations from a Sample of 69 Teach for America Teachers in North Carolina

A special shoutout goes to the New York Times editorial board for making national policy recommendations based on the Urban Institute's study of Teach for America in North Carolina, which included a whopping 69 Teach for America teachers - a .5% sample of all TFA teachers placed during those years. The study found that North Carolina TFA math and science teachers produced results slightly better (about a tenth of a standard deviation) than experienced teachers in the same school. Because every state in the country is just like North Carolina, the NYT argues that "states that want students to do better in math and science need to focus recruitment on more selective colleges instead of on traditional teacher education programs, which are often little more than diploma mills."

There is a long discussion of that study here. As I wrote then:

I’m all for Teach for America as a stopgap, but the achievement gap claim is fanciful thinking. Why? By comparison, the black-white gap in NAEP math achievement in grade 12 is approximately 1 standard deviation (and is likely larger because many black students have left by grade 12). An advantage of .04-.1 standard deviations over teachers with 3-5 years experience in the same school is not going to significantly close the achievement gap. This is not an advantage over teachers in the nearest suburb or the best schools in the city that don’t staff TFA teachers, and is hardly a convincing rationale to permanently staff tough schools with a revolving corps of academically talented 2-year teachers.

May 16, 2008

Teacher Salaries, ATRs, and Closing Schools: A Preview

I've got NYC's school-level teacher salary data fired up, and will write a few posts using these data next week. Here's a preview. New York City is slated to close 14 schools this year, though many will not close immediately, but will phase out over the coming years. Per the whole "Absent Teacher Reserve" (ATR) debate (here, here, here, and here), how many teachers are employed at these schools, and what are their average salaries?

These schools employ a total of 822 teachers, and a number of these schools have relatively high average salaries. Given current budgeting rules, through which schools are allocated dollars rather than positions, what's the chance a principal will, all else equal, hire an excessed teacher from Franklin K. Lane who makes $80,000 when he can hire a teacher with 3 years experience for about $46,000? (See the teacher salary scale here.)

If you've got questions that you'd like to see answered using the teacher salary data, please leave me ideas below.

closing-schools-salary.jpg

May 15, 2008

Dean Millot's Comment on the Ayers AERA Affair

deanmillot-blog.jpg
Regarding the Ayers affair, Dean Millot posted the following comment below and over at Flypaper, but it is worth reprinting in full:

I'm a lawyer now involved in k-12 education with a long background in national security.

Putting on my lawyer hat - Ayers was a fugitive from justice, but all charges against him were dropped in light of prosecutorial misconduct.

Putting on my national security hat - to describe him and the Weather Underground as terrorrists is a bit of hyberbole. As a tactic of political struggle, terrorism refers to the indiscriminate use of force against innocents. The Weather Underground targeted government and military facilities - and warned potential victims prior to their actions. Their actions were criminal, but they were not Al Quada, the IRA, Bader-Meinhoff, or the Red Army faction. It devalues the serious nature of terrorism to slap the label on every misguided or even deranged person with a bomb.

Putting on my k-12 hat, the man may have radical views, but presumably members of AERA havent found them to be a bar to his role in an norganization nfocused on research. If AERA is too radical for some, they might form a separate group.

As a citizen of this free society, I also have something to say. To call someone who has never been found guilty of of a violent crime, let alone terrorism - the highly charged word "terrorist," is to take political debate back to the atmosphere of McCarthyism. "If you don't agree with me, you must be a Communist - or in this case a terrorist (and I, by implication, must be a patriot)."

I don't agree with Mr Ayers politics or many of his views, but I'll be damned if I'm not going to protest actions and tactics that can only drag poitical discourse into the mud.

To paraphrase one historic response to Senator McCarthy - "Have you no shame?"

May 15, 2008

Cool People You Should Know: Doug Ready

doug%20ready.jpg
Doug Ready is a sociologist of education who teaches at Teachers College. His research examines the influence of educational policies and practices on educational equity and access. With Valarie Lee, he co-authored Schools Within Schools: Possibilities and Pitfalls of High School Reform, which warns that schools within schools can become powerful tracking devices. Recently, he penned an excellent review of the class size literature. You can listen to a podcast of his class size talk and read the report here.

May 15, 2008

Must See TV! Schwarzenegger Doppelganger Promotes Algebra II!

KnowHow2Go has a new college access campaign encouraging kids to take tough classes like Algebra II and Foreign Languages. Think KISS x Schwarzenegger, but with Mr. Rogers' intentions. I'm going to hide under my bed now.



May 14, 2008

Unsolved Mysteries: The Joel Klein Budget Edition

Holmes-Image-Loupe.jpg
Imagine that you had 8 staff that cost a total of $904,636. Next year, you will also have 8 staff, but they are only budgeted at $1117, for a mean salary of $139.63. (See p. 446.) That's the deal with Joel Klein's staff - his 8 staff stay, but they are working for sweatshop wages.

Hmmmm - if I wanted to make the central Department of Education budget appear smaller than it really is, might I make these monies reappear after public scrutiny of the budget subsided? I'm just saying.

If I am missing an alternate explanation (i.e. maybe budgets are meaningless after all?), please let me know.

page446.jpg


Update: Thanks to Dave Bellel for sending along this page. Click to enlarge.

May 14, 2008

Mike Petrili and the Meese Police

police.jpg
Earlier in the week, Mike "Milli" Petrilli asked if I "favor electing former terrorists to key positions of authority within the education research community." Here's the backstory: In his Memo to the AERA, Petrilli suggested that the AERA council should unseat Bill Ayers as Vice-President Elect of Curriculum Studies. I disagree. While I do not condone his actions, Bill Ayers was democratically elected, and the right of professional associations to self-govern should be respected.

Mike believes that Ayers' presence reflects badly on the whole association, but guilt by association is a shaky principle. I don't judge Mike Petrilli, whose colleagues at the Hoover Institution include upstanding guys like Ed Meese and Donald Rumsfeld, based on his association with them, nor do I believe that AERA is tainted by having Ayers among its leadership. Mike might argue that Meese and Rumsfeld have records of accomplishment that justify their affiliation with Hoover. The same is true regarding Ayers and AERA.

All that said, Mike deserves props for his memo to ED in '08's Roy Romer.

May 14, 2008

What Can $7,789,623 Buy in New York City?

price%20is%20right.jpg
A) 3,894,812 subway rides
B) 15,579 pairs of Prada heels
C) 1812 hours with the Emperors VIP Club
D) 315 years of education at the Brearley School
E) 18 staff for the New York City Department of Education's Division of Assessment and Accountability

On page 446 of New York City's FY09 budget, we learn that the Division of Assessment and Accountability is budgeted at $8,287,282. $7,789,623 will buy you 18 staff - that's $432,757 per person!

The irony of NYC's selective attention to budgeting issues? Priceless.

Update: NYC Parents dishes the goods on Bloomberg's $4.5 million dollar slush fund, which he used to reward city council members.

Update II: NYC DOE's Press Secretary David Cantor posted the following correction to the NYC education news listserve:

The actual headcount in the DOE's Office of Accountability is 79, not 18. The actual budget for salaries is $6.7 million, not $8.3 million. The correct headcount figure is reflected in the most recent DOE Financial Status Report, located online here on page 13. The correct budget figure will appear in the next iteration of the City budget. Sorry for the confusion.

As skoolboy said, "The fact that the people responsible for assessment can't put together an intelligible budget should give us great confidence about the assessment data they report."

May 13, 2008

Roberta Flack, Vietnam, and NCLB - All in One Op-Ed

Roberta-Flack-Best-Of-2006.jpg
It's a deadly slow week in education policy, so I'll pass along this op-ed in the School Library Journal (Killing Me Softly: No Child Left Behind) on a teacher's decision to leave teaching because of the No Child Left Behind Act. Minus 5 points for the melodramatic beginning (I feel like the last marine who got out before the siege of Khe Sanh. I feel like the one Titanic band member who overslept, missed the voyage, and lived. In my darkest moments, I feel like a traitor.), but you can't hold that against a guy who writes young adult fiction. Here's an excerpt:

If you’re a teacher, thanks for being braver than I am. Thanks for riding it out when I’m just, well, riding out. And if you’re a parent, please fight for your child. Ask to see your school’s test-materials budget and its library budget. Ask to visit the classroom on a random day, unannounced. Ask whether your kid is getting more or less art than she would have had five years ago. Ask why band practice is at 7 a.m. when it used to be part of the school day. And while you’re mourning the loss of art, music, language, or history, ask the one most damning question of all: What took its place? If you get really riled up by the answer, please consider running for a spot on the school board.

As for me, I’m out. And I’m sorry.


Are teachers leaving because of NCLB? Does anyone have stories or data?

May 12, 2008

Watch Out, Elizabeth Green, Erin Einhorn, & Jenny Medina!!!

NYC education reporters take note. Straying from his Code Blue demeanor, Mayor Mike proves that he will devour you (without checking your calories) if you accuse him of "maintaining" anything - about NYC schools or otherwise. That's a shame, because this has been a blockbuster school year for "maintaining" in NYC. (Greatest hits: here, here, and here.)

In the clip below, a Newsday reporter says, “Mayor, you maintain that..." Bloomberg cuts him off with: “Maintain is a word that I don’t think is appropriate, sir. The next time you have a question and want to insinuate that I lie, just talk to the press secretary. I don’t think we have a question for you.” (Via the Daily Intel.)

May 09, 2008

Who Slipped a Mickey in John Merrow's Kool-Aid?

Kool-AidMan.jpg
It wasn't me, that's for sure. John Merrow shed crocodile tears this morning over public education's "upside-down universe where student outcomes are not allowed to be connected to teaching." He gives a special shout out to New York, though conveniently fails to mention that our tests are administered smack in the middle of the year. We'll give him a pass for forgetfulness - but watch your drink next time, J.

You can't swing a fish anymore without hitting a glitch in value-added models - try some of the papers from the recent Wisconsin Value-Added Conference on the complexities of measurement error (value-added models must contend with measurement error in both last year and this year's scores), interval scaling (few tests are scaled so that 1 unit of growth at the bottom of the scale means the same thing as 1 unit of growth at the top of the scale), and non-random assignment (see Jesse Rothstein's new paper on just how large these biases can be). Or you can refer to these earlier posts:

* skoolboy on: The Status of the Status Quo in Education Policy
* More Signs of the Apocalypse! (More on NY's Teacher Tenure Law)
* After NY's Teacher Tenure Law, Blogosphere Plays Union Pinata
* My Value-Added Bucket List
* Do Value-Added Models Add Value? A New Paper Says Not Yet
* The Oops Factor in Measuring Teacher Effectiveness
* Ignoring the Great Sorting Machine
* No Teacher is an Island
* What Does It Mean for a Teacher to Be Good?

Alexander Russo, also commenting on Merrow, makes the mistake of equating teachers' evaluation of students with tests and quizzes with the evaluation of teachers by students' test scores. It's just a bad comparison. Teachers give tests, assignments, reports, homeworks, etc in order to evaluate students and to see what they've learned. These measures are part of an extended interactive process through which a teacher hopes to move students forward. The purpose is not simply to label a student as "good" or "bad" based on one assessment. But when we evaluate teachers based on students' scores, the teacher is being evaluated on a more narrow set of skills than are students, and high-stakes are attached to a single test. So the intent of the process is different; few value-added plans are designed to help teachers improve, but focus instead on assigning rewards and sanctions.

The measurement issues are also different. In an elementary school year, a teacher probably collects 900 data points on student performance (let's say 5 a day); with teacher value-added, we end up with 20-25 data points a year. Teacher value-added is, in short, a low precision enterprise. Readers, what do you think of Alexander's comparison?

Happy weekend, everyone!

May 08, 2008

And the Winner is....

Someone should make tee shirts.

boy_band2.jpg

From left to right, the Fordham Foundation's Liam Julian, Mike Petrilli, and Checker Finn. If you missed the beginning of this thread, here's the original name brainstorm.

May 08, 2008

TNTP Throws Down the Gauntlet

Why sort out all those pesky details? Let's get to the table, says TNTP in its latest statement.

May 07, 2008

Joel Klein Blames Idle Teachers for $4 Gas, Subprime Crisis

joel_klein.jpg
Forget Secretary of Education - this guy should be running the Fed. This morning, the Daily News reported that "Schools Chancellor Joel Klein said the teachers union - and policies that keep instructors from their classrooms - bear some of the blame for next school year's budget cuts."

You've got to give the man props for having the cojones to craft a budgeting rule that creates disincentives to hire teachers from closing schools on Monday, spend $80 million on a data warehousing system that doesn't work on Tuesday, hire a legion of PR and executive staff at McKinsey prices on Wednesday, pay for British quality review evaluators to fly across the pond on Thursday, and on Friday, blame the freaking teachers union for his lack of fiscal discipline and America's economic downturn. Those are epic cojones, really.

So if we could get back to the real issues - I'd like to know the answers to these questions:

1) What percentage of ATRs are carrying full loads but haven't been formally hired? Now that the UFT has established that many ATRs are serving as regular teachers, a third party needs to formally study this question. I do wonder why these data weren't collected and analyzed as part of the original report.

2) How do budgeting rules affect experienced teachers' odds of being hired? Yesterday, Daly clarified that some excessed teachers are on local budgets (34% of the 2006), but there are good reasons to believe that it's the younger teachers who are on local budgets. As I understand it, here's the budgeting rule: If the teacher comes from a closing school, the ATR goes on central payroll. If a school is simply deciding that it wants to close down one of its programs, or its student enrollment goes through the ordinary dips, the ATR remains on the school's budget.

In a comment, Daly reported that senior ATRs are more likely to come from closing schools - it follows, then, that experienced teachers are more likely to be on the central budget. If experienced teachers are more likely to be centrally financed, this may explain, in part, why they are more likely to remain in the ATR pool.

If, as TNTP report said, we need a solution "that recognizes the value, commitment and service of New York City’s teachers," we first need to understand why experienced teachers are more likely to remain in the ATR pool. More hard numbers on these issues would be a good start.

Image credit: Gotham Gazette

May 06, 2008

Tuesday Links

TOTE_jackbox.jpg
1) Leo on the Daly Show: Leo Casey responds to the New Teacher Project's latest. On an unrelated topic, check out his thoughts on A Nation at Risk at the CEA blog.

2) The Dean Scream!: My title is false advertising, but Dean's penned two great posts on the skoolboy/Kevin Carey exchange on policymaking and The New Teacher Project report. And on Dean's earlier post on the medical and teaching professions, Going to the Mat's soccer fiend deconstructs the medicine/education comparison. Go Fulham!

3) Corey Glory: Having walloped his finals, Thoughts on Education Policy returns with a post on the Ed Sector's teacher survey.

4) Cerf n Turf, Sans Red Herring: The Gotham Gazette's got the goods from a recent forum on grading NYC schools (Diane Ravitch, Pedro Noguera, Randi Weingarten, Chris Cerf, and Esmeralda Simmons).

5) Nothing to Lose But Your Chains: Joel at So You Want to Teach? has kicked off his "Blog Revolution Project."

6) Harvard's Gossip Girl Makes Z Cavaricci's Look Cool: The best teenage drama since My So-Called Life spawns another knockoff. If they can spot Roland Fryer in gym shorts, you won't hear me complaining.

7) Newt Stumps for E.D.: Who needs Bob Dole when you've got Gingrich? Strikes me as an unlikely candidate to keynote unless you're hosting a conference on giraffe hunting or "the language of living in a ghetto" (i.e. any language but English). At least former ED in '08 spokesperson Kanye West just raps about drunk and hot girls.

May 05, 2008

Guest Blogger Tim Daly on The New Teacher Project's Report

timdaly.jpg
Tim Daly is the President of The New Teacher Project and the lead author of "Mutual Benefits."

Over the past several days, representatives of the United Federation of Teachers (UFT) and others have sought to challenge specific findings of “Mutual Benefits,” our recently released study on New York City’s school staffing policies. We appreciate the UFT’s engagement in this dialogue and welcome their participation.

The New Teacher Project (TNTP) researched and released “Mutual Benefits” with the goal of sparking a substantive, data-driven policy debate from which better policies would emerge. We are glad to see this debate taking shape and remain optimistic that it will lead to reforms that better serve New York City students.

As our paper indicates, the current policy on teachers in the Absent Teacher Reserve (ATRs) is flawed in four fundamental ways:

1. Teachers in the ATR have no incentive to search for positions aggressively and no requirement to apply for positions
2. Teachers have earned and will continue to earn tenure while serving in the ATR
3. There is no limit to the amount of time teachers may serve in the ATR, earning full salary and benefits regardless of their placement status
4. The ATR includes a higher concentration of teachers with documented performance problems than the overall teacher population, and that concentration is growing over time

It is important to note that our assessment of these flaws in the current policy has not, to our knowledge, been rebutted or addressed by any criticism of the paper to date. We stand by these findings and continue to believe that, if unaddressed, the stresses that these flaws put on the school system will inevitably undermine the fair, open and efficient staffing process now in place in New York City.

Though the arguments by the UFT and others against our findings and recommendations have not centered on these core issues to date, many of them mischaracterize our research and threaten to distract everyone involved from the real issues at hand. Below we respond to each of the primary arguments leveled against our report, as discussed primarily in posts on the UFT’s official blog, EdWize.org, and on Eduwonkette.com. We have asked both sites to post this response as part of the larger discussion.

One-third of ATRs are teaching “regular programs” on a full-time basis.

This assertion is inaccurate and misleading for several reasons, including:

1) It wrongly includes guidance counselors

The UFT estimates that 200 or more individuals in the ATR are, “teaching full programs, with regularly scheduled classes, just as they had done when they were regular assigned to schools.” However, the UFT includes not only teachers but also guidance counselors in this figure. Our report does not include data on guidance counselors or address their hiring patterns at any point. Guidance counselors should therefore be excluded from this calculation. Data from New York City’s payroll system appear to indicate that approximately 85 guidance counselors remained in excess as of April 2007.

2) It includes District 79 teachers, whose excessing and hiring processes were anomalous

In his posting on EdWize.org, Leo Casey of the UFT claims that 270 of the 665 teachers in the ATR are from District 79 alternative schools. Neither figure is correct. According to the NYCDOE’s payroll system, 123 teachers from District 79 schools were in the ATR as of December 2007. These teachers were not included in the 665 figure or our study in general because District 79 underwent a substantial and atypical restructuring in 2007 that led to many teachers changing schools. The rules governing the hiring process for these teachers differed from those for other excessed teachers.

For this reason, TNTP did not include 2007 excessed teachers from District 79 schools in its analysis; it would have been misleading to consider them along with other teachers whose excess process was quite different and far more typical of the city’s normal hiring process. If the UFT believes that the restructuring process for alternative schools should have happened differently, that is a worthy debate – but it is quite separate from this one.

Even so, District 79 teachers fared very well in obtaining new placements. Overall, only 24 percent of teachers excessed from District 79 in 2007 still had not found a new position by December—lower than the unselected rate for teachers who were not from District 79 schools.

3) It is based on an unreliable data source

Last, the UFT’s data is of questionable quality and requires more scrutiny and explanation. It is not enough to conclude that because a teacher reports working a full class schedule that the teacher is actually filling a full-time, permanent vacancy. Self-reported data is vulnerable to a host of inaccuracies. For example, the teacher could be substituting for a teacher who is on long-term leave but who will return again. Verification of the UFT’s claim would require communication with the building principal and an examination of the course allocation for each school. It would require knowing whether the only factor preventing principals from placing ATRs into permanent positions is the budget issue raised by the UFT, or whether they are assigning them to classes merely because they have been instructed to do this as the best way to accommodate ATRs who are housed in their buildings.

It is entirely possible that some teachers in the ATR are effectively teaching on a full-time basis. Indeed, as we have noted before, it is difficult to know exactly how principals are putting these teachers to use. In instances where a reserve pool teacher truly is filling a permanent position, we believe that teacher should be formally appointed to the position. That is a reasonable and fair outcome. Limiting the amount of time a teacher may serve in the reserve pool, as we recommend, may in fact provide an incentive for principals to appoint these teachers to positions formally (or risk losing them).

May 05, 2008

Why Buy the Teacher When You Can Have the Teaching for Free?

free_250x251.jpg
New Yorkers love themselves some incentives. We have incentives for students to do well on tests and incentives for parents to take their kids to the doctor. Now that we can't enjoy a meal without contemplating its caloric content, we have guilt-based incentives to eat Pinkberry yogurt instead of Beard Papa's cream puffs. Last week, the New Teacher Project argued that teachers in the "Absent Teacher Reserve" have no incentive to get a job. This morning, it's clear that, in many cases, principals have no incentive to hire them.

On Friday, I showed that experienced teachers are more likely to remain in the Absent Teacher Reserve, and asked what role financial incentives might play in producing this outcome. Of teachers excessed in 2006, only 22% had 13+ years of experience. Of the 2006 teachers who remained unplaced as of December 2007, 42% had 13+ years of experience. Under Fair Student Funding, which allocates dollars rather than positions to principals, a rational principal would choose a $40,000 teacher over an $75,000 one, all else equal. But FSF didn't come online until 2007, and thus can't account for this pattern.

But a more basic incentive problem predates Fair Student Funding - ATR teachers are off-budget. Imagine that you're a principal and through the ATR pool, you've identified a teacher with 20 years of experience that you'd like to have on board. You can give the teacher a full-time class and acquire him at no cost, or you can shell out a pile of money. In the former scenario, the teacher is happy (he's getting paid a full salary and has no reason to leave) and the principal is happy - he's scored a free teacher.

This morning, Elizabeth Green reported that 29% of the absent teacher reserve pool (194 of the 665 teachers) are teaching full courseloads. Edwize provides a list of schools in which teachers have full-time positions and more details. While we're kvetching about aligning incentives, we should get them aligned for principals, too.

May 05, 2008

Vote Early, Vote Often

You know you loved the picture - so between now and Thursday night at midnight, help pick a name for Fordham's boy band.

 

May 02, 2008

Why You Should Read the Fine Print in the New Teacher Project Report

fine-print-shadow.jpg
From the coverage of the New Teacher Project's report, "Mutual Benefits: New York City’s Shift to Mutual Consent in Teacher Hiring,” you'd think that the 235 teachers excessed in 2006 and remaining in the "absent teacher reserve" in December 2007 are the worst of NYC's worst teachers. Consider the National Center on Teacher Quality's retelling: "They are also a generally substandard bunch, with a higher rate of unsatisfactory ratings on their personnel records than their more successful peers. For those content to do very little in life, why give up the life of an excessed teacher?" Or, as the NTP's press release put it, "By September 2007, unselected excessed teachers from 2006 were six times as likely to have received a prior “Unsatisfactory” rating as other New York City teachers."

So what percentage of these teachers have never received an Unsatisfactory rating? 81 percent. What percentage of these teachers have received an Unsatisfactory rating more than one time in their careers? Only 6 percent - about 14 teachers. I am not denying that these rates are higher than the NYC teacher population as a whole. They are. But the raw numbers provide much needed context, and we shouldn't have to dig deep in the report to find them.

The issue of age discrimination in teacher hiring also remains unresolved by this report, despite eduwonk's protest on this point. And there are good reasons to keep a close eye on age discrimination in NYC. With the advent of "Fair Student Funding," principals have strong incentives to hire teachers that cost less. And as the age of principals continues to decline, we might expect that young principals will prefer to supervise younger teachers.

To be sure, the NTP report provides evidence that experienced teachers are somewhat less engaged in the job seeking process than inexperienced teachers. Unfortunately, it doesn't provide enough evidence to convince me that previous teacher ratings and job seeking patterns can fully explain the pattern exhibited in the graph below. The blue bars show the experience levels of the pool of teachers excessed in 2006, while the red bars show the experience levels of teachers who remained unplaced in December 2007.

Because of seniority rules, 44% of teachers excessed in 2006 had 0-3 years experience, while 22% of teachers in this pool had 13+ years of experience. Of the 235 teachers who remained unplaced as of December 2007, only 25% of these teachers had 0-3 years of experience, while 42% had 13+ years of experience. (All numbers are taken from the NTP report, though it wisely never put these two sets of numbers in a figure together.)

NTP%20graph.jpg

My point is not that we should preserve the current staffing rule, or that we should turn back the clock - mutual consent is an important principle. The DOE and UFT need to strike a deal, but first we need to understand the nature of the problem. Framing these teachers as a uniform bunch of incompetent louts does little to advance this understanding.

Update: The New Teacher Project's Tim Daly comments below.

Advertisement

Archives

Recent Comments

  • Christopher Wong: As the filmmaker responsible for "Whatever It Takes", I also read more
  • britney: im still paying off my loan for my education, it read more
  • ed: i love reading your blog whenever i can, i dont read more
  • Johnny Acejo: Now teens are being whores and sluts. read more
  • max: Great post.People do not realize that education is the best read more

Most Viewed
On Education Week