January 26, 2009

eduwonkette hangs up her cape

eduwonkette-batsignal_web.jpg

Today, dear readers, I'm hanging up my cape. I'm joining the Sociology department at NYU this fall, and have a dissertation to wrap up that needs my undivided attention.

Last night, I peeked back at my initial post in September 2007:
Rather than stepping into [education policy's] ideological boxing ring, this blog takes a different approach. eduwonkette will consider some of the most contentious education policy debates from a different perspective....My hope is that this blog provides a forum for a broader discussion about the possibilities for, and barriers to, improving schools for American children. But eduwonkette is not all about being wonky. We'll have some fun, too.
I never imagined that this blog would turn out to be the amazingly dynamic forum that it has become, and have all of you to thank for that. It's been a heckuva lot of fun.

I'm grateful to Education Week for hosting me over the last year, and especially thank Ed Week's Jeanne McCann, who has been incredibly supportive of this blog in all matters big and small.

And I couldn't have wished for a better blogging partner than Aaron Pallas, aka skoolboy. His wit and wisdom will live on over at Gotham Schools, where he will be occasionally blogging.

So I guess this is goodbye, at least for now. I'll leave you with some classic superhero fare:
Harvey Dent: We've received a letter from Batman this morning. "Please inform the citizens of Gotham that Gotham City has earned a rest from crime. But if the forces of evil should rise again to cast a shadow on the heart of the city, call me."

January 26, 2009

Wish #1: Taking Kids' Out of School Time Seriously

time.jpg
Sexy sound bite solutions dominate education policy airtime – paying kids for test scores, paying teachers for test scores, and eliminating teacher certification are some of the latest examples.

My final wish for the next four years is much more banal. Kids spent the overwhelming majority of their 0-18 years outside of school – the average American has spent 87% of his or her waking hours outside of school by age 18. If we want to reduce inequality, we need to start thinking seriously about how kids are spending the majority of their time, and support interventions like pre-school and an extended school day and year.

Even if all kids attended schools of identical quality, we would still see inequality in educational outcomes by socioeconomic status because of the 87% conundrum. Home learning environments, it turns out, are much more unequal than school environments. Below, this figure in a terrific paper by Doug Downey and colleagues makes this very clear. To be sure, schools offer unequal learning opportunities, but there is even more inequality in learning opportunities between families.

downey.jpg

In other words, the difference between the best and worst schools is smaller than the difference between the most and least enriched home learning environments. As Downey put it, “As a result, a disadvantaged child attending a low-quality school can still enjoy a larger ‘school boost’ than an advantaged child attending a high quality school. In this way schools can favor advantaged students, but still serve as equalizers.”

This is not to say that we shouldn’t also focus on that 13%, but that increasing the amount of time that poor kids spend in school is a promising strategy for reducing inequality. While it is an expensive intervention, keeping poor kids in school longer – both for preschool and during the school year and summer - is a policy option that deserves more attention.

(For those who are interested in the research here, Karl Alexander found that two-thirds of the reading achievement gap between poor and rich 9th graders in Baltimore is explained by how much they learned during their elementary school summers: Karl Alexander's recent work - written up here in Ed Week - or Doug Downey and colleagues paper using data from the Early Childhood Longitudinal Study. )

January 23, 2009

Wish #2: The End of Proficiency Only Accountability Systems

mylerdude_Pico_superdog_81688_o_thumb.jpg
The No Child Left Behind Act may represent the largest threshold-based government accountability system in the country. Schools are evaluated not by how much progress students make, but by their success in pushing students over the proficiency bar. By now, you’re probably familiar with the discontents of this system: states can game the system by setting that proficiency bar low; some schools have triaged their students, essentially reallocating resources to the kids most likely to become proficient in the very short-term; and policymakers can misleadingly make claims about declining racial achievement gaps based on proficiency rates, even as these gaps are unchanged or growing.

Proficiency-based accountability systems leave us in a terrible spot. On the one hand, we want to push kids and raise the bar for proficiency. But on the other hand, we want to make sure that the lowest performing students aren’t kicked to the curb. The higher you raise that bar, the more likely you are to have a significant proportion of students in any given school below proficiency. And those are precisely the conditions under which it makes sense for educators to allocate their time and attention strategically.

All of this, of course, should have been expected in a system focused on proficiency rather than growth. And contrary to popular belief, NCLB's growth model pilot doesn't allow true value-added models, but is instead based on a "projection model” which requires all students to reach a fixed proficiency target regardless of their initial achievement levels.

What am I suggesting? The new Department of Education would do well to let states experiment with a few different accountability systems: 1) dump proficiency altogether and identify schools as in need of improvement based on whether they are making less growth than expected. In other words, drop NCLB’s arbitrary targets and evaluate schools based on how they are doing compared to the schools we already have, or 2) keep proficiency around, but focus improvement efforts on schools that are both low-growth and low-proficiency – not relative to an arbitrary standard, but perhaps those in the bottom 15% of both categories. (That number should be set based on the number of schools to which states can provide targeted support.)

Either of those options would require significant new investments in better tests that are designed to measure growth, and careful attention to building a value-added model that is both valid and reliable. New Yorkers know well that a poorly designed value-added model at the center of the Progress Reports wreaks more havoc than no value-added model at all.

My recommendations will surely fail to impress the “no excuses” crowd (or more aptly, the “nuke the system” crowd—my belated entry into Elizabeth’s Green’s name-the-reformer contest) who see anything short of “100% proficiency” as not radical enough. “No excuses” is great rhetoric, but in the end it’s just that. So my wish #2 is that we move past this bravado in the next four years and develop a more reasonable and effective way of identifying and supporting low-performing schools in getting better.

PS: Check out Richard Rothstein's related op-ed, Getting Accountability Right, which speaks back to Wish #4 (integrating a broad set of goals of public schooling into accountability systems).

January 22, 2009

Wish #3: Asking More "Why?" Questions

why-blog.jpg

Earlier this month, a team of researchers at MIT and Harvard released a report contrasting the impact of charter schools, “pilot” schools, and traditional public schools on student achievement. The finding of charter school effects on achievement, using a random assignment research design, fueled the rhetoric of charter school advocates, some of whom saw the findings as a license for unlimited expansion of charter schools.

The researchers themselves were more cautious. They acknowledged that the study was not designed to discern why the effects were found. In fact, if the study had found that students in charter schools had shown less growth in achievement than students in traditional public schools, they wouldn’t have known why either.

Good public policy depends on compelling answers to “why” questions about both the observed effects and non-effects of policies and programs. And these “why” questions pertain both to the inner workings of policies and programs as well as the context in which the policies and programs are situated. Borrowing policies that have been found to be effective in one setting and expecting the same results in another setting makes sense only if we know why the policies were effective in that first setting. A research study showing that a policy or program “worked” in a particular setting doesn’t tell us that.

Our wish, then, is for asking “why?” more loudly, and earlier in the lifecycle of a policy or program. Why might achievement be higher in charter schools? Why do children learn more in smaller classes? Why are some teachers more successful in teaching low-achieving students than high-achieving students? Why don’t school expenditures have a stronger association with student outcomes? In skoolboy’s view, the real leverage in education policy comes from good answers to the “why?” questions. To paraphrase Jim March, research that addresses “why?” questions is more useful than research that addresses “what works?” questions because it has so many more applications.

One challenge posed by our wish is that the researchers who are skilled at addressing “what works?” questions are not necessarily the ones who are good at addressing “why?” questions. Even in large federal evaluations, there typically is a division of labor in which the study of implementation and context is segregated from the study of program impacts, and different research organizations or researchers are responsible for differing parts of the overall enterprise. Asking “why?” more often will require some hard thinking about research training and the infrastructure for education research in the U.S.

January 21, 2009

Wish #4: Better Alignment of Accountability Systems to School Outcomes

18madoff_190.jpg

Here’s a little thought experiment: Suppose that, in addition to adequate yearly progress in literacy and mathematics, high schools had to demonstrate progress in students’ ethical behavior. Would the graduates of Far Rockaway High School in Queens in New York City be as proficient in their treatment of others as they are in math and literacy?

Victims of Bernard Madoff’s $50 billion Ponzi scheme might wish that Far Rockaway had spent more time on the development of its students’ non-cognitive skills as their ability to read, write and figure. Of course, we cannot tell what led Madoff astray, and his experience at Far Rockaway probably had little to do with it. But the thought experiment opens the door to a wish for accountability systems in education that are better-aligned with the diverse school outcomes we think are important.

What skills do employers value in their workers? A 2008 survey of members of the Society for Human Resources Management found that human resources professionals reported that some skills and practices were more important for experienced workers in 2008 than two years before. More than a third of the respondents reported that adaptability/flexibility; critical thinking/problem-solving; leadership; professionalism/work ethic; teamwork/collaboration; and information technology application had increased in importance in the recent past.

The story is not that different for the general public. Asked to allocate a total of 100 points across eight goals of public education, a sample of adults divided them up relatively evenly: basic academic skills (19%); critical thinking (15%); social skills and work ethic (14%); physical health (12%); preparation for skilled work (11%); emotional health (11%); citizenship (10%); and the arts and literature (8%).

Why, if the public and employers think that these are the most important goals of public education, have we constructed accountability systems that focus on a narrow subset of these goals – basic proficiency in literacy and mathematics? Part of the answer is that we had an existing technology for measuring literacy and mathematics proficiency – standardized tests of academic performance.

Richard Rothstein, Rebecca Jacobsen, and Tamara Wilder, in Grading Education: Getting Accountability Right, argue that if these broad goals are important – and skoolboy thinks they are—then we should develop measures of these goals, and incorporate them into accountability systems. One of the things we’ve learned about education accountability systems that rely on rewards and punishments is that educators respond to incentives, doing what they can to avoid punishments and to achieve rewards associated with a particular pattern of outcomes. Particularly when the inducements are high-stakes, we are liable to get precisely the outcomes that are to be rewarded and punished – no more, and no less.

Literacy and mathematical proficiency are extremely important skills for schools to cultivate, and it’s appropriate that accountability systems monitor students’ literacy and math performance and provide incentives for educators to help students achieve challenging performance standards. But it’s also critically important for U.S. children and youth to prepare to assume the responsibilities of citizenship in a democracy that depends on a tacit social contract which binds us together, and we count on schools to do this and much more. Our wish is for accountability systems in education that are designed to measure and promote genuine growth and development in children and youth.

January 20, 2009

Wish #5: Education Policy Based on Averages, Not Outliers

michael-phelps-picture-3.jpg
To celebrate this week’s historic inauguration, skoolboy and I are going to take a step back and make some big wishes – or at least predictions - for education policy in the next four years.

And I want to start this wish in an unlikely place - with a man in a Speedo. Let’s talk about Michael Phelps. Who wasn’t astonished by his eight golds, including that insane race where he touched out his competitor by a hundredth of a second? All over the country, there are age group swimmers, probably some of them putting laps in as you read this, who want to swim as fast as Phelps. Perhaps some of them will emulate his breakfast diet after practice today: three fried-egg sandwiches loaded with cheese, lettuce, tomatoes, fried onions and mayonnaise, two cups of coffee, one five-egg omelet, one bowl of grits, three slices of French toast topped with powdered sugar, and three chocolate-chip pancakes.

Americans love outliers. The quick, the talented, the beautiful – we like to read stories about them, watch them on TV, and aspire to be like them. Up to a point, that’s all for the good.

But education policy has taken this fawning adoration to a new level. Rather than appreciating the good work outlier schools do but realizing that public policy must be crafted for mere mortals, some hold up outliers as evidence that all schools can reach a particular standard. Consider Joel Klein and Al Sharpton’s remarks in a recent Wall Street Journal piece:
Dismissing the potential of schools to substantially boost minority achievement, as is now fashionable in some Democratic circles, is ultimately little more than a recipe for defeatism….High-performing urban charter schools such as the KIPP (Knowledge Is Power Program) schools are showing that minority students can close the achievement gap if given access to high-quality instruction.
So what are Klein and Sharpton saying here? Their argument is essentially: 1) Some schools with high concentrations of minority and poor students are getting exceptional results, 2) If some schools with high concentrations of minority and poor students are getting good results, poverty must not affect academic achievement - at least not in ways that can't be overcome by good schools, and 3) If some schools can get exceptional results in spite of the challenges their students face, all schools should be able to.

I won’t belabor how flawed this logic is - because at the end of the day, it is just crazy talk. We don’t expect the other 99.9% of swimmers to be able to do what Michael Phelps can, and a swim coach that set out to reach that goal for his swimmers would be sorely disappointed. And we don’t infer that disabilities like Phelps’ ADHD can be overcome by all because one man did so. Few would disagree with the previous two sentences. But it seems that when we step into the education policy arena, we too often check our brains at the door.

So Wish #5 is a simple one: Please, dear policymakers, don’t craft your policies – or your expectations about the effects of policies – based on outlier schools or teachers.

January 16, 2009

The State of "State of the City" Speeches

While we await President-Elect Obama's Inauguration speech, here's a look at the rhetoric in ten mayors' "State of the City" speeches over the past year. Can you match the mayor with the quote?

1. We're going to demonstrate how a school community comes together when you give teachers, parents and principals real authority to make decisions in the classroom. We’re going to show how the atmosphere transforms with uniforms and parent contracts, when you instill a culture of discipline and respect. We’re going to show what happens when we set tall goals and raise expectations, when we publish clear benchmarks and hold ourselves accountable. We are going show what is possible when we make our children believe they can do anything.

2. In our schools, we have decreased the achievement gap and increased learning.

3. And on this 80th anniversary of Dr. King's birth and on the eve of the inauguration of our first African-American president, we can all be proud that African American and Latino students are leading the way in the rate of improvement.

4. No one wants to see their school closed, and there was controversy, but the leaders of our schools held their ground because they knew the change would help our kids, especially those with the greatest learning gap. And a year later we are beginning to see the positive results.

5. As adults, we have a responsibility to create hope in the lives of our children.

6. We’re continuing to work with nonprofits like the Bill and Melinda Gates Foundation to double the number of Class of 2010 students graduating from college -- and triple the number for the Class of 2013.

7. Our graduation rate remains dangerously low -- and while they talk about a world class education system, our Legislature slashes nearly a billion dollars in funding for our children. We refuse to accept the growing technology gap between children who will compete in the global economy, and those who, not by their choosing, will watch the world pass them by.

8. In 2007, 55 percent of seniors graduated -- the highest percent age since 1995. This year, we are working towards a goal of 60 percent. Each year, we will be working to increase graduation rates.

9. Anyone who believes in libraries also knows their importance to a major city -- not as monuments to civic pride, but as doors to education and opportunity.

10. All over our City we are seeing educational excellence in public and private schools -- beacons of light, illuminating the way forward.

a. R.T. Rybak, Minneapolis
b, Jerry Sanders, San Diego
c. Thomas Menino, Boston
d. Tom Barrett, Milwaukee
e. Manuel Diaz, Miami
f. Antonio Villaraigosa, Los Angeles
g. Adrian Fenty, Washington, D.C.
h. Cory Booker, Newark
i. Frank Jackson, Cleveland
j. Michael Bloomberg, New York


(Answers in the comments at the end of the day.)

January 13, 2009

Lies, Damned Lies, and Bush Administration Accomplishments

largevalues.jpg

Yesterday, President George W. Bush, as part of his swan song, released a compendium entitled “Policies of the Bush Administration 2001-2009.” Not surprisingly, No Child Left Behind is the centerpiece of administration’s accomplishments in K-12 education, and the fact sheets detail the administration’s claims about progress.

Skoolboy’s favorite section is the one on Reading First. You remember Reading First, don't you? The program whose interim impact evaluation, sponsored by the Institute of Education Sciences, found no evidence of effects on reading comprehension test scores in grades 1 to 3? The text reads:

NCLB established the principle that Federal funding should be invested in programs that have rigorous research demonstrating their effectiveness. Reading First has provided more than $6 billion to fund scientifically-based instructional programs, valid and reliable diagnostic assessments, and professional development for teachers. State data shows that Reading First students from nearly every grade and subgroup have made impressive gains in reading proficiency. For first grade, 44 of 50 States reported increases in the percentage of students proficient in reading comprehension; for second grade, 39 of 52 States reported improvement; and for third grade, 27 of 35 States reported improvement.

“52 States”? Maybe we should have invested a bit more in Math First.

Okay, cheap shot, there are 54 state education agencies (SEA’s) that received funds under Reading First, including American Samoa, the Bureau of Indian Education, the District of Columbia, and the Virgin Islands.

But seriously: How did “44 of 50 States” report increases in the percentage of first grade students proficient in reading comprehension when, according to the American Institutes for Research compilation of Reading First Annual Performance Reports from 2003-2007, only 40 of the 54 SEA’s even reported reading comprehension proficiency for first grade students for two or more years?

January 12, 2009

Professor Bonuses Based on Course Evaluations?

for_sale_sign_1.gif
Forget a PhD - profs might do better with improv training and Botox (seriously, attractive professors - especially attractive men - get better evaluations!). Reported this morning in the Chronicle:
The chancellor of the Texas A&M University system wants to give faculty members bonuses of up to $10,000, based on student evaluations, but some professors are raising concerns about the plan, saying it could become a popularity contest....Though details are preliminary, officials said, the goal is to offer awards starting at $2,500 to the top 15 percent of participating instructors.
To be sure, good teaching is insufficiently rewarded at most colleges and universities. But according to the Chancellor, “This is customer satisfaction....It doesn’t have to do with tenure, promotion, status. It has to do with students’ having the opportunity to recognize good teachers and reward them with some money.”

But is good teaching the same thing as "customer satisfaction?" Is there a better way to recognize and reward effective college teaching? Or, as one commenter at the Chronicle augured, are we left with this bargain?
Wow. What an easy way to make up to 10,000 dollars! Just water-down my courses, make no demands on students, make sure to bring donuts or some sort of snacks on the day of evaluations, and make sure my students know I think they are incredibly bright and they will get an A. Cha-ching!

January 09, 2009

Private Practice, Public Health, and the Autism/Vaccine Debate

"Private Practice" - the "Grey's Anatomy" spinoff starring Kate Walsh - may be one of the most poorly written, bad excuse for soft porn shows on TV. But big props to the show for last night's episode/public service announcement, which has already ignited a firestorm on the autism blogs.

The episode featured a mother with three sons, and the oldest was autistic. Blaming the MMR vaccine for her child's autism, she chose not to vaccinate her two other sons. An unvaccinated son picks up measles while the family is in Switzerland seeking autism treatment, exposes the entire practice when he comes in, and dies at the end of the episode.

Think this is implausible? Check out this graph of the growth of measles cases in the UK over the last 12 years, courtesy of the BBC:

measles.jpg
And it's not just the UK. During the first seven months of 2008, 131 measles cases were reported to CDC, compared with an average of 63 cases per year during 2000--2007. (On a more local level, in the first four months of 2008, there were 22 measles cases in NYC.)

Parents have the right to make choices for their children, but they don't have an inalienable right to expose other people's children to deadly diseases. And if it takes a bunch of hot faux doctors to get that message out, so be it.
Advertisement

Archives

Recent Comments

  • Christopher Wong: As the filmmaker responsible for "Whatever It Takes", I also read more
  • britney: im still paying off my loan for my education, it read more
  • ed: i love reading your blog whenever i can, i dont read more
  • Johnny Acejo: Now teens are being whores and sluts. read more
  • max: Great post.People do not realize that education is the best read more

Most Viewed
On Education Week