« April Fool in Love Links | Main | Quotes of the Day »

AERA continued: The Teachings of Russ Whitehurst

In a talk last Thursday entitled, “Seven Things I've Learned About Education Research and Policy, Plus or Minus Two,” Russ Whitehurst, the Director of the Institute of Educational Sciences, summarized what he’s learned about education policymaking during his seven years at IES.

1) The research community is oriented towards understanding, while the policy community is oriented towards action.

Researchers are often upset that their work is not defined as “policy relevant” (and thus not included in IES’s funding priorities). But they usually haven’t thought about what’s actionable in their own research. Whitehurst gave the example of a study in which the researcher coded classroom interactions between teachers and children of different ability levels, and found meaningful differences. When asked what the policy implications were, the researcher looked at him like a deer in headlights.

Said Whitehurst, “I’m not suggesting there’s anything wrong with that kind of scholarship,” but this quest for understanding rather than prescription is perplexing to policymakers. Researchers often defend research oriented towards understanding by appealing to the long arc of science. In response, Whitehurst argued that education is not a discipline in the sense that neuroscience is a discipline. Rather, education is more like transportation, in that it presents a series of problems that need to be solved.

2) Researchers operate under the logic of disconfirmation, while policymakers operate under the logic of confirmation, especially once they’ve committed to a course of action.

Once policymakers have signed on to an initiative, they are not looking for evidence that they’ve committed to the wrong program. Using NCLB as an example, Whitehurst explained that once NCLB was passed, the Department of Education necessarily had to shift from being a buyer to a seller of education policy. A series of complex policy decisions had to be made – i.e. establishing subgroup size and the percentage of students who could sit for alternate assessments. Whitehurst’s point was that the sweet spot of policymaking is where people are uncertain and uncommitted. Policymakers like to have the weight of research behind them, and it’s most effective to offer advice before they’ve publicly commented about the issue.

3) Much research that’s relevant to policymakers shouldn’t be because it’s too methodologically weak to be taken seriously.

Whitehurst lamented that he’s had to provide assessments of research to major newspapers, though the research “was so weakly done that it’s a shame that anyone had to spend time thinking about it.” Unfortunately, Whitehurst said, a report put out by a thinktank is given the same weight as an article published in Science. Whitehurst argued that until policymakers don’t have to worry that what they’re reading is a political document, rather than a research document, the relationship between educational research and educational policymaking will be troubled.

4) Demonstrating that popular programs don’t work is risky business.

No good evaluation goes unpunished, Whitehurst quipped. He provided the example of the Upward Bound evaluation, which found no effects of Upward Bound on college going, and discussed the subsequent shutdown of a randomized trial to further evaluate Upward Bound.

5) The combination of high-stakes for policymakers and high uncertainty about what they can do generates unreasonable expectations for educational research.

While medical research has invested millions of dollars in the search for an AIDS vaccine, it has been unsuccessful. The medical community is willing to accept that research and progress takes time, while there’s no understanding that identifying solutions takes time in educational research, too.

This was probably the best session I attended at AERA. His points weren’t particularly novel, but Whitehurst pulled them together coherently, if sometimes naively. For example, he worried that policymakers see research articles as political documents rather than research documents – but isn’t the choice of research questions and outcome variables political to begin with? I also expected more fireworks from the audience about funding priorities – only a few years ago, many researchers were stomping mad that their research was ineligible for funding.
Notice: We recently upgraded our comments. (Learn more here.) If you are logged in as a subscriber or registered user and already have a Display Name on edweek.org, you can post comments. If you do not already have a Display Name, please create one here.
Ground Rules for Posting
We encourage lively debate, but please be respectful of others. Profanity and personal attacks are prohibited. By commenting, you are agreeing to abide by our user agreement.
All comments are public.


Recent Comments




Technorati search

» Blogs that link here


8th grade retention
Fordham Foundation
The New Teacher Project
Tim Daly
absent teacher reserve
absent teacher reserve

accountability in Texas
accountability systems in education
achievement gap
achievement gap in New York City
acting white
AERA annual meetings
AERA conference
Alexander Russo
Algebra II
American Association of University Women
American Education Research Associatio
American Education Research Association
American Educational Research Journal
American Federation of Teachers
Andrew Ho
Art Siebens
Baltimore City Public Schools
Barack Obama
Bill Ayers
black-white achievement gap
books on educational research
boy crisis
brain-based education
Brian Jacob
bubble kids
Building on the Basics
Cambridge Education
carnival of education
Caroline Hoxby
Caroline Hoxby charter schools
cell phone plan
charter schools
Checker Finn
Chicago shooting
Chicago violence
Chris Cerf
class size
Coby Loup
college access
cool people you should know
credit recovery
curriculum narrowing
Dan Willingham
data driven
data-driven decision making
data-driven decision-making
David Cantor
Dean Millot
demographics of schoolchildren
Department of Assessment and Accountability
Department of Education budget
Diplomas Count
disadvantages of elite education
do schools matter
Doug Ready
Doug Staiger
dropout factories
dropout rate
education books
education policy
education policy thinktanks
educational equity
educational research
educational triage
effects of neighborhoods on education
effects of No Child Left Behind
effects of schools
effects of Teach for America
elite education
Everyday Antiracism
excessed teachers
exit exams
experienced teachers
Fordham and Ogbu
Fordham Foundation
Frederick Douglass High School
Gates Foundation
gender and education
gender and math
gender and science and mathematics
gifted and talented
gifted and talented admissions
gifted and talented program
gifted and talented programs in New York City
girls and math
good schools
graduate student union
graduation rate
graduation rates
guns in Chicago
health benefits for teachers
High Achievers
high school
high school dropouts
high school exit exams
high school graduates
high school graduation rate
high-stakes testing
high-stakes tests and science
higher ed
higher education
highly effective teachers
Houston Independent School District
how to choose a school
incentives in education
Institute for Education Sciences
is teaching a profession?
is the No Child Left Behind Act working
Jay Greene
Jim Liebman
Joel Klein
John Merrow
Jonah Rockoff
Kevin Carey
KIPP and boys
KIPP and gender
Lake Woebegon
Lars Lefgren
leaving teaching
Leonard Sax
Liam Julian

Marcus Winters
math achievement for girls
meaning of high school diploma
Mica Pollock
Michael Bloomberg
Michelle Rhee
Michelle Rhee teacher contract
Mike Bloomberg
Mike Klonsky
Mike Petrilli
narrowing the curriculum
National Center for Education Statistics Condition of Education
new teachers
New York City
New York City bonuses for principals
New York City budget
New York City budget cuts
New York City Budget cuts
New York City Department of Education
New York City Department of Education Truth Squad
New York City ELA and Math Results 2008
New York City gifted and talented
New York City Progress Report
New York City Quality Review
New York City school budget cuts
New York City school closing
New York City schools
New York City small schools
New York City social promotion
New York City teacher experiment
New York City teacher salaries
New York City teacher tenure
New York City Test scores 2008
New York City value-added
New York State ELA and Math 2008
New York State ELA and Math Results 2008
New York State ELA and Math Scores 2008
New York State ELA Exam
New York state ELA test
New York State Test scores
No Child Left Behind
No Child Left Behind Act
passing rates
picking a school
press office
principal bonuses
proficiency scores
push outs
qualitative educational research
qualitative research in education
quitting teaching
race and education
racial segregation in schools
Randall Reback
Randi Weingarten
Randy Reback
recovering credits in high school
Rick Hess
Robert Balfanz
Robert Pondiscio
Roland Fryer
Russ Whitehurst
Sarah Reckhow
school budget cuts in New York City
school choice
school effects
school integration
single sex education
small schools
small schools in New York City
social justice teaching
Sol Stern
Stefanie DeLuca
stereotype threat
talented and gifted
talking about race
talking about race in schools
Teach for America
teacher effectiveness
teacher effects
teacher quailty
teacher quality
teacher tenure
teachers and obesity
Teachers College
teachers versus doctors
teaching as career
teaching for social justice
teaching profession
test score inflation
test scores
test scores in New York City
testing and accountability
Texas accountability
The No Child Left Behind Act
The Persistence of Teacher-Induced Learning Gains
thinktanks in educational research
Thomas B. Fordham Foundation
Tom Kane
University of Iowa
Urban Institute study of Teach for America
Urban Institute Teach for America
value-added assessment
Wendy Kopp
women and graduate school science and engineering
women and science
women in math and science
Woodrow Wilson High School