« Should You Count on Diplomas Count? | Main | Move Over Grey's Anatomy! Thursday Night TV With Joel Klein »

A Texas Tall Tale Remembered, and Demolished, One More Time

In December 2000, the New York Times introduced us to the president elect's choice for Secretary of Education, a former football coach with a penchant for "snake-, lizard-, ostrich- or alligator-skin boots." In that article, Jacques Steinberg reported that under his leadership as the superintendent of the Houston Independent School District, Rod Paige "helped nudge test scores steadily upward in the Houston district, which is largely black and Hispanic. It now ranks among the highest-performing in the state." Houston, the commentators cooed, was nothing short of a miracle. In 2002, the district won the first Broad Prize for Urban Education.

By 2003, the press - and the Texas Education Agency - started looking more closely at Houston's results. In the Times first article on the Houston miracle, "Questions on Data Cloud Luster of Houston Schools," Diana Schemo wrote, "Now, some here are questioning whether the miracle may have been smoke and mirrors, at least on the high school level. And they are suggesting that perhaps Houston is a model of how the focus on school accountability can sometimes go wrong, driving administrators to alter data or push students likely to mar a school's profile -- through poor attendance or low test scores -- out the back door."

Ten days later, the Times editorial page wrote that Paige "owes it to the country to share his thoughts on how this happened and what it means." In an interview with the Times editorial board a few days later, Paige defended his record. Gains in student achievement were real and "still standing," though he said ''there probably was'' a dropout problem.

But the cat was out of the bag. By December the Times had acquired test score data - both on the Texas TAAS and the nationally normed Stanford tests - and established that Houston's state test score gains were enormously inflated. In other words, Houston's sizable gains on the Texas test largely evaporated on the Stanford 9. In August 2004, 60 Minutes ran a segment on the Texas Miracle. When the Dallas Morning News uncovered widespread cheating in Houston late in 2004, it appeared that the game was finally over.

In this month's issue of Educational Evaluation and Policy Analysis, a new study by UT-Austin professor Julian Vasquez-Heilig and Linda Darling-Hammond, "Accountability Texas-Style: The Progress and Learning of Urban Minority Students in a High-Stakes Testing Context," revisits the Houston miracle by analyzing years of student-level test score and graduation data (1995-2002). There's no version up on the web yet, but here are some key findings:

* Growth on scores on TAAS exam outpaced scores on the Stanford exam. This appears to be prima facie evidence of test score inflation.

* Low-scoring students were excluded from taking the TAAS, both through special education and language exemptions and grade retention.

* A key strategy for improving test scores involved retaining students in 9th grade so they would not sit for the TAAS exit exam in 10th grade. At its peak, 30% of 9th graders were retained for one or more years. Some students were kept in 9th grade for two years, and then skipped to 11th grade so they could avoid the exit test. When more students were retained, unsurprisingly, accountability ratings went up.

* While minuscule dropout rates were reported, only a third of students were graduating in Houston in 5 years or less.

Take home lessons? If it looks too good to be true, it probably is.

Great post, eduwonkette! It seems to me that Rod Paige was simply a pea in this Administration's pod. Your post -- on the heels of Scott McClellan's book and today's release of the US Senate report on the lead-up to the war in Iraq -- seems to suggest that the entire upper echelon of the Bush Administration is populated by liars and cheats.

Substantively, Houston's story provides a cautionary tale about school districts that are singled out for praise based on a year or two worth of test scores. Many of those districts can't sustain those scores (or gains) over time, calling into question whether any of their supposed 'best' practices really are at all. Of course, in this case, there was pure cheating and obfuscation of data going on.

Too bad the NY times has never taken a close look at the NYC "miracle" closer to home. Nearly everything they found in Houston has happened here -- inflated state test scores that don't match up with national results; similarly inflated graduation rates.

I saw Rod Paige speak at an education policy conference toward the end of his tenure as Sec of Education. I was shocked to see that he could barely string a sentence together - he appeared to have little command of grammar and difficulty answering any substantive questions. He certainly did not appear to be a role model for education in America. Where did Bush find this guy?

There's a bit of a problem with this article. While the Houston folks may have played some tricks with the test, for the past five or so years known as the TAKS, the exit level test--the test that determines if a student can graduate from high school--is in 11th, not 10th grade.

The testing and the rules and regimentation surrounding it have become impossible to distinguish from an Onion parody. Special education students whose mental abilities are on the level of 18 month olds must take TAKS tests, even if this means that their teachers are reduced to assisting them "hand over hand, which means literally guiding their hands to the correct answer. Teachers administering the test are told that they must constantly "monitor" students by walking around and ensuring that they are working on the correct portions of the tests at the correct times, answering all of the questions, etc., yet teachers are also told that they are not allowed to look at or read any portion of the tests, nor are they allowed to so much as mention their content to anyone, lest their teaching certificates be revoked or they be prosecuted.

To call the state testing racket insane is an insult to the truly insane everywhere.

Comments are now closed for this post.


Recent Comments

  • Mike: There's a bit of a problem with this article. While read more
  • Attorney DC: I saw Rod Paige speak at an education policy conference read more
  • Leonie Haimson: Too bad the NY times has never taken a close read more
  • Liam Goldrick: Great post, eduwonkette! It seems to me that Rod Paige read more




Technorati search

» Blogs that link here


8th grade retention
Fordham Foundation
The New Teacher Project
Tim Daly
absent teacher reserve
absent teacher reserve

accountability in Texas
accountability systems in education
achievement gap
achievement gap in New York City
acting white
AERA annual meetings
AERA conference
Alexander Russo
Algebra II
American Association of University Women
American Education Research Associatio
American Education Research Association
American Educational Research Journal
American Federation of Teachers
Andrew Ho
Art Siebens
Baltimore City Public Schools
Barack Obama
Bill Ayers
black-white achievement gap
books on educational research
boy crisis
brain-based education
Brian Jacob
bubble kids
Building on the Basics
Cambridge Education
carnival of education
Caroline Hoxby
Caroline Hoxby charter schools
cell phone plan
charter schools
Checker Finn
Chicago shooting
Chicago violence
Chris Cerf
class size
Coby Loup
college access
cool people you should know
credit recovery
curriculum narrowing
Dan Willingham
data driven
data-driven decision making
data-driven decision-making
David Cantor
Dean Millot
demographics of schoolchildren
Department of Assessment and Accountability
Department of Education budget
Diplomas Count
disadvantages of elite education
do schools matter
Doug Ready
Doug Staiger
dropout factories
dropout rate
education books
education policy
education policy thinktanks
educational equity
educational research
educational triage
effects of neighborhoods on education
effects of No Child Left Behind
effects of schools
effects of Teach for America
elite education
Everyday Antiracism
excessed teachers
exit exams
experienced teachers
Fordham and Ogbu
Fordham Foundation
Frederick Douglass High School
Gates Foundation
gender and education
gender and math
gender and science and mathematics
gifted and talented
gifted and talented admissions
gifted and talented program
gifted and talented programs in New York City
girls and math
good schools
graduate student union
graduation rate
graduation rates
guns in Chicago
health benefits for teachers
High Achievers
high school
high school dropouts
high school exit exams
high school graduates
high school graduation rate
high-stakes testing
high-stakes tests and science
higher ed
higher education
highly effective teachers
Houston Independent School District
how to choose a school
incentives in education
Institute for Education Sciences
is teaching a profession?
is the No Child Left Behind Act working
Jay Greene
Jim Liebman
Joel Klein
John Merrow
Jonah Rockoff
Kevin Carey
KIPP and boys
KIPP and gender
Lake Woebegon
Lars Lefgren
leaving teaching
Leonard Sax
Liam Julian

Marcus Winters
math achievement for girls
meaning of high school diploma
Mica Pollock
Michael Bloomberg
Michelle Rhee
Michelle Rhee teacher contract
Mike Bloomberg
Mike Klonsky
Mike Petrilli
narrowing the curriculum
National Center for Education Statistics Condition of Education
new teachers
New York City
New York City bonuses for principals
New York City budget
New York City budget cuts
New York City Budget cuts
New York City Department of Education
New York City Department of Education Truth Squad
New York City ELA and Math Results 2008
New York City gifted and talented
New York City Progress Report
New York City Quality Review
New York City school budget cuts
New York City school closing
New York City schools
New York City small schools
New York City social promotion
New York City teacher experiment
New York City teacher salaries
New York City teacher tenure
New York City Test scores 2008
New York City value-added
New York State ELA and Math 2008
New York State ELA and Math Results 2008
New York State ELA and Math Scores 2008
New York State ELA Exam
New York state ELA test
New York State Test scores
No Child Left Behind
No Child Left Behind Act
passing rates
picking a school
press office
principal bonuses
proficiency scores
push outs
qualitative educational research
qualitative research in education
quitting teaching
race and education
racial segregation in schools
Randall Reback
Randi Weingarten
Randy Reback
recovering credits in high school
Rick Hess
Robert Balfanz
Robert Pondiscio
Roland Fryer
Russ Whitehurst
Sarah Reckhow
school budget cuts in New York City
school choice
school effects
school integration
single sex education
small schools
small schools in New York City
social justice teaching
Sol Stern
Stefanie DeLuca
stereotype threat
talented and gifted
talking about race
talking about race in schools
Teach for America
teacher effectiveness
teacher effects
teacher quailty
teacher quality
teacher tenure
teachers and obesity
Teachers College
teachers versus doctors
teaching as career
teaching for social justice
teaching profession
test score inflation
test scores
test scores in New York City
testing and accountability
Texas accountability
The No Child Left Behind Act
The Persistence of Teacher-Induced Learning Gains
thinktanks in educational research
Thomas B. Fordham Foundation
Tom Kane
University of Iowa
Urban Institute study of Teach for America
Urban Institute Teach for America
value-added assessment
Wendy Kopp
women and graduate school science and engineering
women and science
women in math and science
Woodrow Wilson High School