In a networked-world sort of way, I co-wrote this post with J. Gordon Wright at Education Post. Two different educational policy polls came out this week, and I posted a bunch of tweets about the funny and fascinating differences in findings and interpretation about very similar issues. Wright took my tweets, added some context and analysis, and posted over at Education Post. With permission, I’m re-posting here.
It’s edu-poll season, everyone.
Peter Cunningham already summed up the most pertinent conclusion from these competing polls: It’s all how you ask the question.
On the flip side, as Harvard professor Paul Peterson revealed to NPR, “The first thing you learn is that there is no right way to ask a question.” [BJFR: Two other posts comparing the polls come from Paul Peterson and Marty West from Education Next and Morgan Polikoff on his blog.]
By far my favorite recap of the recent poll bonanza, though, comes from #EdTech guru Justin Reich. In typical techie fashion, he took to Twitter to make essentially the same point, but in an epic series of 20 tweets. (Hat-tip to @Ed_Realist.)
Reich starts by setting the scene:
OK folks, it’s a stellar week in education policy polling with two big polls out 1/n
-- Justin Reich (@bjfr) August 24, 2015
EducationNext (free-markety, right leaning) has their 2015 poll out //t.co/VqwPqbTb5Q 2/n
-- Justin Reich (@bjfr) August 24, 2015
and PDK(21st century skillzy, left learning) has their 2015 poll with Gallup out //t.co/sZAgZbbzQ5 3/n
-- Justin Reich (@bjfr) August 24, 2015
First he looks at annual standardized testing: Do we love it or hate it?
EdNext asks, Do you think the feds should test in 3rd-8 and in HS, & 2/3 of ‘Muricans say yes. Bam! Testing wins. 4/n pic.twitter.com/VBqRrDsMSh
-- Justin Reich (@bjfr) August 24, 2015
But wait! PDK asks, Do u think there is too much testing in schools?, & 2/3 of ‘Muricans say yes. Bam! No tests! 5/n pic.twitter.com/MOOTS7nClB
-- Justin Reich (@bjfr) August 24, 2015
Hmm, so it’s a draw on the tests. Well, then how do we feel about parents opting their kids out of those tests?
PDK asks whether parents should be able to let their kids opt out, and the split is 50/50. #choice! 6/n pic.twitter.com/vWRIzSacbf
-- Justin Reich (@bjfr) August 24, 2015
Last tweet should have noted that PDK asks whether parents should be able to opt out of “standardized tests” 7/n
-- Justin Reich (@bjfr) August 24, 2015
But when EdNext asks whether ‘rents should be able to opt kids out of “math and reading tests”, strong opposition.8/n pic.twitter.com/NAskTMf3jG
-- Justin Reich (@bjfr) August 24, 2015
Aha! So apparently it’s okay to opt out of standardized tests, as long as they aren’t math and reading tests. (Good thing those are the only ones required by the federal government.)
But this is the easy stuff. Let’s get into a dicey issue like merit pay for teachers:
Next up: Merit Pay: EdNext asks “should pay be based on how much students learn?” and slight majority is in favor 9/n pic.twitter.com/z5pUaytys9
-- Justin Reich (@bjfr) August 24, 2015
But then PDK asks “do you favor using Standardized. tests on teacher evals?” and slight majority opposes. 10/n pic.twitter.com/HhIZEbjuhf
-- Justin Reich (@bjfr) August 24, 2015
Fair enough. When I think back to the bubble-tests of my youth, I understand why people wouldn’t think that was a useful metric for gauging teacher performance. Fortunately, standardized tests are getting much, much better.
But let’s stop beating around the bush. What’s the scoop on Common Core?
How about Common Core? PDK says that 54% opposes using #CCSS to guide local instruction, versus 24% in favor. 11/n pic.twitter.com/29vjxTrSsd
-- Justin Reich (@bjfr) August 24, 2015
But wait! EdNext asks generally about using #CCSS as common standards, and 55% in favor vs 30% or so opposed. 12/n pic.twitter.com/podrkldbi1
-- Justin Reich (@bjfr) August 24, 2015
Um, I was frankly surprised that these results on Common Core came out so differently.
But as Cunningham points out, apparently PDK’s use of the word “guide” implies some sort of nefarious meddling in the teacher’s classroom autonomy. If so, then respondents may intuitively understand the true intent of the standards--to provide a meaningful benchmark while still empowering school leaders and classroom instructors to choose what’s right for the kids in their community.
But let’s not get too upbeat, a bit of cynicism is appropriate here:
I’m sure like me you are shocked, SHOCKED! to discover that the results of these surveys are so aligned with the org’s policy beliefs. 13/n
-- Justin Reich (@bjfr) August 24, 2015
The good news is, whatever you believe about ed policy, this week, there are data, polls, and white papers to support your views. 14/n
-- Justin Reich (@bjfr) August 24, 2015
Here’s a great takeaway:
One insight is that the brand “standardized test” is toxic. If u like test-accountability, you’ll want to use “reading and math tests” 15/n
-- Justin Reich (@bjfr) August 24, 2015
Here’s the CYA:
To be clear, I think both surveys are designed by good orgs with integrity and best principles, and both are very likely to be true 16/n
-- Justin Reich (@bjfr) August 24, 2015
Another insight is that if you ask about your kids versus your community, versus your state, versus in general, you get diff answers. 17/n
-- Justin Reich (@bjfr) August 24, 2015
Some more smart takeaways:
If you are (like me) ambivalent about ed policy & appreciate the frail beauty of the scientific endeavor, then this is a great polling. 18/n
-- Justin Reich (@bjfr) August 24, 2015
And to my friends in the press, if u report on one of these polls alone (like reporting on any one study), you’ll be getting it wrong. 19/n
-- Justin Reich (@bjfr) August 24, 2015
And then a great finale:
I leave you with the headlines. “Public Backs Testing” “Testing Lacks Public Support.” 20/20 #scienceprovesit pic.twitter.com/qmzTVy1Oxn
-- Justin Reich (@bjfr) August 24, 2015
For regular updates, follow me on Twitter at @bjfr and for my publications, C.V., and online portfolio, visit EdTechResearcher.