« Are Poor Students More Prepared for Kindergarten? | Main | A Closer Look at Corporal Punishment in the States »

Can You Hack It? Game Shows Difficulty in Interpreting Research

Often in education research, the answer is embedded in how you ask the question. 

The statistical news blog FiveThirtyEight (named for the number of electors in the U.S. electoral college) launched a newsgame allowing readers to use the same data set to "prove" that either Republicans or Democrats are better for the economy, by adjusting categories included in the analysis.

p-Hacking.JPGSource: FiveThirtyEight

While the accompanying story focuses on political research, it's an interesting read for anyone interested in why education findings can be so difficult to replicate, and why studies of the same data set often conflict. (It's also a pretty fun tool to play with.)

And for more on persnickety education research results, check out our look at why so many education results fade out over time.

Notice: We recently upgraded our comments. (Learn more here.) If you are logged in as a subscriber or registered user and already have a Display Name on edweek.org, you can post comments. If you do not already have a Display Name, please create one here.
Ground Rules for Posting
We encourage lively debate, but please be respectful of others. Profanity and personal attacks are prohibited. By commenting, you are agreeing to abide by our user agreement.
All comments are public.

Follow This Blog

Advertisement

Most Viewed on Education Week

Categories

Archives

Recent Comments