« Gender Bender: The AAUW's New Report on Gender Equity | Main | skoolboy's Platinum Law of Educational Research »

Violation of the Iron Law of Qualitative Research in Education, #1,321

| 14 Comments
The Iron Law: The number of participants in the study should exceed the number of authors on the paper.

Yet I opened up the latest issue of the American Educational Research Journal to discover a violation of said rule in the article, "The Emotional Ambivalence of Socially Just Teaching: A Case Study of A Novice Urban Schoolteacher," which has two authors. Got to love the "convenience sample" - the novice teacher is a former student of one of the authors. Jay Greene, I am totally going to dominate your bingo game with one article only.

No disrespect to qualitative research intended here - in fact, I believe qualitative research is critical to educational research and policy. But qualitative research comes in many flavors (as does quantitative research), and studies like this one do not help the cause.
14 Comments

Oh, you'll have to do better than this, eduwonkette. What exactly is the problem here? The sample size? The use of a convenience sample? The opaque language and jargon? The authors' extrapolations or generalizations from their data? Any or all of these could be a source of concern, but you're not telling us what's problematic and why.

All of the above - but my original concern was the sample size. If you're studying emotional ambivalence, isn't that something that we'd expect to vary - so you'd want to study more than one teacher???

If this was a study of a rare psychological disease, great - one person will do. But it's not.

The problem? Did you read the abstract? What language is this in?

"The authors contend that studying emotional perspectives can facilitate understanding of the complexities of socially just teaching. They explore the intersection between emotions and socially just teaching via a case study of a White novice teacher at one urban school as she struggles to formulate socially just teaching practices. Drawing from feminist and critical theory, the authors propose the term critical emotional praxis to denote critical praxis informed by emotional resistance to unjust pedagogical systems and practices. The authors’ analysis may assist in the development of socially just teachers: First, emotions and their expression play an important, ongoing role in socially just teaching, and second, emotional negotiation related to socially just teaching can provide deeper understanding of possible change, perhaps even in counterresponse to wider social, political contexts of schools."

What we have here is a failure to communicate...

I should not have to defend the value and merit of qualitative research. (Those arguments has been made within the educational research community by far more articulate writers and thinkers for the last thirty years, often in journals the caliber of AERJ.)

What I think would be helpful to this discussion would be a few questions. 1. How do we, as the education community, best address "unjust pedagogical systems" in our classrooms if not through a focused, critical lens? 2. In what way can/should research take up the mantle of sticky issues, such as socially just teaching? and 3. How do we make room for theory within educational discourses littered with soundbites and spin...

These are just thoughts???

Hi Into the Breach,

Just to be clear, I am not criticizing qualitative research. I am criticizing poorly designed and executed qualitative research. And if qualitative research is ever to be taken seriously, it's important that we apply some quality control.

That said, these are good questions to start with. First, can you explain what you mean by socially just teaching?

Edw'ette, you didn't need any further clarification about your respect for quality qualitative research.

You made yourself perfectly clear: " . . . I believe qualitative research is critical to educational research and policy."

If people have trouble understanding the meaning of a couple of simple sentences, imagine the trouble they'd have intepreting data.


It seems to me that talking to *one* ambivalent teacher may help you formulate a hypothesis, but it takes talking to (at least) two or three more to test it.

Can someone help me out here -- what are "unjust pedagogical systems and practices"? I had thought that pedagogy might be more or less effective, but unjust?

Hi Rachel,
Agreed that this is a useful way to pilot a future study - but it's not a study worthy of publication in one of AERA's flagship journals.

Stuart, I wish I could help with your question.

Edwonkette,

It is not about research--it is about gaining tenure. A lot of crap gets published because every university and college now expects their faculty to conduct "research."

Thanks to eduwonkette (and to commenters) for my first laugh of the morning! This is not the first time I've seen a ridiculous study.

I agree with eduwonkette. Qualitative research is indeed essential. But it has to follow some guidelines. And, of course, clear English helps both the researcher and the reader identify the main points.

In ed school we had two big qualitative research assignments: one, an "observation" of a particular student; the other, an "action research" project about our own teaching practice. In the one, the study had a single subject. In the other, the author and subject were one and the same.

I protested the "action research" requirement and was on the verge of refusing to do it. A colleague who had been teaching a few years longer pulled me aside and said: "Just get it over with and finish ed school." So, I did, but devoted a large part of the paper to my concerns.

Of course, with thousands of ed students churning out research on themselves, someone's got to publish it....

Good Morning Eduwonkette...

I have to say an interesting discussion has unfolded. It is fun to read the varied opinions and understandings...

To your points... I thoroughly agree in the need for rigorous and quality research across the bredth of research paradigms. We have a great deal to learn about how to best meet the needs of all our children in our classrooms and it will take all research methods to achieve that goal. I would like to suggest that standards of rigor and quality for more qualitatively-oriented approaches to research, standards that rely on contextually-driven factors (such as time in "field" and explicit/transparent data analysis mechanisms, for example) and principals commonly understood in the fields of anthropology and certain areas within sociology, are a bit different from the research standards that rely on concepts like sampling, control, and statistical significance. Qualitative research will always appear meek and useless when held up to inaccurate/inappropriate measures of rigor. So, from my perspective I question "the Iron Law" from the standpoint it still relies on the idea that more (number of participants) is better, which in the end would ultimately priveledge large studies and deny the value of tightly focused, "thickly described," theory-generating work...Just a thought...

With respect to your question about socially just teaching...I will reference the authors of the study in question. They write, "The authors’ analysis may assist in the development of socially just teachers: First, emotions and their expression play an important, ongoing role in socially just teaching, and second, emotional negotiation related to socially just teaching can provide deeper understanding of possible change, perhaps even in counterresponse to wider social, political contexts of schools."

The authors suggest the theory they are developing (a term "critical emotional praxis") may in the future be utilized to help teachers become socially just...as they define it... So, the point of this piece is to offer "critical" and "feminist" insight into the practice of teaching--to build theory (not test an intervention, quantify the impact of a policy, or determine a child's readiness to learn...all important knowledge pursuits in and of themselves, but not this research question.)

After considering this discussion, I am left with the question where is the place of theory in today's educational discourse?

Thanks.

From someone who's not knowledgeable about the standards commonly applied to qualitative research (or quantitative research either), why would you not call the article under discussion a "case study informed by theory" rather than "research?"

I'm all for single subject study but don't call it research. Call it an essay at least or a story about my friend. I guess they couldn't find any other discouraged new white teachers in an urban school.

Comments are now closed for this post.

Advertisement

Recent Comments

  • J.M. Holland: I'm all for single subject study but don't call it read more
  • Jane: From someone who's not knowledgeable about the standards commonly applied read more
  • Into the breach: Good Morning Eduwonkette... I have to say an interesting discussion read more
  • Diana Senechal: Thanks to eduwonkette (and to commenters) for my first laugh read more
  • Ed: Edwonkette, It is not about research--it is about gaining tenure. read more

Archives

Categories

Technorati

Technorati search

» Blogs that link here

Tags

8th grade retention
Fordham Foundation
The New Teacher Project
Tim Daly
absent teacher reserve
absent teacher reserve

accountability
accountability in Texas
accountability systems in education
achievement gap
achievement gap in New York City
acting white
admissions
AERA
AERA annual meetings
AERA conference
AERJ
Alexander Russo
Algebra II
American Association of University Women
American Education Research Associatio
American Education Research Association
American Educational Research Journal
American Federation of Teachers
Andrew Ho
Art Siebens
ATR
Baltimore City Public Schools
Barack Obama
Bill Ayers
black-white achievement gap
books
books on educational research
boy crisis
brain-based education
Brian Jacob
bubble kids
Building on the Basics
Cambridge Education
carnival of education
Caroline Hoxby
Caroline Hoxby charter schools
cell phone plan
charter schools
Checker Finn
Chicago
Chicago shooting
Chicago violence
Chris Cerf
class size
Coby Loup
college access
cool people you should know
credit recovery
curriculum narrowing
D3M
Dan Willingham
data driven
data-driven decision making
data-driven decision-making
David Cantor
DC
Dean Millot
demographics of schoolchildren
Department of Assessment and Accountability
Department of Education budget
desegregation
Diplomas Count
disadvantages of elite education
do schools matter
Doug Ready
Doug Staiger
dropout factories
dropout rate
dropouts
education books
education policy
education policy thinktanks
educational equity
educational research
educational triage
effects of neighborhoods on education
effects of No Child Left Behind
effects of schools
effects of Teach for America
elite education
ETS
Everyday Antiracism
excessed teachers
exit exams
experienced teachers
Fordham and Ogbu
Fordham Foundation
Frederick Douglass High School
Gates Foundation
gender
gender and education
gender and math
gender and science and mathematics
gifted and talented
gifted and talented admissions
gifted and talented program
gifted and talented programs in New York City
girls and math
good schools
graduate student union
graduation rate
graduation rates
guns in Chicago
health benefits for teachers
High Achievers
high school
high school dropouts
high school exit exams
high school graduates
high school graduation rate
high-stakes testing
high-stakes tests and science
higher ed
higher education
highly effective teachers
Houston Independent School District
how to choose a school
IES
incentives in education
Institute for Education Sciences
is teaching a profession?
is the No Child Left Behind Act working
Jay Greene
Jim Liebman
Joel Klein
John Merrow
Jonah Rockoff
Kevin Carey
KIPP
KIPP and boys
KIPP and gender
Lake Woebegon
Lars Lefgren
leaving teaching
Leonard Sax
Liam Julian

Marcus Winters
math achievement for girls
McGraw-Hill
meaning of high school diploma
Mica Pollock
Michael Bloomberg
Michelle Rhee
Michelle Rhee teacher contract
Mike Bloomberg
Mike Klonsky
Mike Petrilli
narrowing the curriculum
National Center for Education Statistics Condition of Education
NCLB
neuroscience
new teachers
New York City
New York City bonuses for principals
New York City budget
New York City budget cuts
New York City Budget cuts
New York City Department of Education
New York City Department of Education Truth Squad
New York City ELA and Math Results 2008
New York City gifted and talented
New York City Progress Report
New York City Quality Review
New York City school budget cuts
New York City school closing
New York City schools
New York City small schools
New York City social promotion
New York City teacher experiment
New York City teacher salaries
New York City teacher tenure
New York City Test scores 2008
New York City value-added
New York State ELA and Math 2008
New York State ELA and Math Results 2008
New York State ELA and Math Scores 2008
New York State ELA Exam
New York state ELA test
New York State Test scores
No Child Left Behind
No Child Left Behind Act
passing rates
Pearson
picking a school
press office
principal bonuses
proficiency scores
push outs
pushouts
qualitative educational research
qualitative research in education
quitting teaching
race and education
racial segregation in schools
Randall Reback
Randi Weingarten
Randy Reback
recovering credits in high school
Rick Hess
Robert Balfanz
Robert Pondiscio
Roland Fryer
Russ Whitehurst
Sarah Reckhow
school budget cuts in New York City
school choice
school effects
school integration
single sex education
skoolboy
small schools
small schools in New York City
social justice teaching
Sol Stern
SREE
Stefanie DeLuca
stereotype threat
talented and gifted
talking about race
talking about race in schools
Teach for America
teacher effectiveness
teacher effects
teacher quailty
teacher quality
teacher tenure
teachers
teachers and obesity
Teachers College
teachers versus doctors
teaching as career
teaching for social justice
teaching profession
test score inflation
test scores
test scores in New York City
testing
testing and accountability
Texas accountability
TFA
The No Child Left Behind Act
The Persistence of Teacher-Induced Learning Gains
thinktanks in educational research
Thomas B. Fordham Foundation
Tom Kane
Tweed
University of Iowa
Urban Institute study of Teach for America
Urban Institute Teach for America
value-addded
value-added
value-added assessment
Washington
Wendy Kopp
women and graduate school science and engineering
women and science
women in math and science
Woodrow Wilson High School