{"id":4294,"date":"2019-02-25T08:00:09","date_gmt":"2019-02-25T13:00:09","guid":{"rendered":"https:\/\/braindevs.net\/blog\/blog\/?p=4294"},"modified":"2025-02-26T06:54:33","modified_gmt":"2025-02-26T11:54:33","slug":"can-teachers-be-trusted-to-evaluate-research","status":"publish","type":"post","link":"https:\/\/www.learningandthebrain.com\/blog\/can-teachers-be-trusted-to-evaluate-research\/","title":{"rendered":"Can Teachers Be Trusted to Evaluate Research?"},"content":{"rendered":"

In a blog post, David Didau raises concerns about \u201cthe problem with teachers\u2019 judgment<\/a>.\u201d<\/p>\n

\"\"<\/a><\/p>\n

Here goes:<\/p>\n

If a brain expert offers me a teaching suggestion, I might respond: \u201cWell, I know my students, and that technique just wouldn\u2019t work with them.\u201d<\/p>\n

Alas, this rebuttal simply removes me from the realm of scientific discussion.<\/p>\n

Scientific research functions only when a claim can be disproven. Yet the claim \u201cI know my students better than you do\u201d can\u2019t be disproven.<\/p>\n

Safe in this \u201cI know my students\u201d fortress, I can resist all outside guidance.<\/p>\n

As Didau writes:<\/p>\n

If, in the face of contradictory evidence, we [teachers] make the claim that a particular practice \u2018works for me and my students\u2019, then we are in danger of adopting an unfalsifiable position. We are free to define \u2018works\u2019 however we please.<\/p><\/blockquote>\n

It\u2019s important to note: Didau isn\u2019t arguing with a straw man. He\u2019s responding to a tweet in which a former teacher proudly announces: \u201cI taught 20 years without evidence or research…I chose to listen to my students.\u201d<\/p>\n

(Didau’s original post is a few years old; he recently linked to it to rebut this teacher’s bluff boast.)<\/p>\n

Beware Teachers’ Judgment, Part 2<\/h2>\n

In their excellent book\u00a0Understanding How We Learn<\/em>, the\u00a0Learning Scientists<\/a> Yana Weinstein and Megan Sumeracki make a related pair of arguments.<\/p>\n

They perceive in teachers “a huge distrust of any information that comes ‘from above’ “… and “a preference for relying on [teachers’] intuitions” (p. 22).<\/p>\n

And yet, as they note,<\/p>\n

There are two major problems that arise from a reliance on intuition.<\/p>\n

The first is that our intuitions can lead us to pick the wrong learning strategies.<\/p>\n

Second, once we land on a learning strategy, we tend to seek out “evidence” that favors the strategy we have picked. (p. 23)<\/p><\/blockquote>\n

Weinstein and Sumeracki cite lots of data supporting these concerns.<\/p>\n

For instance, college students believe that rereading a textbook leads to more learning than does retrieval practice — even when their own experience shows the opposite<\/a><\/em>.<\/p>\n

The Problems with the Problem<\/h2>\n

I myself certainly agree that teachers should listen to guidance from psychology and neuroscience. Heck: I\u2019ve spent more than 10 years making such research a part of my own teaching, and helping others do so too.<\/p>\n

And yet, I worry that this perspective overstates its case.<\/p>\n

Why? Because as I see it, we absolutely must rely on teachers\u2019 judgment — and even intuition<\/em>. Quite literally, we have no other choice. (I\u2019m an English teacher. When I write \u201cliterally,\u201d I mean literally<\/em>.)<\/p>\n

At a minimum, I see three ways that teachers\u2019 judgments must be a cornerstone in teacher-researcher conversations.<\/p>\n

Judgment #1: Context Always Matters<\/h2>\n

Researchers arrive at specific findings. And yet, the context<\/strong> in which we teach a) always matters, and b) almost never matches the context in which the research was done.<\/p>\n

And therefore, we must rely on teachers\u2019 judgments to translate<\/em> the specific finding to our specific context.<\/p>\n

For example: the estimable Nate Kornell has shown that the spacing effect applies to study with flashcards<\/a>. In his research, students learned more by studying 1 pile of 20 flashcards than 4 piles of 5 flashcards. The bigger pile spaced out practice of specific flashcards, and thus yielded more learning.<\/p>\n

So, clearly, we should always tell our students to study with decks of 20 flashcards.<\/p>\n

No, we should not.<\/em><\/p>\n

Kornell\u2019s study showed that college students reviewing pairs of words<\/em> learned more from 20-flashcard piles than 5-flashcard piles. But, I don\u2019t teach college students. And: my students simply NEVER learn word pairs.<\/p>\n

So: I think Kornell\u2019s research gives us useful\u00a0general guidance<\/em>. Relatively large<\/em> flashcard decks will probably result in more learning than relatively small<\/em> ones. But, \u201crelatively large\u201d and \u201crelatively small\u201d will vary.<\/p>\n

Doubtless, 2nd<\/sup> graders will want smaller decks than 9th<\/sup> graders.<\/p>\n

Complex definitions will benefit from smaller decks than simple ones.<\/p>\n

Flashcards with important historical dates can be studied in larger piles than flashcards with lengthy descriptions.<\/p>\n

In every case, we have to rely on \u2026 yes \u2026 teachers\u2019 judgments to translate a broad research principle to the specific classroom context.<\/p>\n

Judgment #2: Combining Variables<\/h2>\n

Research works by isolating variables<\/em>. Classrooms work by combining variables<\/em>.<\/p>\n

Who can best combine findings from various fields? Teachers<\/em>.<\/p>\n

So: we know from psychology research that interleaving<\/strong> improves learning.<\/p>\n

We also know from psychology research that working memory overload<\/strong> impedes learning.<\/p>\n

Let\u2019s put those findings together and ask: at what point does too much interleaving lead to working memory overload<\/em>?<\/p>\n

It will be simply impossible for researchers to explore all possible combinations of interleaving within all levels of working memory challenge.<\/p>\n

The best we can do: tell teachers about the benefits of interleaving, warn them about the dangers of WM overload \u2013 and let them use their judgment to find the right combination.<\/p>\n

Judgment #3: Resolving Disputes<\/h2>\n

Some research findings point consistently in one direction. But, many research fields leave plenty of room for doubt, confusion, and contradiction.<\/p>\n

For example: the field of retrieval practice<\/strong> is (seemingly) rock solid. We\u2019ve got all sorts of research<\/a> showing its effectiveness. I tell teachers and students about its benefits all the time.<\/p>\n

And yet, we still don\u2019t understand its boundary conditions well.<\/p>\n

As I wrote last week, we do know that RP improves memory of specifically tested<\/em> facts and processes. But we don\u2019t know if it improves memory of facts and processes adjacent<\/em> to the ones that got tested.<\/p>\n

This study<\/a> says it does. This one<\/a> says it doesn\u2019t.<\/p>\n

So: what should the teacher do right now, before we get a consistent research answer? We should hear about the current research, and then use our best judgment<\/em>.<\/p>\n

One Final Point<\/h2>\n

People who don\u2019t want to rely on teacherly judgment might respond thus: \u201cwell, teachers have to be willing to listen to research, and to make changes to their practice based upon it.\u201d<\/p>\n

For example, that teacher who boasted<\/strong> about ignoring research is no model for our work.<\/p>\n

I heartily \u2013 EMPHATICALLY \u2013 agree with that point of view.<\/p>\n

At the same time, I ask this question: \u201cwhy would teachers listen to research-based guidance if those offering it routinely belittle our judgment in the first place?\u201d<\/p>\n

If we start by telling teachers that their judgment is not to be trusted, we can\u2019t be surprised that\u00a0they respond with “a huge distrust of any information that comes ‘from above’.”<\/p>\n

So, here\u2019s my suggestion: the field of Mind, Brain, Education should emphasize equal partnership<\/em>.<\/p>\n

Teachers: listen respectfully to relevant psychology and neuroscience research. Be willing to make changes to your practice based upon it.<\/p>\n

Psychology and neuroscience researchers: listen respectfully to teachers\u2019 experience. Be up front about the limits of your knowledge and its applicability.<\/p>\n

Made wiser by these many points of view, we can all trust each other to do our best within our fields of expertise.<\/p>\n","protected":false},"excerpt":{"rendered":"

Too often, teachers hear that our judgment about classroom applications of scientific research isn’t to be trusted. And yet, teacher judgment is essential when applying research in the classroom. Given that psychology research affects classroom practice only when teachers use it, why put down the teachers who are essential partners in this process? Our field should focus not on competition, but on respectful collaboration.<\/p>\n","protected":false},"author":18,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[27,28,12,30],"class_list":["post-4294","post","type-post","status-publish","format-standard","hentry","category-lb-blog","tag-boundary-conditions","tag-methodology","tag-retrieval-practice","tag-working-memory"],"_links":{"self":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/4294","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/comments?post=4294"}],"version-history":[{"count":11,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/4294\/revisions"}],"predecessor-version":[{"id":4323,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/4294\/revisions\/4323"}],"wp:attachment":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media?parent=4294"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/categories?post=4294"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/tags?post=4294"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}