{"id":6060,"date":"2021-02-23T08:00:14","date_gmt":"2021-02-23T13:00:14","guid":{"rendered":"https:\/\/braindevs.net\/blog\/blog\/?p=6060"},"modified":"2021-02-21T11:20:31","modified_gmt":"2021-02-21T16:20:31","slug":"when-evidence-conflicts-with-teachers-experience","status":"publish","type":"post","link":"https:\/\/www.learningandthebrain.com\/blog\/when-evidence-conflicts-with-teachers-experience\/","title":{"rendered":"When Evidence Conflicts with Teachers’ Experience"},"content":{"rendered":"

Here’s an interesting question:\u00a0do students — on average — benefit when they repeat a grade?<\/em><\/p>\n

\"\"<\/a><\/p>\n

As you contemplate that question, you might notice the\u00a0kind of evidence<\/em> that you thought about.<\/p>\n

Perhaps<\/strong> you thought: “I studied this question in graduate school. The research<\/em> showed that answer is X.”<\/p>\n

Perhaps<\/strong> you thought: “I knew a student who repeated a grade. Her experience<\/em> showed that the answer is X.”<\/p>\n

In other words: our teaching beliefs might rest on research, or on personal experience. Almost certainly, they draw on a complex blend of both research and experience.<\/p>\n

So, here’s today’s question: what happens when I see research<\/em> that directly contradicts my experience<\/em>?<\/p>\n

If I, for instance, think that cold calling <\/a>is a bad idea<\/em>, and research shows it’s a good idea<\/em>, I might…<\/p>\n

… change my beliefs and conclude it’s a good idea, or<\/p>\n

… preserve my beliefs and insist it’s a bad idea. In this case, I might…<\/p>\n

… generalize my doubts and conclude\u00a0education research generally<\/em> doesn’t have much merit. I might even…<\/p>\n

… generalize those doubts even further and conclude that research in other fields (like medicine) can’t help me reach a wise decision.<\/p>\n

If my very local doubts about cold-calling research spread beyond this narrow question, such a conflict could create ever-widening ripples of doubt.<\/p>\n

Today’s Research<\/h2>\n

A research team in Germany, led by Eva Thomm,\u00a0looked at this question<\/a>, with a particular focus on teachers-in-training. These pre-service teachers, presumably, haven’t studied much research on learning, and so most of their beliefs come from personal experience.<\/p>\n

What happens when research contradicts those beliefs?<\/p>\n

Thomm ran an online study with 150+ teachers-in-training across Germany. (Some were undergraduates; others graduate students.)<\/p>\n

Thomm’s team asked teachers to rate their beliefs on the effectiveness of having students repeat a year. The teachers then read research that contradicted (or, in half the cases,\u00a0confirmed) those beliefs. What happened next?<\/p>\n

Thomm’s results show an interesting mix of bad and good news:<\/p>\n

Alas<\/strong>: teachers who read contradictory evidence tended to say that they doubted its accuracy.<\/p>\n

Worse still: they started to rely less <\/em>on scientific sources (research) and more<\/em> on other sources (opinions of colleagues and students).<\/p>\n

The Good News<\/h2>\n

First<\/strong>: teachers’ doubts did not generalize outside education<\/em>. That is: however vexed they were to find research contradicting prior beliefs about repeating a year, they did not conclude that medical research couldn’t be trusted.<\/p>\n

Second<\/strong>:\u00a0teachers’ doubts did not generalize within education<\/em>. That is: they might have doubted findings about repeating a year, but they didn’t necessarily reject research into cold calling.<\/p>\n

Third<\/strong>: despite their expressed doubts, teachers did begin to change their minds<\/em>. They simultaneously expressed skepticism about the research AND let it influence their thinking.<\/p>\n

Simply put, this research could have discovered truly bleak belief trajectories. (“If you tell me that cold calling is bad, I’ll stop believing research about vitamin D!”) Thomm’s research\u00a0did not<\/strong> see that pattern at work.<\/p>\n

Caveats, Caveats<\/h2>\n

Dan Willingham says: “one study is just one study, folks.” Thomm’s research gives us interesting data, but it does not answer this question completely, once and for all. (No one study does. Research can’t do that.)<\/p>\n

Two points jump out at me.<\/p>\n

First, Thomm’s team worked with teachers in Germany<\/strong>. I don’t know if German society values research differently than other societies do. (Certainly US society has a conspicuously vexed relationship with research-based advice.) So, this research might not hold true in other countries or social belief systems.<\/p>\n

Second, her participants initially “reported a positive view on the potency of research and indicated a higher appreciation of scientific than of non-scientific sources.” That is, she\u00a0started\u00a0<\/em>with people who trusted in science and research. Among people who start more skeptical — perhaps in a society that’s more skeptical — these optimistic patterns might not repeat.<\/p>\n

And a final note.<\/p>\n

You might reasonably want to know: what’s the answer to the question?<\/em> Does repeating a year help students?<\/p>\n

The most honest answer is: I’m not an expert on that topic, and don’t really know.<\/p>\n

The most comprehensive analysis I’ve seen<\/a>, over at the Education Endowment Foundation, says: NO:<\/p>\n

“Evidence suggests that, in the majority of cases, repeating a year is harmful to a student\u2019s chances of academic success.” (And, they note, it costs A LOT.)<\/p><\/blockquote>\n

If you’ve got substantial contradictory evidence that can inform this question, I hope you’ll send it my way.<\/p>\n","protected":false},"excerpt":{"rendered":"

Here’s an interesting question:\u00a0do students — on average — benefit when they repeat a grade? As you contemplate that question, you might notice the\u00a0kind of evidence that you thought about. Perhaps you thought: “I studied this question in graduate school. The research showed that answer is X.” Perhaps you thought: “I knew a student who […]<\/p>\n","protected":false},"author":18,"featured_media":6063,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[19,81],"class_list":["post-6060","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lb-blog","tag-skepticism","tag-teacher-development"],"_links":{"self":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/6060","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/comments?post=6060"}],"version-history":[{"count":4,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/6060\/revisions"}],"predecessor-version":[{"id":6065,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/6060\/revisions\/6065"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media\/6063"}],"wp:attachment":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media?parent=6060"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/categories?post=6060"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/tags?post=6060"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}