{"id":2582,"date":"2017-11-29T08:00:52","date_gmt":"2017-11-29T08:00:52","guid":{"rendered":"https:\/\/braindevs.net\/blog\/blog\/?p=2582"},"modified":"2017-12-06T21:33:05","modified_gmt":"2017-12-06T21:33:05","slug":"welcome-to-the-messiness","status":"publish","type":"post","link":"https:\/\/www.learningandthebrain.com\/blog\/welcome-to-the-messiness\/","title":{"rendered":"Welcome to &#8220;the Messiness&#8221;"},"content":{"rendered":"<p><a href=\"https:\/\/braindevs.net\/blog\/\/wp-content\/uploads\/2017\/11\/AdobeStock_47527235_Credit.jpg\"><img decoding=\"async\" class=\"aligncenter size-large wp-image-2587\" src=\"https:\/\/braindevs.net\/blog\/\/wp-content\/uploads\/2017\/11\/AdobeStock_47527235_Credit-1024x615.jpg\" alt=\"AdobeStock_47527235_Credit\" width=\"640\" height=\"384\" srcset=\"https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2017\/11\/AdobeStock_47527235_Credit-1024x615.jpg 1024w, https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2017\/11\/AdobeStock_47527235_Credit-300x180.jpg 300w\" sizes=\"(max-width: 640px) 100vw, 640px\" \/><\/a><\/p>\n<p>In a recent <a href=\"https:\/\/braindevs.net\/blog\/\/meet-the-speakers-dr-pooja-k-agarwal\/\" target=\"_blank\">interview<\/a> on this blog, Dr. Pooja K. Agarwal spoke about the benefits of\u00a0<strong>retrieval practice<\/strong>: a study technique that&#8211;in her words&#8211;focuses on pulling information OUT of students&#8217; brains rather than getting it back IN.<\/p>\n<p>For example: if I begin today&#8217;s class by having my students write down three things they remember\u00a0from yesterday&#8217;s lesson on the Han dynasty, that&#8217;s retrieval practice. After all, they&#8217;re going back into their memories and drawing\u00a0OUT facts and ideas we discussed.<\/p>\n<p>If, however, I begin by briefly summarizing yesterday&#8217;s class, well, then I&#8217;m trying to put information back IN. That&#8217;s not retrieval practice.<\/p>\n<p>Dr. Agarwal summarizes the benefits of retrieval practice thus: &#8220;it works for all students in all subjects, all the time.&#8221;<\/p>\n<p>Sounds tempting, no?<\/p>\n<p><strong>Pushing Boundaries<\/strong><\/p>\n<p>In one part of our conversation, Dr. Aragwal notes that she likes doing research in actual classrooms with actual students&#8211;rather than in psychology labs in highly controlled conditions&#8211;because &#8220;I really like <em>the messiness<\/em> of\u00a0of doing scientific research in classrooms. The fire alarms, and school assemblies, and kids who are out sick, I really enjoy it because it pushes boundaries.&#8221;<\/p>\n<p>In the spirit of <em>messiness<\/em>, here&#8217;s a recent <a href=\"http:\/\/www.learningscientists.org\/blog\/2017\/8\/4-1\">post<\/a> from the Learning Scientists about using retrieval practice in elementary school to learn vocabulary.<\/p>\n<p>The good news about this study:<\/p>\n<p><em>First<\/em>: it took place in a real school with real students, not in a psychology lab. That means its results are likelier to be meaningful to teachers.<\/p>\n<p><em>Second<\/em>: the participants were 9-year-olds, not college students. So, we can be more confident that retrieval practice works with&#8230;say&#8230;4th graders.<\/p>\n<p>Third: the study took place in the Netherlands, so we&#8217;ve got reason to believe that the benefits go beyond a North American cultural context.<\/p>\n<p>So far, so good.<\/p>\n<p><strong>Let the Messiness Begin<\/strong><\/p>\n<p>At the same time, this particular study revealed a few muddles as well.<\/p>\n<p>Muddle #1: the size of the benefit was relatively small. Retrieval practice\u00a0produced more learning than simple restudy, and more than &#8220;elaborative retrieval,&#8221; but statistically speaking that difference was harder to find than in a psychology lab.<\/p>\n<p>Muddle #2: Dr. Agarwal&#8217;s research shows that <em>fill-in-the-blank<\/em> retrieval practice and <em>multiple-choice<\/em> retrieval practice are equally effective. This study, however, contradicts that finding; multiple-choice retrieval didn&#8217;t produce more learning than pure restudy.<\/p>\n<p>Muddle #3: believe it or not, muddle #3 contradicts muddle #2. Because of the study design, the authors acknowledge that their own findings about multiple-choice tests aren&#8217;t fully persuasive. For example: because the average score on the multiple-choice tests was above a 90%, there wasn&#8217;t enough difference among the students&#8217; scores to calculate meaningful effects.<\/p>\n<p>What should teachers do with all this contradictory information?<\/p>\n<p>My advice<em>: Embrace the muddle.<\/em><\/p>\n<p>Teachers should <em>expect<\/em> that different studies produce muddled&#8211;and occasionally contradictory&#8211;results.<\/p>\n<p>No one study tells us everything we need to know about retrieval practice. Instead, we&#8217;re looking for <em>patterns<\/em> of findings.<\/p>\n<p>If we do ten studies, and eight of them show that retrieval practice helps learning, <em>that&#8217;s impressive<\/em>. We don&#8217;t need to be thrown off by one study that shows no effect&#8211;or, as in this case, a relatively smaller effect than in a psych lab.<\/p>\n<p><strong>The\u00a0Quiet Finding<\/strong><\/p>\n<p>Although the authors don&#8217;t dwell on this point, one finding jumped out at me.<\/p>\n<p>In one of the restudy conditions, students were asked to &#8220;elaborate&#8221; on the meaning of the word. For example, as they tried to remember &#8220;compost pile,&#8221; they were asked to circle the words relating to a compost pile on this list:\u00a0<em>manure, plastic, delicious, orange-peels, mailbox, dead leaves.<\/em><\/p>\n<p>My teacherly instincts tell me that this restudy condition ought to help students. After all, to circle the correct words, they have to <em>think a bit harder<\/em> about the meaning of the phrase &#8220;compost pile.&#8221; That additional thought strikes me as a <strong>desirable difficulty<\/strong>, and ought to produce more learning.<\/p>\n<p>But&#8211;at least in this one study&#8211;it didn&#8217;t. Students who &#8220;elaboratively restudied&#8221; scored between the &#8220;pure restudy&#8221; group and the &#8220;retrieval practice&#8221; group&#8211;and their scores weren&#8217;t significantly different from either.<\/p>\n<p><strong>The Take-Aways&#8230;<\/strong><\/p>\n<p>I myself reach three conclusions based on this research:<\/p>\n<p>A) Yup: retrieval practice still works, even with 4th graders, even with vocabulary learning, even in the Netherlands.<\/p>\n<p>B) My instincts about elaborative restudy might be off. I should keep my eyes peeled for further research.<\/p>\n<p>C) The muddle isn&#8217;t disheartening, it&#8217;s enjoyable. Jump in&#8211;the water&#8217;s warm!<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In a recent interview on this blog, Dr. Pooja K. Agarwal spoke about the benefits of\u00a0retrieval practice: a study technique that&#8211;in her words&#8211;focuses on pulling information OUT of students&#8217; brains rather than getting it back IN. For example: if I begin today&#8217;s class by having my students write down three things they remember\u00a0from yesterday&#8217;s lesson [&hellip;]<\/p>\n","protected":false},"author":18,"featured_media":2587,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[15,12],"class_list":["post-2582","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lb-blog","tag-classroom-advice","tag-retrieval-practice"],"_links":{"self":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/2582","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/comments?post=2582"}],"version-history":[{"count":8,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/2582\/revisions"}],"predecessor-version":[{"id":2608,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/2582\/revisions\/2608"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media\/2587"}],"wp:attachment":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media?parent=2582"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/categories?post=2582"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/tags?post=2582"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}