{"id":6686,"date":"2022-08-14T08:00:29","date_gmt":"2022-08-14T13:00:29","guid":{"rendered":"https:\/\/braindevs.net\/blog\/blog\/?p=6686"},"modified":"2022-08-06T14:48:47","modified_gmt":"2022-08-06T19:48:47","slug":"how-to-make-sure-homework-really-helps-a-k-a-retrieval-practice-fails","status":"publish","type":"post","link":"https:\/\/www.learningandthebrain.com\/blog\/how-to-make-sure-homework-really-helps-a-k-a-retrieval-practice-fails\/","title":{"rendered":"How To Make Sure Homework Really Helps (a.k.a.: &#8220;Retrieval Practice Fails&#8221;)"},"content":{"rendered":"<p>Most research focuses narrowly on just a few questions. For instance:<\/p>\n<p style=\"padding-left: 30px;\">&#8220;Does mindful meditation help 5th grade students reduce anxiety?&#8221;<\/p>\n<p style=\"padding-left: 30px;\">&#8220;How many instructions overwhelm college students&#8217; working memory?&#8221;<\/p>\n<p style=\"padding-left: 30px;\">&#8220;Do quizzes improve attention when students learn from online videos?&#8221;<\/p>\n<p>Very occasionally, however, just one study results in LOTS of teaching advice. For instance, <a href=\"https:\/\/www.tandfonline.com\/doi\/abs\/10.1080\/01443410.2020.1802645\" target=\"_blank\" rel=\"noopener\">this recent research<\/a> looks at data from ELEVEN YEARS of classroom teaching.<\/p>\n<p><a href=\"https:\/\/braindevs.net\/blog\/\/wp-content\/uploads\/2022\/08\/Student-Doing-Homework.jpg\"><img decoding=\"async\" class=\"alignleft size-medium wp-image-6691\" src=\"https:\/\/braindevs.net\/blog\/\/wp-content\/uploads\/2022\/08\/Student-Doing-Homework-300x225.jpg\" alt=\"Student Doing Homework with Laptop\" width=\"300\" height=\"225\" srcset=\"https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2022\/08\/Student-Doing-Homework-300x225.jpg 300w, https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2022\/08\/Student-Doing-Homework-768x576.jpg 768w, https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2022\/08\/Student-Doing-Homework.jpg 960w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>Professor Arnold Glass (writing with Mengxue Kang) has been looking at the benefits of various teaching strategies since 2008.<\/p>\n<p>For that reason, he can draw conclusions about those strategies. AND, he can draw conclusions about changes over time.<\/p>\n<p>The result: LOTS of useful guidance.<\/p>\n<p>Here&#8217;s the story&#8230;<\/p>\n<h2>The Research<\/h2>\n<p>Glass has been teaching college courses in Memory and Cognition for over a decade. Of course, he wants to practice what he preaches. For instance:<\/p>\n<p><strong>First<\/strong>, when Glass&#8217;s students learn about concepts, he begins by asking them to make plausible predictions about the topics they&#8217;re going to study.<\/p>\n<p>Of course, his students haven&#8217;t studied the topic yet, so they&#8217;re unlikely to get the answers right. But simply\u00a0<em>thinking<\/em> about these questions helps them remember the correct answers that they do learn.<\/p>\n<p>In research world, we often call this strategy &#8220;<a href=\"https:\/\/psycnet.apa.org\/record\/2009-14440-005\" target=\"_blank\" rel=\"noopener\"><strong>pretesting<\/strong><\/a>&#8221; or &#8220;prequestions.&#8221;<\/p>\n<p><strong>Second<\/strong>, after students learn the topics, he asks them to answer questions about them from memory.<\/p>\n<p>That is: he doesn&#8217;t want them to\u00a0<em>look up\u00a0<\/em>the correct answers, but to <em>try and remember<\/em> the correct answers.<\/p>\n<p>In research world, we call this technique &#8220;<a href=\"https:\/\/braindevs.net\/blog\/\/compared-to-what-is-retrieval-practice-really-better\/\" target=\"_blank\" rel=\"noopener\"><strong>retrieval practice<\/strong><\/a>&#8221; or &#8220;the testing effect.&#8221;<\/p>\n<p><strong>Third<\/strong>, Glass spreads these questions out over time. His students don&#8217;t answer retrieval practice questions once; they do so several times.<\/p>\n<p>In research world, we call this technique\u00a0&#8220;<a href=\"https:\/\/braindevs.net\/blog\/\/are-retrieval-practice-and-spacing-equally-important\/\" target=\"_blank\" rel=\"noopener\"><strong>spacing<\/strong><\/a>.&#8221;<\/p>\n<p>Because Glass connects all those pretesting and retrieval practice questions to exam questions, he can see which strategies benefit.<\/p>\n<p>And, because he&#8217;s been tracking data for years, he can see how those benefits change over time.<\/p>\n<h2>The Results: Good &amp; Bad<\/h2>\n<p>Obviously, Glass&#8217;s approach generates LOTS of results. So, let&#8217;s keep things simple.<\/p>\n<p><em>First Headline<\/em>: these strategies work.<\/p>\n<p style=\"padding-left: 30px;\">Pretesting and retrieval practice and spacing all help students learn.<\/p>\n<p style=\"padding-left: 30px;\">These results don&#8217;t surprise us, but we&#8217;re happy to have confirmation.<\/p>\n<p><em>Second Headline:\u00a0<\/em>but sometimes these strategies <strong>don&#8217;t<\/strong> work.<\/p>\n<p style=\"padding-left: 30px;\">In other words: <em>most of the time<\/em>, students get questions right on the final exam more often than they did for the pretesting and the retrieval practice.<\/p>\n<p style=\"padding-left: 30px;\">But, occasionally, <strong>students do better on the pretest question (or the retrieval practice question) than on the final exam.<\/strong><\/p>\n<p style=\"padding-left: 30px;\">Technically speaking, that result is BIZARRE.<\/p>\n<p>How can Glass explain this finding?<\/p>\n<h2>Tentative Explanations, Alarming Trends<\/h2>\n<p>Glass and Kang have a hypothesis to explain this &#8220;bizarre&#8221; finding. In fact, this study explores their hypothesis.<\/p>\n<p style=\"padding-left: 30px;\">Glass&#8217;s students answer the &#8220;pretesting&#8221; questions for homework. What if, instead of\u00a0<em>speculating<\/em> to answer those pretesting questions, the students look the answer up on the interwebs?<\/p>\n<p style=\"padding-left: 30px;\">What if, instead of answering &#8220;retrieval practice&#8221; questions by trying to remember, the students look up the answers?<\/p>\n<p>In these cases, the students would almost certainly get the answers right &#8212; so they would have <em>high<\/em> scores on these practice exercises.<\/p>\n<p>But they wouldn&#8217;t learn the information well, so they would have\u00a0<em>low<\/em> scores on the final exam.<\/p>\n<p style=\"padding-left: 30px;\">So, pretesting and retrieval practice work\u00a0<em>if students actually do it<\/em>.<\/p>\n<p style=\"padding-left: 30px;\">But if the students <em>look up answer instead of predicting<\/em>, they don&#8217;t get the benefits of prequestions.<\/p>\n<p style=\"padding-left: 30px;\">If they <em>look up the answer instead of trying to remember<\/em>, they don&#8217;t get the benefit of retrieval practice.<\/p>\n<p>And, here&#8217;s the &#8220;alarming trend&#8221;:\u00a0<strong>the percentage of students who look up the answers has been rising dramatically<\/strong>.<\/p>\n<p>How dramatically? In 2008, it was about <strong>15%<\/strong>. In 2018, it was about <strong>50%<\/strong>.<\/p>\n<h2>Promises Fulfilled<\/h2>\n<p>The title of the blog post promises to make homework helpful (and to point out when retrieval practice fails).<\/p>\n<p>So, here goes.<\/p>\n<p style=\"padding-left: 30px;\">Retrieval practice fails <em>when students don&#8217;t try to retrieve<\/em>.<\/p>\n<p style=\"padding-left: 30px;\">Homework that includes retrieval practice won&#8217;t help if students <em>look up the answers<\/em>.<\/p>\n<p>So, to make homework help (and to get the benefits of retrieval practice), <strong>we should do everything we reasonably can to prevent this shortcut<\/strong>.<\/p>\n<p>Three strategies come quickly to mind.<\/p>\n<p><strong>First<\/strong>: don&#8217;t just use prequestions and retrieval practice. Instead, explain the logic and the research behind them. Students should know: <em>they won&#8217;t get the benefits if they don&#8217;t do the thinking<\/em>.<\/p>\n<p><strong>Second<\/strong>:\u00a0as must as is reasonably possible, make homework low-stakes or no-stakes. Students have less incentive to cheat if doing so doesn&#8217;t get them any points. (And, they know that it harms their learning.)<\/p>\n<p><strong>Third<\/strong>: use <em>class time <\/em>for both strategies.<\/p>\n<p>In other words: we teachers ultimately can&#8217;t force students to &#8220;make educated predictions&#8221; or &#8220;try to remember&#8221; when they&#8217;re at home. But we can monitor them in class to ensure they&#8217;re doing so.<\/p>\n<p>These strategies, to be blunt, might not work well as homework &#8212; especially not at the beginning of the year. We should plan accordingly.<\/p>\n<h2>TL;DR<\/h2>\n<p>Prequestions and retrieval practice do help students learn, but only if students actually do the thinking these strategies require.<\/p>\n<p>We teachers should be realistic about our students&#8217; homework habits and incentives, and design assignments that nudge them in the right directions.<\/p>\n<p>&nbsp;<\/p>\n<p>Glass, A. L., &amp; Kang, M. (2022). Fewer students are benefiting from doing their homework: an eleven-year study.\u00a0<i>Educational Psychology<\/i>,\u00a0<i>42<\/i>(2), 185-199.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Most research focuses narrowly on just a few questions. For instance: &#8220;Does mindful meditation help 5th grade students reduce anxiety?&#8221; &#8220;How many instructions overwhelm college students&#8217; working memory?&#8221; &#8220;Do quizzes improve attention when students learn from online videos?&#8221; Very occasionally, however, just one study results in LOTS of teaching advice. For instance, this recent research [&hellip;]<\/p>\n","protected":false},"author":18,"featured_media":6691,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[197,57,12],"class_list":["post-6686","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lb-blog","tag-generation-effect","tag-homework","tag-retrieval-practice"],"_links":{"self":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/6686","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/comments?post=6686"}],"version-history":[{"count":5,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/6686\/revisions"}],"predecessor-version":[{"id":6692,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/6686\/revisions\/6692"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media\/6691"}],"wp:attachment":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media?parent=6686"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/categories?post=6686"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/tags?post=6686"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}