{"id":5600,"date":"2020-04-18T08:00:03","date_gmt":"2020-04-18T13:00:03","guid":{"rendered":"https:\/\/braindevs.net\/blog\/blog\/?p=5600"},"modified":"2020-04-17T10:58:24","modified_gmt":"2020-04-17T15:58:24","slug":"beyond-retrieval-practice-the-benefits-of-student-generated-questions","status":"publish","type":"post","link":"https:\/\/www.learningandthebrain.com\/blog\/beyond-retrieval-practice-the-benefits-of-student-generated-questions\/","title":{"rendered":"Beyond Retrieval Practice: The Benefits of Student-Generated Questions"},"content":{"rendered":"<p><strong>Retrieval Practice<\/strong> has gotten a lot of press in recent years &#8212; especially at our conference last fall on Deeper Learning.<\/p>\n<p><a href=\"https:\/\/braindevs.net\/blog\/\/wp-content\/uploads\/2020\/04\/AdobeStock_334665163_CRedit.jpg\"><img decoding=\"async\" class=\"alignleft size-medium wp-image-5604\" src=\"https:\/\/braindevs.net\/blog\/\/wp-content\/uploads\/2020\/04\/AdobeStock_334665163_CRedit-300x200.jpg\" alt=\"\" width=\"300\" height=\"200\" srcset=\"https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2020\/04\/AdobeStock_334665163_CRedit-300x200.jpg 300w, https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2020\/04\/AdobeStock_334665163_CRedit-768x512.jpg 768w, https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2020\/04\/AdobeStock_334665163_CRedit.jpg 829w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>The short version: students don&#8217;t benefit much from <em>simple review &#8212; <\/em>say, rereading a passage. But, they benefit a lot from <em>actively trying to recall<\/em> information &#8212; say, answering questions about that passage.<\/p>\n<p>Dr. Pooja Agarwal puts it this way: Students should practice <strong>not<\/strong> by trying to <em>put information into<\/em> their brains, but by trying to <em>take information out<\/em>.<\/p>\n<p>(She and Patrice Bain have written a great book on the topic: <a href=\"https:\/\/braindevs.net\/blog\/\/the-best-teaching-book-to-read-this-summer-powerful-teaching\/\" target=\"_blank\" rel=\"noopener\">Powerful Teaching<\/a>.)<\/p>\n<p>We have LOTS of research showing that retrieval practice yields great benefits. Can other strategies match it?<\/p>\n<p>Here&#8217;s an idea: maybe instead of having students\u00a0<em>answer<\/em> questions (retrieval practice), we should have them\u00a0<em>create<\/em> questions to be answered. Just perhaps, generating questions might boost learning more than\u00a0<em>simple review<\/em>. Or &#8212; let&#8217;s get crazy: maybe generating questions boosts learning as much as retrieval practice? Even more?<\/p>\n<h2>Generating Research<\/h2>\n<p>Over the years, the &#8220;generation effect&#8221; has been studied occasionally &#8212; alas, not as much as retrieval practice. Often, research in this area includes a training session where students learn how to ask good questions. That step makes sense &#8230; but it might discourage teachers from adopting this strategy. Who has the time?<\/p>\n<p>Researchers in Germany had three groups of college students read slides from a lecture about infant developmental psychology.<\/p>\n<p>The first group practiced the information by rereading it. Specifically, the were instructed to memorize the content of those slides.<\/p>\n<p>Group two practiced by answering questions on each slide. They if they couldn&#8217;t remember the answer, they were allowed to go back and review the slide. In effect, this was &#8220;open-book retrieval practice.&#8221;<\/p>\n<p>In group three,<\/p>\n<blockquote><p>&#8220;students were instructed to formulate one exam question in an open response format for the content of each slide [,] and also to provide an answer to that question.&#8221;<\/p><\/blockquote>\n<p>That is: they generated questions.<\/p>\n<p>So, here&#8217;s the big question: when they took a surprise quiz, <a href=\"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/acp.3639\" target=\"_blank\" rel=\"noopener\">how did students in each group do<\/a>?<\/p>\n<h2>Drum Roll Please&#8230;<\/h2>\n<p><strong>First<\/strong>: Students who generated questions scored ~<em>10% higher <\/em>on that surprise quiz than those who tried to memorize information.<\/p>\n<p><strong>Second<\/strong>: Students who generated questions did <em>as well as<\/em> those who used retrieval practice.<\/p>\n<p><strong>Third<\/strong>: Questioners got these benefits even without explicit training in how to ask good questions.<\/p>\n<p><strong>Fourth<\/strong>: Question generators (and retrieval practicers) scored higher than mere reviewers on both\u00a0<em>factual<\/em> question and\u00a0<em>transfer<\/em> questions.<\/p>\n<p><strong>Fifth<\/strong>: Researchers got these impressive results even though the surprise quiz took place\u00a0<em>one week later<\/em>. (In research like this, those quizzes often happen right away. Of\u00a0 course, a week&#8217;s delay looks a lot more like genuine learning.)<\/p>\n<p>We could hardly ask for better results than these. In this research paradigm, question generation worked as well as retrieval practice &#8212; which works better than almost anything else we know of to help students learn.<\/p>\n<h2>Explaining Amazing Results<\/h2>\n<p>Why would this be? Why does\u00a0<em>generating<\/em> questions help students as much as\u00a0<em>answering <\/em>them?<\/p>\n<p>This study doesn&#8217;t answer that question directly, but it suggests a rough-n-ready answer.<\/p>\n<p>Both common sense and lots o&#8217; research tell us: students learn more when they <em>think hard about something<\/em>. (Obvi.)<\/p>\n<p>If we increase the challenge of the thinking task, we prompt students to think harder and therefore to learn better.<\/p>\n<p>Psychologists talk about &#8220;desirable difficulties&#8221;: a level of mental challenge that forces students to work their synapses but doesn&#8217;t overtax them.<\/p>\n<p>In this case, we can reasonably hypothesize that students who must create a question on a topic have to think hard about it. To come up with a good question, they have to think at least as hard as students answering questions on that topic.<\/p>\n<p>And, they have to think considerably harder than students who simply reread a passage.<\/p>\n<p>Voila! Generating questions help students learn.<\/p>\n<h2>A Few Caveats<\/h2>\n<p>As always, research provides teachers with helpful guidance. But: we need to adapt it to our own circumstances.<\/p>\n<p><strong>First<\/strong>: this study took place with college students. We should take care that our students can &#8212; in fact &#8212; come up with good questions.<\/p>\n<p>For instance, I&#8217;m a high-school English teacher. I would use this technique with\u00a0<em>Their Eyes Were Watching God<\/em> or\u00a0<em>Passing<\/em> or\u00a0<em>Sula<\/em>. But I don&#8217;t think I&#8217;d use it with\u00a0<em>The Scarlet Letter<\/em> or\u00a0<em>Hamlet<\/em>. My students struggle to understand the basics with those texts; I&#8217;m not sure they&#8217;d do a good job coming up with resonant exam questions.<\/p>\n<p>More precisely: I&#8217;d structure those assignments quite differently. I suspect I could be open-ended with an assignment to create\u00a0<em>Passing<\/em> questions, but would offer a lot more guidance for\u00a0<em>Scarlet Letter<\/em> questions.<\/p>\n<p><strong>Second<\/strong>: yes, this study found that retrieval practice and question generation resulted in additional learning. And, we have a reasonably hypothesis about why that might be so.<\/p>\n<p>But, we have MUCH more research about retrieval practice. Before we invest too heavily in question generation, we should keep our eyes peeled for more studies.<\/p>\n<p><strong>Third<\/strong>: In this paradigm, trying to memorize resulted in less learning. However, we shouldn&#8217;t conclude that students should never try to memorize. At times, &#8220;overleaning&#8221; is essential for reducing working memory load &#8212; which facilitates learning.<\/p>\n<p>As long as we keep these caveats in mind, we can be excited about trying out a new review technique.<\/p>\n<p>And: this can work in online settings as well!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Is it better to have students ANSWER questions or to ASK question? Recent research from Germany provides a helpfully specific way to think about study strategies.<\/p>\n","protected":false},"author":18,"featured_media":5604,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[12],"class_list":["post-5600","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lb-blog","tag-retrieval-practice"],"_links":{"self":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/5600","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/comments?post=5600"}],"version-history":[{"count":4,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/5600\/revisions"}],"predecessor-version":[{"id":5602,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/5600\/revisions\/5602"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media\/5604"}],"wp:attachment":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media?parent=5600"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/categories?post=5600"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/tags?post=5600"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}