{"id":6102,"date":"2021-03-30T08:00:02","date_gmt":"2021-03-30T13:00:02","guid":{"rendered":"https:\/\/braindevs.net\/blog\/blog\/?p=6102"},"modified":"2021-03-28T10:02:47","modified_gmt":"2021-03-28T15:02:47","slug":"to-grade-or-not-to-grade-should-retrieval-practice-quizzes-be-scored","status":"publish","type":"post","link":"https:\/\/www.learningandthebrain.com\/blog\/to-grade-or-not-to-grade-should-retrieval-practice-quizzes-be-scored\/","title":{"rendered":"To Grade or Not to Grade: Should Retrieval Practice Quizzes Be Scored?"},"content":{"rendered":"<p>We&#8217;ve seen enough research on <strong>retrieval practice <\/strong>to know: <em>it rocks<\/em>.<\/p>\n<p style=\"padding-left: 30px;\">When students <em>simply review<\/em> material (review their notes; reread the chapter), that mental work doesn&#8217;t help them learn.<\/p>\n<p style=\"padding-left: 30px;\">However, when they\u00a0<em>try to remember<\/em> (quiz themselves, use flashcards), this kind of mental work does result in greater learning.<\/p>\n<p>In <a href=\"https:\/\/braindevs.net\/blog\/\/the-best-teaching-book-to-read-this-summer-powerful-teaching\/\" target=\"_blank\" rel=\"noopener\">Agarwal and Bain&#8217;s<\/a> elegant phrasing: don&#8217;t ask students to <em>put information back into <\/em>their brains. Instead, ask them to <em>pull information out of<\/em> their brains.<\/p>\n<p><a href=\"https:\/\/braindevs.net\/blog\/\/wp-content\/uploads\/2021\/03\/AdobeStock_288862877_Credit.jpg\"><img decoding=\"async\" class=\"aligncenter size-full wp-image-6105\" src=\"https:\/\/braindevs.net\/blog\/\/wp-content\/uploads\/2021\/03\/AdobeStock_288862877_Credit.jpg\" alt=\"\" width=\"792\" height=\"265\" srcset=\"https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2021\/03\/AdobeStock_288862877_Credit.jpg 792w, https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2021\/03\/AdobeStock_288862877_Credit-300x100.jpg 300w, https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2021\/03\/AdobeStock_288862877_Credit-768x257.jpg 768w\" sizes=\"(max-width: 792px) 100vw, 792px\" \/><\/a><\/p>\n<p>Like all teaching guidance, however, the suggestion &#8220;use retrieval practice!&#8221; requires nuanced exploration.<\/p>\n<p style=\"padding-left: 30px;\">What are the best methods for doing so?<\/p>\n<p style=\"padding-left: 30px;\">Are some retrieval practice strategies more effective?<\/p>\n<p style=\"padding-left: 30px;\">Are some frankly harmful?<\/p>\n<p>Any on-point research would be welcomed.<\/p>\n<h2>On-Point Research<\/h2>\n<p>Here&#8217;s a simple and practical question. If we use pop quizzes as a form of retrieval practice, <strong>should we grade them<\/strong>?<\/p>\n<p>In other words: do <em>graded pop quizzes<\/em> result in more or less learning, compared to their <em>ungraded<\/em> cousins?<\/p>\n<p>This study, it turns out, can be run fairly easily.<\/p>\n<p>Dr. Maya Khanna <a href=\"https:\/\/journals.sagepub.com\/doi\/abs\/10.1177\/0098628315573144\" target=\"_blank\" rel=\"noopener\">taught three sections<\/a> of an Intro to Psychology course. The first section had\u00a0<em>no<\/em> pop quizzes. In the second section, Khanna gave six <em>graded<\/em> pop quizzes. In the third, six <em>ungraded<\/em> pop quizzes.<\/p>\n<p>Students also filled out a questionnaire about their experience taking those quizzes.<\/p>\n<p>What did Khanna learn? Did the quizzes help? Did grading them matter?<\/p>\n<h2>The Envelope Please<\/h2>\n<p>The big headline:\u00a0<em>the <strong>ungraded<\/strong> quizzes helped students on the final exam<\/em>.<\/p>\n<p>Roughly: students who took the ungraded pop quizzes averaged a B- on the final exam.<\/p>\n<p>Students in the other two groups averaged in the mid-to-high C range. (The precise comparisons require lots of stats speak.)<\/p>\n<p>An important note: students in the &#8220;ungraded&#8221; group scored higher even though the final exam <em>did not repeat<\/em> the questions from those pop quizzes. (The same\u00a0<em>material<\/em> was covered on the exam, but the questions themselves were different.)<\/p>\n<p>Of course, we also wonder about our students&#8217;\u00a0<em>stress<\/em>. Did these quizzes raise anxiety levels?<\/p>\n<p>According to the questionnaires,\u00a0<strong>nope<\/strong>.<\/p>\n<p style=\"padding-left: 30px;\">Khanna&#8217;s students responded to this statement: &#8220;The inclusion of quizzes in this course made me feel anxious.&#8221;<\/p>\n<p style=\"padding-left: 30px;\">A 1 meant &#8220;strongly disagree.&#8221;<\/p>\n<p style=\"padding-left: 30px;\">A 9 meant &#8220;strongly agree.&#8221;<\/p>\n<p>In other words, a LOWER rating suggests that the quizzes didn&#8217;t increase stress.<\/p>\n<p style=\"padding-left: 30px;\">Students who took the graded quizzes averaged an answer of 4.20.<\/p>\n<p style=\"padding-left: 30px;\">Students who took the ungraded quizzes averaged an answer of 2.96.<\/p>\n<p>So, <em>neither group<\/em> felt much stress as a result of the quizzes. And, the students in the ungraded group felt even less.<\/p>\n<h2>In the Classroom<\/h2>\n<p>I myself use this technique as one of a great many retrieval practice strategies.<\/p>\n<p style=\"padding-left: 30px;\">My students&#8217; homework sometimes includes retrieval practice exercises.<\/p>\n<p style=\"padding-left: 30px;\">I often begin class with some <a href=\"https:\/\/braindevs.net\/blog\/\/cold-calling-and-bad-pizza\/\" target=\"_blank\" rel=\"noopener\">lively cold-calling<\/a> to promote retrieval practice.<\/p>\n<p style=\"padding-left: 30px;\">Occasionally &#8212; last Thursday, in fact &#8212; I begin class by saying: &#8220;Take out a blank piece of paper. This is NOT a quiz. It will NOT be graded. We&#8217;re using a different kind of retrieval practice to start us off today.&#8221;<\/p>\n<p>As is always true, I&#8217;m combining this research with my own experience and classroom circumstances.<\/p>\n<p style=\"padding-left: 30px;\">Khanna gave her quizzes at the end of class; I do mine at the beginning.<\/p>\n<p style=\"padding-left: 30px;\">Because I&#8217;ve taught high school for centuries, I&#8217;m confident my students feel comfortable doing this kind of written work. If you teach younger grades, or in a different school context, your own experience might suggest a different approach.<\/p>\n<p style=\"padding-left: 30px;\">To promote interleaving, I include questions from many topics (Define &#8220;bildungsroman.&#8221; Write a sentence with a participle. Give an example of Janie <em>exercising agency<\/em> in last night&#8217;s reading.) You might focus on one topic to build your students&#8217; confidence.<\/p>\n<p>Whichever approach you take, Khanna&#8217;s research suggests that retrieval practice quizzes\u00a0<em>don&#8217;t<\/em> increase stress and\u00a0<em>don&#8217;t<\/em> require grades.<\/p>\n<p>As I said: retrieval practice rocks!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>We&#8217;ve seen enough research on retrieval practice to know: it rocks. When students simply review material (review their notes; reread the chapter), that mental work doesn&#8217;t help them learn. However, when they\u00a0try to remember (quiz themselves, use flashcards), this kind of mental work does result in greater learning. In Agarwal and Bain&#8217;s elegant phrasing: don&#8217;t [&hellip;]<\/p>\n","protected":false},"author":18,"featured_media":6105,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[15,12],"class_list":["post-6102","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lb-blog","tag-classroom-advice","tag-retrieval-practice"],"_links":{"self":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/6102","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/comments?post=6102"}],"version-history":[{"count":4,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/6102\/revisions"}],"predecessor-version":[{"id":6107,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/6102\/revisions\/6107"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media\/6105"}],"wp:attachment":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media?parent=6102"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/categories?post=6102"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/tags?post=6102"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}