{"id":5798,"date":"2020-09-08T08:00:48","date_gmt":"2020-09-08T13:00:48","guid":{"rendered":"https:\/\/braindevs.net\/blog\/blog\/?p=5798"},"modified":"2020-09-05T14:19:51","modified_gmt":"2020-09-05T19:19:51","slug":"the-benefits-of-testing-depend-on-the-definition-of-testing-and-the-timing-and","status":"publish","type":"post","link":"https:\/\/www.learningandthebrain.com\/blog\/the-benefits-of-testing-depend-on-the-definition-of-testing-and-the-timing-and\/","title":{"rendered":"The Benefits of &#8220;Testing&#8221; Depend on the DEFINITION of &#8220;Testing.&#8221; And the TIMING. And&#8230;"},"content":{"rendered":"<p>Whenever I want to start a food fight at a faculty meeting (admit it: you know the feeling), I contemplate shouting: &#8220;What do we all think about testing?&#8221;<\/p>\n<p><a href=\"https:\/\/braindevs.net\/blog\/\/wp-content\/uploads\/2020\/09\/AdobeStock_258411728_Credit.jpg\"><img decoding=\"async\" class=\"alignleft size-medium wp-image-5805\" src=\"https:\/\/braindevs.net\/blog\/\/wp-content\/uploads\/2020\/09\/AdobeStock_258411728_Credit-300x200.jpg\" alt=\"\" width=\"300\" height=\"200\" srcset=\"https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2020\/09\/AdobeStock_258411728_Credit-300x200.jpg 300w, https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2020\/09\/AdobeStock_258411728_Credit-768x512.jpg 768w, https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2020\/09\/AdobeStock_258411728_Credit.jpg 793w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>Almost certainly, several colleagues will decry the use of discriminatory <strong>high-stakes tests<\/strong>\u00a0that stress and mis-categorize our students.<\/p>\n<p>Others will angrily retort that research into <strong>retrieval practice<\/strong> shows that well-designed tests help students learn. Heck, &#8220;retrieval practice&#8221; yields great benefits because of &#8220;the <em>testing effect<\/em>.&#8221;<\/p>\n<p>Still others will heatedly contrast formative assessment with summative assessment.<\/p>\n<p>Like the Goddess of Discord with my Golden Apple, I will have inspired an enduring battle.<\/p>\n<p>Of course, this battle results from <em>confusion about definitions<\/em>.<\/p>\n<p>Scholars who champion retrieval practice or formative assessment might be said to &#8220;favor testing,&#8221; but they favor very specific kinds of testing. The testing they champion (probably) looks nothing like the high-stakes test that my first respondents so loathe.<\/p>\n<p>In other words: my colleagues don&#8217;t necessarily disagree with each other. Because this one word has different meanings, they&#8217;re probably arguing about different topics without realizing it.<\/p>\n<h2>Confusion Gets Clearer<\/h2>\n<p>Even if I narrow my question to &#8220;pre-testing,&#8221; I&#8217;ve still created many opportunities for confusion.<\/p>\n<p>I might, for instance, &#8220;pre-test&#8221; my students about the myth of the Golden Apple because I want to know what they already know.<\/p>\n<p>My goal, in other words, isn&#8217;t to\u00a0<em>evaluate<\/em> them. Instead, I want to align my lessons with their current knowledge. After all, I need one lesson plan for a class which has never heard of Zeus, Aphrodite, or Troy; and a completely different lesson plan for a class that read\u00a0<em>The Iliad<\/em> last year.<\/p>\n<p>I&#8217;m &#8220;pre-testing&#8221; as an early step in my own lesson planning.<\/p>\n<p>On the other hand, we have a fascinating research pool suggesting that &#8220;pre-testing&#8221; itself might <em>help students learn<\/em>. That is: the act of taking that pretest can improve their ultimate understanding of the material later in the unit.<\/p>\n<p>Amazingly, according to this research pool, these pre-tests benefit students <em>even if they get all the answers wrong<\/em>. (<em>Of course<\/em> they get the answers wrong. They haven&#8217;t yet done the unit with me.)<\/p>\n<p>For instance, Dr. Lindsay Richland and Co. pre-tested students on a <a href=\"http:\/\/www.uciscienceoflearning.org\/uploads\/1\/1\/7\/8\/117864006\/richlandkornellkao.pdf\" target=\"_blank\" rel=\"noopener\">passage about color-blindness<\/a>. They found that students who took a pretest (and got all the answers wrong) ultimately learned more than students who used that extra time to study the passage. (As I&#8217;ve <a href=\"https:\/\/braindevs.net\/blog\/\/vital-resources-in-psychology\/\" target=\"_blank\" rel=\"noopener\">written earlier<\/a>, I love this study because Richland works SO HARD to disprove her own hypothesis.)<\/p>\n<h2>Getting the Specifics JUST RIGHT<\/h2>\n<p>So far, we&#8217;ve seen that the <em>benefits<\/em> of testing depend on the <em>definition<\/em> of testing. While we know that some tests stress and demotivate students, we&#8217;ve also got research suggesting that\u00a0<em>a very specific kind of pre-testing<\/em> might help students learn.<\/p>\n<p>Of course, we know that psychology research always includes\u00a0<strong>boundary conditions<\/strong><em>.\u00a0<\/em>A teaching technique that works in one set of circumstances might not work in others.<\/p>\n<p>So, for instance, a teaching technique that helps 3rd graders learn might not help college students. Or, a strategy to help students write well might not help them learn to pirouette in dance class.<\/p>\n<p>We know that there will be boundaries for this (very specific kind of) pre-testing. What are they?<\/p>\n<p>As is so often the case, this question has led to complexity and controversy. For instance: several scholars have found that pretesting helps students make new connections\u00a0<em>only\u00a0<\/em><em>if they already know a little bit about the material.<\/em><\/p>\n<p>A study from 2014, however, suggests that pre-testing\u00a0helps students\u00a0<em>even if they don&#8217;t know anything about the material<\/em>.<\/p>\n<p>For teachers,\u00a0<strong>this distinction matters<em>.<\/em><\/strong><\/p>\n<p>If students need at least a little prior knowledge for pretesting to be helpful, we will use this technique less often. If, however, they don&#8217;t need that prior knowledge, then our decision to limit its use robs them of a chance to learn.<\/p>\n<p>To use this technique correctly, we really need to know the right answer.<\/p>\n<h2>Today&#8217;s Research: Activating Prior Knowledge<\/h2>\n<p>A <a href=\"https:\/\/pearl.plymouth.ac.uk\/bitstream\/handle\/10026.1\/12450\/TPL%20%2812%29%20-accepted.pdf?sequence=1&amp;isAllowed=y\" target=\"_blank\" rel=\"noopener\">recent study<\/a>, led by Dr. Tina Seabrooke, tries to sort through this intricate and important question. In fact, because the details require such nuanced distinctions, she ended up running\u00a0<em>five<\/em>\u00a0different experiments. Only by considering all five together could she and her team reach a conclusion.<\/p>\n<p>Of course, with five different studies underway, Seabrooke&#8217;s work has lots of nooks and subtleties to explore. Instead, let me cut to the chase:<\/p>\n<p>TL; DR<\/p>\n<p>Pre-testing will probably help students learn and understand a topic better\u00a0<em>if they already know something about it<\/em>.<\/p>\n<p>If students\u00a0<em>don<\/em><em>&#8216;t<\/em> know anything about the subject, pretests don&#8217;t help much.<\/p>\n<p>More specifically: pretests might help them remember some words from the questions, and some words from the answers. But &#8212; crucially &#8212; pretests won&#8217;t help students <em>make connections between the questions and the answers<\/em>.<\/p>\n<p>Of course, we really want students to make those connections. Any definition of &#8220;understanding&#8221; a topic will include the ability to answer meaningful questions about it.<\/p>\n<p>You might think about pretesting this way:<\/p>\n<p>Pretests help students activate useful prior knowledge. If they don&#8217;t have relevant prior knowledge, then pretests don&#8217;t have anything useful to draw upon.<\/p>\n<h2>Final Word<\/h2>\n<p>Research into &#8220;pretesting&#8221; is still ongoing, and we&#8217;re still learning new and useful information.<\/p>\n<p>I suggest that teachers use this technique from time to time as a way to activate prior knowledge. I wouldn&#8217;t require it as part of my daily routine.<\/p>\n<p>And: I would keep my eyes peeled for the next relevant study. We&#8217;ve still got lots more to learn on this subject&#8230;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Should we test our students or not? Researchers can answer that question only by defining &#8220;test&#8221; very precisely. Happily, we&#8217;ve got research on one kind of PRE-test that just might help students learn and understand.<\/p>\n","protected":false},"author":18,"featured_media":5805,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[135],"class_list":["post-5798","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lb-blog","tag-testing"],"_links":{"self":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/5798","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/comments?post=5798"}],"version-history":[{"count":9,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/5798\/revisions"}],"predecessor-version":[{"id":5808,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/5798\/revisions\/5808"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media\/5805"}],"wp:attachment":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media?parent=5798"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/categories?post=5798"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/tags?post=5798"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}