{"id":5251,"date":"2019-12-22T08:00:43","date_gmt":"2019-12-22T13:00:43","guid":{"rendered":"https:\/\/braindevs.net\/blog\/blog\/?p=5251"},"modified":"2019-12-16T20:05:31","modified_gmt":"2019-12-17T01:05:31","slug":"a-holiday-present-for-the-teacher-skeptic-in-beta","status":"publish","type":"post","link":"https:\/\/www.learningandthebrain.com\/blog\/a-holiday-present-for-the-teacher-skeptic-in-beta\/","title":{"rendered":"A Holiday Present for the Teacher\/Skeptic (in Beta)"},"content":{"rendered":"<p>Teachers who rely on research to inform our teaching&#8211;presumably, that&#8217;s YOU&#8211;routinely hear that we must <strong>be skeptical<\/strong>.<\/p>\n<blockquote><p>&#8220;Don&#8217;t just believe everything you hear. When someone says that their suggestion is &#8216;brain based,&#8217; you&#8217;ve got to kick the tires.&#8221;<\/p><\/blockquote>\n<p>Yes. Of course. But: how EXACTLY do we do that? What&#8217;s the most effective method for skepticism?<\/p>\n<h2>Pens and Laptops<\/h2>\n<p>Let&#8217;s take a specific example.<\/p>\n<p><a href=\"https:\/\/braindevs.net\/blog\/\/wp-content\/uploads\/2019\/12\/AdobeStock_71109632_Credit.jpg\"><img decoding=\"async\" class=\"alignright size-medium wp-image-5254\" src=\"https:\/\/braindevs.net\/blog\/\/wp-content\/uploads\/2019\/12\/AdobeStock_71109632_Credit-300x225.jpg\" alt=\"\" width=\"300\" height=\"225\" srcset=\"https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2019\/12\/AdobeStock_71109632_Credit-300x225.jpg 300w, https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2019\/12\/AdobeStock_71109632_Credit-768x576.jpg 768w, https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2019\/12\/AdobeStock_71109632_Credit-1024x768.jpg 1024w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>You&#8217;ve probably heard &#8220;research shows&#8221; that <em>handwritten<\/em> notes are more effective than notes taken on <em>laptops<\/em>. That is: students who take notes by hand remember more than those who take notes on their computers.<\/p>\n<p>If you hunt down the source of that information, you&#8217;ll almost certainly end up at Mueller and Oppenheimer&#8217;s <a href=\"https:\/\/journals.sagepub.com\/doi\/full\/10.1177\/0956797614524581\" target=\"_blank\" rel=\"noopener\">wittily titled study<\/a>\u00a0<em>The Pen is Mightier than the Laptop.\u00a0<\/em>It made a big splash when it came out in 2014, and its waves have been lapping over us ever since.<\/p>\n<p>Once you find that source, your thought process might go like this:<\/p>\n<p style=\"padding-left: 30px;\"><strong>Step 1<\/strong>: &#8220;Look! Research shows that handwritten notes are superior. I shall forbid laptops forthwith!&#8221;<\/p>\n<p style=\"padding-left: 30px;\"><strong>Step 2<\/strong>: &#8220;Wait a minute&#8230;I&#8217;ve been told to be skeptical. Just because Mueller and Oppenheimer say so (and have research to support their claim), I shouldn&#8217;t necessarily believe them.&#8221;<\/p>\n<p style=\"padding-left: 30px;\"><strong>Step 3<\/strong>: &#8220;Hmmm. How exactly can I be skeptical?&#8221;<\/p>\n<p>So, here&#8217;s my holiday present for you: <em>a website that makes effective skepticism noticeably easier&#8230;<\/em><\/p>\n<h2>Check the Scitation<\/h2>\n<p>The website <a href=\"https:\/\/scite.ai\/\" target=\"_blank\" rel=\"noopener\">scite.ai<\/a> leads with this catchy slogan: &#8220;making science reliable.&#8221;<\/p>\n<p>At least, it&#8217;s helping make science <em>reliabler<\/em>. Or, more reliable.<\/p>\n<p>Here&#8217;s how. Surf over to the website, put in the name of the article, and press the magic button.<\/p>\n<p>Scite will then tell you&#8230;<\/p>\n<p style=\"padding-left: 30px;\">&#8230;how many later studies have <em>confirmed<\/em> its findings,<\/p>\n<p style=\"padding-left: 30px;\">&#8230;how many simply\u00a0<em>mention<\/em> its findings,<\/p>\n<p style=\"padding-left: 30px;\">&#8230;and how many <em>contradict<\/em> its findings.<\/p>\n<p>In this case, you&#8217;ll discover that\u00a0<strong>24<\/strong> studies mention Mueller and Oppenheimer&#8217;s study, <strong>1<\/strong> <a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S1747938X17300374?via%3Dihub\" target=\"_blank\" rel=\"noopener\">contradicts<\/a> it, and <strong>0<\/strong> confirm it. That&#8217;s right. <em>Zero.<\/em><\/p>\n<p>So, according to Scite, you&#8217;ve got as much research encouraging laptop notes as you do decrying them. But: one of those studies is remarkably famous. And, the other simply isn&#8217;t known.<\/p>\n<h2>Next Steps<\/h2>\n<p>What should you do with this initial information?<\/p>\n<p>At this point, I think the obvious answer is that <em>we don&#8217;t have an obvious answer<\/em>.<\/p>\n<p>Probably, you want to keep looking for further evidence on both sides of the case.<\/p>\n<p style=\"padding-left: 30px;\">You might find <a href=\"https:\/\/www.learningscientists.org\/blog\/2019\/7\/25-1?rq=taking%20notes\" target=\"_blank\" rel=\"noopener\">this summary<\/a> over at the Learning Scientists, where Dr. Megan Sumeracki walks through the nuances and complexities of the research.<\/p>\n<p style=\"padding-left: 30px;\">You might also find <a href=\"https:\/\/braindevs.net\/blog\/\/now-even-the-new-york-times-has-it-wrong\/\" target=\"_blank\" rel=\"noopener\">my own article<\/a> arguing that the Mueller and Oppenheimer research makes sense only if you believe that students <em>can&#8217;t learn to do new things<\/em>. (That&#8217;s a strange belief for a teacher to have.) If you believe students\u00a0<em>can\u00a0<\/em>learn new things, then their own data suggest that laptop notes ought to be better.<\/p>\n<p>At a minimum, I hope, you&#8217;ll feel empowered in your skepticism. Now you&#8211;unlike most people who quote Mueller and Oppenheimer&#8211;have a broader picture of the research field. You can start using your judgment and experience to guide your thinking.<\/p>\n<h2>An Important Caveat<\/h2>\n<p>I don&#8217;t know how long scite.ai has been around, but it&#8217;s in beta. And, truth be told, it&#8217;s not wholly reliable.<\/p>\n<p>For instance: in 2011, Ramirez and Beilock did a <a href=\"https:\/\/www.cogsci.msu.edu\/DSS\/2014-2015\/Beilock\/Ramirez&amp;Beilock_2011.pdf\" target=\"_blank\" rel=\"noopener\">study<\/a> showing that writing about stress before an exam can reduce that stress (for anxious students).<\/p>\n<p>In 2018, Camerer et al <a href=\"https:\/\/www.nature.com\/articles\/s41562-018-0399-z\" target=\"_blank\" rel=\"noopener\">tried and failed<\/a> to replicate those results (and several other studies as well).<\/p>\n<p>When I searched on Ramirez&#8217;s study in scite, it showed only one contradiction: a study about &#8220;aural acupuncture.&#8221;\u00a0In other words: scite missed an important non-replication, and included an irrelevant finding.<\/p>\n<p>So, you shouldn&#8217;t use this website as your only skepticism strategy.<\/p>\n<p>But, as of today, you&#8217;ve got one more than you did before. Happy Holidays!<\/p>\n<hr \/>\n<p>If you&#8217;re looking for other skepticism strategies for the holidays, check out <a href=\"https:\/\/braindevs.net\/blog\/\/trying-to-prove-yourself-wrong\/\" target=\"_blank\" rel=\"noopener\">this work<\/a> by Blake Harvard.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A new website helps us confirm &#8212; or disconfirm &#8212; research findings that (perhaps) ought to guide our teaching.<\/p>\n","protected":false},"author":18,"featured_media":5254,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[19],"class_list":["post-5251","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lb-blog","tag-skepticism"],"_links":{"self":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/5251","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/comments?post=5251"}],"version-history":[{"count":5,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/5251\/revisions"}],"predecessor-version":[{"id":5258,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/5251\/revisions\/5258"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media\/5254"}],"wp:attachment":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media?parent=5251"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/categories?post=5251"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/tags?post=5251"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}