{"id":3256,"date":"2018-04-16T08:00:24","date_gmt":"2018-04-16T13:00:24","guid":{"rendered":"https:\/\/braindevs.net\/blog\/blog\/?p=3256"},"modified":"2018-04-13T15:27:00","modified_gmt":"2018-04-13T20:27:00","slug":"can-rely-meta-analysis-can-doubt","status":"publish","type":"post","link":"https:\/\/www.learningandthebrain.com\/blog\/can-rely-meta-analysis-can-doubt\/","title":{"rendered":"Can You Rely on Meta-analysis? Can You Doubt It?"},"content":{"rendered":"<p>Over at his blog Filling the Pail, Greg Ashman likes challenging popular ideas. In a recent post, he <a href=\"https:\/\/gregashman.wordpress.com\/2018\/04\/12\/can-meta-analysis-be-saved\/\" target=\"_blank\" rel=\"noopener\">takes issue with meta-analysis<\/a> as a way of analyzing educational research.<\/p>\n<p><a href=\"https:\/\/braindevs.net\/blog\/\/wp-content\/uploads\/2018\/04\/AdobeStock_34525906_Credit.jpg\"><img decoding=\"async\" class=\"size-medium wp-image-3259 alignleft\" src=\"https:\/\/braindevs.net\/blog\/\/wp-content\/uploads\/2018\/04\/AdobeStock_34525906_Credit-300x200.jpg\" alt=\"\" width=\"300\" height=\"200\" srcset=\"https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2018\/04\/AdobeStock_34525906_Credit-300x200.jpg 300w, https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2018\/04\/AdobeStock_34525906_Credit-768x512.jpg 768w, https:\/\/www.learningandthebrain.com\/blog\/wp-content\/uploads\/2018\/04\/AdobeStock_34525906_Credit.jpg 793w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>In the first place, Ashman argues &#8212; in effect &#8212;\u00a0 &#8220;garbage in, garbage out.&#8221; Combining badly-designed studies with well-designed studies still gives some weight to the badly-designed ones.<\/p>\n<p>Of course, Ashman has some thoughtful suggestions as well.<\/p>\n<h2>Why Does It Matter?<\/h2>\n<p>Why should we care about such an obscure and complicated statistical technique?<\/p>\n<p>Meta-analysis matters <em>because we pay so much attention to it.<\/em><\/p>\n<p>For instance: just a month ago, a pair of meta-analyses about Mindset Theory set off <a href=\"https:\/\/braindevs.net\/blog\/\/mindset-controversy\/\" target=\"_blank\" rel=\"noopener\">another round of anxiety<\/a>. Edu-twitter lit right up with thoughtful scholars wondering if we should stop focusing so much on the right kind of praise.<\/p>\n<p>Or: I frequently rebut claims about working memory training by citing <a href=\"https:\/\/www.researchgate.net\/profile\/Monica_Melby-Lervag\/publication\/225051707_Is_Working_Memory_Training_Effective_A_Meta-Analytic_Review\/links\/0c9605269655989dc6000000\/Is-Working-Memory-Training-Effective-A-Meta-Analytic-Review.pdf\" target=\"_blank\" rel=\"noopener\">this well-known meta-analysis<\/a> by Melby-Lervag and Hulme.<\/p>\n<p>If we&#8217;re going to rely so much on this technique, we should be clear-minded about its strengths <em>and its weaknesses<\/em>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Over at his blog Filling the Pail, Greg Ashman likes challenging popular ideas. In a recent post, he takes issue with meta-analysis as a way of analyzing educational research. In the first place, Ashman argues &#8212; in effect &#8212;\u00a0 &#8220;garbage in, garbage out.&#8221; Combining badly-designed studies with well-designed studies still gives some weight to the [&hellip;]<\/p>\n","protected":false},"author":18,"featured_media":3259,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[28],"class_list":["post-3256","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lb-blog","tag-methodology"],"_links":{"self":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/3256","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/comments?post=3256"}],"version-history":[{"count":4,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/3256\/revisions"}],"predecessor-version":[{"id":3261,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/3256\/revisions\/3261"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media\/3259"}],"wp:attachment":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media?parent=3256"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/categories?post=3256"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/tags?post=3256"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}