{"id":4925,"date":"2019-09-07T08:00:37","date_gmt":"2019-09-07T13:00:37","guid":{"rendered":"https:\/\/braindevs.net\/blog\/blog\/?p=4925"},"modified":"2019-09-05T09:58:05","modified_gmt":"2019-09-05T14:58:05","slug":"when-facing-dramatic-blog-headlines-ask-for-evidence","status":"publish","type":"post","link":"https:\/\/www.learningandthebrain.com\/blog\/when-facing-dramatic-blog-headlines-ask-for-evidence\/","title":{"rendered":"When Facing Dramatic Blog Headlines, Ask For Evidence"},"content":{"rendered":"

Over at the Blog on Learning and Development<\/a>, they’ve penned a dramatic headline<\/a>: Exams May Damage Teenagers’ Mental Health and Restrict Their Potential<\/em>.<\/p>\n

Damage<\/strong> mental health.<\/p>\n

Restrict<\/strong> teenagers’ potential<\/strong>.<\/p>\n

That’s got your attention.<\/p>\n

Your response to such a headline might well depend on your current beliefs about exams.<\/p>\n

If you already think that exams harm students<\/em>, you might cry out a triumphant “I told you so!”\u00a0 You might send a link to your principal, along with a proposal to cancel the lot of them.<\/p>\n

If you already think that exams hold students (and teachers) beneficially accountable<\/em> for the information and skills they ought to have mastered, you might dismiss the blog post as yet another refusal to maintain strict but helpful standards.<\/p>\n

I have an alternate suggestion:<\/p>\n

Don’t take sides<\/em>.<\/p>\n

Instead, ask yourself a reasonable and straightforward question:<\/p>\n

What pertinent evidence<\/strong> does the blog post offer to support its claims?<\/p>\n

After all, you’ve decided to join Learning and the Brain world because you want to go beyond opinions to arrive at research-informed<\/em> opinions.<\/p>\n

So, as you review the blog post beneath that dramatic headline, don’t look for statements you agree (or disagree) with. Instead, check out the quality of the evidence provided in support.<\/p>\n

Which Door?<\/h2>\n

Let’s start by asking this question: which kind of evidence would you find most persuasive?<\/p>\n

A survey of high school principals, focusing on student stress levels.<\/p>\n

A study comparing the mental health of students who took exams to the health of those who didn’t.<\/p>\n

An online poll of high school students and their parents, asking about the highs and lows of high school.<\/p>\n

An opinion piece by a noted neuroscientist.<\/p>\n

A survey of therapists who work with teens.<\/p>\n

Presumably, given these choices, you’d prefer door #2: the research study.<\/p>\n

In this hypothetical study, researchers would identify two similar groups of adolescent students. One group would take exams. The other wouldn’t.<\/p>\n

When researchers evaluated these students later on, they would find higher rates of mental health diagnosis in the exam group than the no-exam group. (For a relevant parallel, check out this study<\/a> on developing self-control.)<\/p>\n

Such a study would indeed suggest–as the blog states–that “exams may damage teenagers’ mental health.”<\/p>\n

The other methods would, of course, reveal opinions<\/em>. Those opinions might well be informed by different kinds of experience: the students’ experience, their parents’, their teachers’, their therapists’.<\/p>\n

But, even well-informed opinions<\/em> can’t root out the biases that well-designed research<\/em> seeks to minimize.<\/p>\n

Let the Sleuthing Begin<\/h2>\n

As you begin reviewing this blog post, you’ll find several links to research studies. That’s a good sign.<\/p>\n

However–and this is a big however–those cited studies\u00a0don’t investigate the blog’s central claim.<\/em> That is: they don’t explore the effects of exams on teens.<\/p>\n

\"\"<\/a><\/p>\n

Instead, they offer evidence that adolescence is an important time for neuro-biological development. That’s true and important, but it’s not the blog post’s central claim.<\/p>\n

Once the author has developed the (important and true) claim that brains change a lot in adolescence, the blog arrives at its core assertion:\u00a0“GSCEs [exams] impose unnecessary stress on adolescents.”<\/p>\n

To support that claim, it offers this link<\/a>.<\/p>\n

Credible Sources<\/h2>\n

This link reveals good news, and bad.<\/p>\n

Good News<\/strong>: the argument that “exams might damage teens’ mental health” comes from a newspaper article covering a neuroscientist’s speech. That scientist–Sarah-Jayne Blakemore–has done lots of research in the world of adolescent brains.\u00a0She does splendid work.<\/p>\n

In fact her most recent book,\u00a0Inventing Ourselves,<\/em> has been enthusiastically reviewed<\/a> on this blog. Twice<\/a>.<\/p>\n

Bad News<\/strong>: the concern that exams might damage mental health is Blakemore’s (very well informed) opinion–but it’s an opinion<\/em>. She’s giving a speech, not describing a study.<\/p>\n

The hypothetical study outlined above–the one that was your first choice for evidence<\/em>–hasn’t been done. (More precisely: it’s not cited by the blog, or by Blakemore.)<\/p>\n

More Bad News<\/strong>: when Blakemore says that “exams” might damage mental health, she means very specific exams: the General Certificate of Secondary Education exams–a kind of a mandatory SAT exam in Great Britain.<\/p>\n

That is: Blakemore does\u00a0not<\/em> say that exams in general<\/em> harm students. Despite the headline, nothing in this article even indirectly suggests that schools shouldn’t have final exams.<\/p>\n

If you want to persuade your principal to cancel all exams, this article simply doesn’t help you make that case.<\/p>\n

Back to the Beginning<\/h2>\n

Let’s return to the blog headline that got us started:\u00a0Exams May Damage Teenagers’ Mental Health and Restrict Their Potential<\/em>.<\/p>\n

I think this headline sets up a reasonable expectation. I expect (and you should too) that researchers have done a relevant study, crunched some numbers, and arrived at that conclusion.<\/p>\n

They don’t just have an opinion. They don’t just have relevant expertise. They’re not making a prediction.<\/p>\n

Instead, they have gathered data, controlled for variables that might muddle their conclusion, done precise calculations, and arrived at a statistically significant finding.<\/p>\n

In the absence of that study, it’s genuine surprising that a blog (for an organization that champions brain research<\/a>) has made such an emphatic claim.<\/p>\n

Important Notes<\/h2>\n

First<\/strong>: I don’t know if the blog-post’s author wrote the headline. Often those two jobs fall to different people. (In newspapers especially, that arrangement can lead to misunderstanding and exaggerated claims.)<\/p>\n

While I’m at it, I should also acknowledge that I myself might be guilty of an occasional hyperbolic headline.<\/p>\n

I try to stick to the facts. I try (very hard) to cite exactly relevant research. I try to limit my claims to the narrow findings of researchers.<\/p>\n

If you catch me going beyond these guidelines, I hope you’ll let me know.<\/p>\n

Second<\/strong>: You might reasonably want to know my own opinions about exams. Here goes:<\/p>\n

I haven’t seen any research that persuades me one way or the other about their utility.<\/strong><\/p><\/blockquote>\n

I suspect that, like so many things in education, they can be done very badly, or done quite well.<\/p>\n

Can exams become hideous exercises in mere memorization, yielding lots of stress but no extra learning? Yes, I’m sure that happens.<\/p>\n

Can exams be inspiring opportunities for students to show their deep mastery of complex material? Yes, I’m sure that happens.<\/p>\n

As is so often the case, I think global conclusions (and alarming headlines) miss the point.<\/p>\n

We should ask: what kind of learning we want our students to do? What kind of learning climate we want to create? And, we should ask what kind of exam–including, perhaps, no exam at all–produces that result for most of our students.<\/p>\n","protected":false},"excerpt":{"rendered":"

A recent blog claims that “exams damage teens’ mental health.” Before you accept that claim, you should check out its evidence…<\/p>\n","protected":false},"author":18,"featured_media":4944,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[23,19],"class_list":["post-4925","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-lb-blog","tag-long-term-memory","tag-skepticism"],"_links":{"self":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/4925","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/users\/18"}],"replies":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/comments?post=4925"}],"version-history":[{"count":12,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/4925\/revisions"}],"predecessor-version":[{"id":4962,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/posts\/4925\/revisions\/4962"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media\/4944"}],"wp:attachment":[{"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/media?parent=4925"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/categories?post=4925"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.learningandthebrain.com\/blog\/wp-json\/wp\/v2\/tags?post=4925"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}