We’re surrounded by statistics—charts, claims, and data points competing for our attention. Some inform us. Others manipulate us. Tim Harford’s book The Data Detective” offers ten “rules” for thinking more clearly about numbers, claims, and headlines. Although these “rules” focus on statistics and numbers, they can also build media literacy skills—the awareness and discernment that help us engage with news, advertising, and social media in more beneficial ways. What follows is my take on Harford’s “rules,” informed by Harford’s podcast episode, and this article from “The Mathematics Enthusiast.”


Rule 1: Search Your Feelings

Before deciding if a statistic is true, notice how it makes you feel. Emotion is a compass pointing toward your biases. After listening to this podcast episode, my husband and I have tried to apply this principle as we consume media. If we have a strong emotional response and we either really want a claim to be true or want it to be false, that is our cue to slow down, get curious, and investigate the claim more thoroughly.

“When data makes you angry or triumphant, pause before you post.”

Example: If you read a headline claiming “People who drink coffee live longer,” your reaction might tell you more than the statistic itself. Coffee drinkers may feel validated, while members of The Church of Jesus Christ of Latter-day Saints—whose health code, known as the Word of Wisdom, discourages coffee—might feel instant skepticism. Either reaction is a sign to pause and look more closely at the study: who conducted it, what they measured, and how strong the evidence really is.


Rule 2: Ponder Your Personal Experience

Your experience is real—but limited. Personal stories can sharpen our understanding or distort it, depending on how we use them. It’s easy to dismiss data by saying, “Well, I’ve never…” or, “I’ve always..” Practice pausing when inclined to use such phrases.

Whenever we catch ourselves relying on our own exceptions as evidence, it’s a sign to slow down, get curious and consider that our perspective may not represent the whole picture.

Example: You might know someone who smoked daily and lived to 90. That doesn’t mean cigarettes are safe—it just reminds us that one person’s story, even our own, doesn’t outweigh the broader evidence. We need both the personal and the statistical perspective to see clearly.


Rule 3: Avoid Premature Enumeration

Enumeration means counting or classifying—but before we start counting, we need to ask what the categories actually mean. Counting isn’t neutral. Every statistic begins with a decision about what counts and how it is defined. That decision shapes the story a number tells.

It’s easy to assume we know what a number means—or to let others lead us to believe we do—but meaning lives in the fine print.

Example: When we hear that unemployment has “dropped,” it sounds straightforward. But in the U.S., a person only counts as unemployed if they’ve actively looked for work in the past four weeks. People who’ve stopped searching, gone back to school, or taken part-time jobs aren’t included. The number might be technically accurate, yet it can still give a misleading picture of reality if we don’t understand how it’s defined.


Rule 4: Step Back and Enjoy the View

Zooming in too close exaggerates change; zooming out too far misses detail. The story numbers tell often depends on the time frame, context, or slice of data we choose to examine.

Ask: Why were these points in time chosen? What does the broader pattern look like? Looking for the longer view protects us from being swept along by whatever spike or dip happens to fit the narrative of the day.

Example: A headline might announce, “Housing prices are falling!” and show a steep downward graph. But if that graph only covers the last two months, it may hide that prices have actually risen steadily over the past five years. Politicians, advertisers, and even journalists often select starting and ending points that tell the story they want you to see.


Rule 5: Get the Backstory

Every number has a narrative behind it. Dig for what didn’t make the headline. Numbers don’t just appear out of thin air—they come from studies, surveys, and decisions about what to measure, who to include, and how to interpret the results. Without that context, even accurate numbers can mislead.

Ask: What evidence is this based on? Who did the study? Why?

Example: A headline might proclaim, “Dark chocolate boosts memory!” It’s tempting to take that at face value—especially if we love chocolate. But a quick look at the backstory could reveal that the study had only fifteen participants, or that it was funded by a chocolate company. The finding might still hold some truth, but it needs to be seen in light of the methods, funding, and limitations that shaped it.


Rule 6: Ask Who Is Missing

Every statistic tells a story—but not always the whole one. Statistics that praise a way of life often miss counting those who didn’t stay in it. If the story sounds too tidy, start by asking who isn’t in the picture.

Whenever we hear a sweeping claim, it’s worth asking: Who was included—and who wasn’t?

Example: Headlines and studies from think tanks might make claims like married people are the happiest, mothers are the most fulfilled, or religious people have the best sex. But what’s missing from those claims? Usually the voices of people who are single, divorced, widowed, child-free, or who’ve left faith communities. When certain demographics of people are missing, the conclusions may look cleaner—and far more certain—than they really are.


Rule 7: Demand Transparency

Behind every statistic is a chain of choices about how data are collected, analyzed, and interpreted. When those choices are hidden behind technical jargon or automated systems, bias and absurdity can hide in plain sight. Numbers can often reflect the systems that created them, not the reality they’re meant to capture. 

Whether it’s credit scores, political polls, or big-data algorithms, we should always ask: How is this number created? What is it really measuring—and what isn’t it?

Example: My own credit score is an illustration of this. I have no debt, a paid-off home and car, yet my credit score is zero. Because I’m an owner of a mortgage company, states reviewing our business licensing occasionally flag my “bad” credit and ask for an explanation. The irony, of course, is that I’m arguably a better risk than someone with a high credit score. But the scoring system isn’t designed to measure financial health—it’s designed to measure how reliably someone uses credit. The result is a number that tells an incomplete story.


Rule 8: Don’t Take Statistical Bedrock for Granted

Reliable numbers depend on reliable institutions. Behind every public statistic—unemployment, inflation, health data—there are agencies collecting, checking, and publishing that information. We tend to take them for granted until they’re questioned, defunded, or pressured to produce a preferred outcome. Statistics are only as trustworthy as the independence of the people producing them. 

Whenever leaders—of governments, companies, or churches—pressure those handling data to present a certain image, we move from measuring reality to managing perception.

Example: In August 2025, President Trump dismissed the head of the Bureau of Labor Statistics (BLS) after a weaker-than-expected jobs report was released. The Bureau’s role is to provide independent, nonpartisan data about the economy—but that foundation can be shaken when political leaders treat statistics as loyalty tests. If those responsible for counting and reporting data fear retribution for honest results, the numbers we depend on for public understanding and economic stability lose their integrity.


Rule 9: Remember That Misinformation Can Be Beautiful, Too

We live in a visual age where a single chart or graphic can persuade faster than a paragraph of explanation. Well-designed visuals can clarify truth—but they can also conceal distortion. The more appealing the image, the easier it is to overlook how much has been cropped, scaled, or exaggerated to produce it. 

The goal isn’t to distrust every chart or headline, but to train our eyes to see what’s been emphasized, downplayed, or omitted.

Example: A social-media post might show a dramatic bar chart proving “a massive rise in crime,” but the Y-axis starts at 95 % instead of 0 %, turning a small change into a towering spike. Or a line graph might zoom in on just a few months, cutting out the long-term downward trend. Because the visual looks professional—and because humans are drawn to beauty and simplicity—we’re less likely to question it.


Rule 10: Keep an Open Mind

At the center of all these rules is one virtue: curiosity. Critical thinking isn’t about winning arguments—it’s about staying genuinely interested in what the data might be telling us, even when it’s complicated.

Curiosity protects us from both cynicism and manipulation. It keeps us engaged long enough to ask the next question.

Example: Take what’s being called the “male loneliness epidemic.” The phrase alone carries emotional weight and has been used to support a wide range of narratives—from concern about men’s mental health to calls for a return to traditional gender roles. A curious approach asks: What do we actually know? How is loneliness being measured? Are men truly becoming more isolated, or are they simply more willing to report it now? How do factors like social expectations, gender norms, and economic pressures shape both the experience and reporting of loneliness?

Curiosity can lead to deeper understanding. It helps us see that statistics about loneliness aren’t just numbers; they’re reflections of what—and who—we value enough to study, discuss, and respond to. When we have an open mind, we resist the temptation to use data as proof of what we already believe and instead use it as an invitation to learn more.


Final Thoughts

Harford’s rules illustrate that the numbers themselves aren’t moral or immoral. It’s how we use them that shapes our thoughts and perceptions. Confirming our biases may feel satisfying—it gives us the illusion of certainty—but that comfort comes at a cost. Unexamined certainty can justify discrimination, spread misinformation, and lead to uninformed decisions that harm others.

Curiosity can interrupt that cycle. It invites humility, empathy, and truth-seeking. Data can illuminate or mislead, but curiosity makes us less likely to be manipulated by it—and less likely to manipulate others with it. 

Stay humble enough to keep listening and brave enough to keep asking.

Other Resources

More or Less — A podcast that investigates real-world claims in media and public life. Hosted by Tim Harford.

Stats + Stories — This podcast examines data, narratives, and meaning with episodes like: No One is Poisoning Your Kids’ Candy, Trust the Numbers.

Statistics Made Simple — A podcast on how is data collected, analyzed, and used (or misused) especially in social science contexts.

Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy Book asserting that mathmatical models can prop up the lucky, punish the downtrodden, and undermine our democracy. “Welcome to the dark side of Big Data.”

Calling Bullshit: The Art of Skepticism in a Data-Driven World A book giving tools to recognize misinformation, disinformation, and fake news.

How To Lie With Statistics Probably one of the best known books about the manipulation and misrepresentation of information through statistics, though a bit dated.

One response to “How Not to Be Fooled by Statistics: Ten Rules for Seeing Clearly”

  1. Does Domestic Violence Go Both Ways? – The Little Stream: Where Soul Meets Society — Reflections on Well-Being, Religion, and Power Avatar

    […] or misrepresented findings drawn from a few flawed or limited data sources. I recently wrote “How Not to Be Fooled by Statistics: Ten Rules for Seeing Clearly,” and this topic is a perfect example of why statistical literacy […]

    Like

Leave a comment

Photo by Min An on Pexels.com