When Bad Questions Lead to Worse Headlines: The Problem with Recent Youth Survey Statistics
There’s a headline doing the rounds that’s got everyone fired up: “40% of teenage boys believe women lie about domestic and sexual violence.” It’s the kind of statistic that makes you want to throw your phone across the room. But before we all collectively lose our minds, we need to talk about something that’s been bugging me for years now – the way survey questions are worded, and how those wordings get spun into inflammatory headlines.
Look, I’m not here to defend misogyny or dismiss the very real problem of violence against women. The statistics on domestic and sexual violence in Australia are genuinely horrifying, and anyone who’s been paying attention knows we have a serious cultural problem to address. But what I am here to question is whether this particular statistic actually tells us what it claims to tell us.
The issue comes down to this: what exactly were these teenage boys asked? Was it “Do women always lie about domestic and sexual violence?” Or was it “Do women sometimes lie about domestic and sexual violence?” Or perhaps it was something even vaguer, like “Can women lie about these things?” Because here’s the uncomfortable truth – the answer to whether women can lie about these things is obviously yes. Humans lie. It’s an unfortunate fact of our species that everyone, regardless of gender, is capable of dishonesty.
Now, I’m sure some people reading this are already composing their angry responses. But stick with me. The distinction matters enormously. If you ask me whether women sometimes lie about domestic violence, I’d have to say yes – because statistically, with millions of accusations made over decades, it would be impossible for every single one to be truthful. That doesn’t mean I think women usually lie, or that I approach claims with scepticism by default. It just means I understand that humans are complicated and occasionally terrible.
But if a survey lumps my answer in with someone who genuinely believes that most or all women fabricate abuse claims, then that survey has failed at its basic job of capturing meaningful data. We’ve taken two completely different worldviews and crammed them into the same statistic.
This reminds me of another recent survey that claimed one in three Australian men admitted to committing intimate partner abuse. Sounds horrifying, right? Except when you dug into the methodology, one of the defining questions was “Have you ever behaved in a manner that has made a partner feel frightened or anxious?” I mean, Christ, I’ve probably done that when I’ve gotten frustrated about work or snapped at someone during a particularly stressful DevOps incident. Does that make me an abuser? The bundling of that question with actual physical violence – “Have you ever hit, slapped, kicked or otherwise physically hurt a partner when you were angry?” – created a statistic that was technically true but practically meaningless.
The really frustrating thing is that poorly designed surveys and misleading headlines actually hurt the causes they’re supposedly serving. When people spot the methodological problems (and in the age of internet forensics, they always do), it gives ammunition to the very people we should be countering. “See?” they say, “It’s all exaggerated. The feminists are manipulating statistics.” And suddenly, instead of having a conversation about the genuine radicalisation of young men through social media, we’re bogged down in arguments about survey design.
Because let’s be clear – there is a problem with how young men are being radicalised online. The algorithm-driven rabbit holes that lead from innocent gaming content to Andrew Tate and his ilk are real and documented. The rise of the “manosphere” and its toxic influence is genuinely concerning. I work in IT, I’ve seen how these systems work, and they’re frighteningly effective at creating echo chambers. A teenage boy watches a few videos about feeling overlooked or dismissed, and within weeks he’s being fed content that tells him women are the enemy.
That’s the conversation we should be having. But instead, we’re stuck debating whether this survey’s methodology was sound, and whether the headline accurately reflects what was actually measured.
What really gets under my skin is the double standard at play. When Betoota Advocate (a satire site, for crying out loud) ran a fake story about VB winning a craft beer award, the entire country fell for it. Nobody questioned it, nobody demanded to see the methodology of the supposed competition. When social media claims that Iran called America “the Epstein Gang,” it gets thousands of shares with zero fact-checking. But when a study comes out suggesting there might be problems with young men’s attitudes – suddenly everyone’s a research methodology expert.
Now, to be fair, some of this scepticism is warranted. We should be questioning the data we’re presented with. Critical thinking is important. But the selective application of that scepticism is revealing. Why are we so quick to accept studies that confirm our existing biases, but so eager to pick apart those that challenge us?
The truth is, we don’t need misleading statistics to make the case that something needs to change. The data on actual violence against women speaks for itself. The number of women who’ve experienced sexual harassment or assault, the domestic violence statistics, the inadequate police responses, the horrifyingly light sentences handed down to perpetrators – all of this is documented, verified, and absolutely damning.
Every woman I’m close to – my wife, my daughter, my colleagues – has at least one story of being harassed, followed, or worse. Most have several. And almost none of these incidents show up in any official statistics because reporting is often pointless or even actively harmful to the victim. That’s the reality we need to grapple with.
So here’s where I land on this: Yes, we need better survey design. Yes, headlines should accurately reflect what was actually measured. Yes, we should maintain our critical faculties when presented with startling statistics. But we also need to stop using methodological nitpicking as a way to avoid uncomfortable conversations about misogyny and violence.
The real question isn’t whether this particular survey was perfectly designed. The real question is: what are we going to do about the undeniable fact that young men are being radicalised by online content, and that this radicalisation is contributing to attitudes that enable violence against women?
We can argue about survey methodology all day, but at some point, we need to actually address the problem. Because while we’re debating the wording of questions, there are teenage boys out there absorbing content that tells them women are lying manipulators who deserve their contempt. And that, regardless of how well any survey captured it, is something we absolutely need to fix.
Maybe start by having honest conversations with the young men in our lives. Not lecturing them, not dismissing their concerns, but actually engaging with what they’re seeing and feeling. Because the manosphere succeeds precisely because it offers simple answers to complex feelings of alienation and confusion. If we want to counter that, we need to offer something better – and that starts with genuine connection and understanding, not just statistics in a headline.