Posts / ai

Cognitive Debt: The Bill We're Running Up Without Noticing


There’s a concept doing the rounds at the moment called cognitive debt, and it’s been sitting in the back of my head for a few days now.

The idea is straightforward. Tech debt is what happens when you cut corners on code quality to ship faster, and then spend the next year paying for it in maintenance hell. Cognitive debt is what happens when you outsource the thinking itself. You ship the thing, it works, but you don’t actually understand why it works. The understanding got deferred along with the effort.

I’ve been in IT long enough to watch several versions of this play out. Every time a new abstraction layer appears, there’s a cohort of people who learn to use it without learning what’s underneath. Usually that’s fine. You don’t need to understand TCP/IP to build a decent web app. But there’s a threshold, and when something breaks at the layer you skipped, you’re standing there with no tools and no map.

What makes the AI version different is the scale and the invisibility of it. A junior dev on someone’s team recently shipped a feature that worked perfectly for three weeks. Then an edge case broke it. He couldn’t debug his own code because he’d prompted his way through writing it without building any mental model of what was actually happening. The code was correct. It was just opaque to its own author.

That story is uncomfortable because it’s not a story about laziness. The kid shipped working code. By every visible metric, he succeeded. The debt was invisible until it wasn’t.

Here’s the part that genuinely worries me: this is mostly a developer problem right now. Developers are, on balance, a group with strong feedback loops. Code breaks, tests fail, prod incidents happen at 2am. There are forcing functions. The same dynamic moving into medicine and finance is a different thing entirely. You can’t patch a misdiagnosis. A bad investment call based on a model nobody interrogated doesn’t come with a stack trace. And the incentive structure for the companies building these tools is almost perfectly misaligned: they make money on adoption speed, not on whether users actually understand what they’re using.

I want to be honest about the tension here, because I don’t think the pessimistic read is the only one. I use AI tools every day and they’re genuinely good. They’ve made certain categories of work faster and less tedious. I’ve watched people pick up technologies they’d never have attempted otherwise, asking questions they wouldn’t have known to ask without something to bounce off. That’s real. It’s not nothing.

But there’s a difference between using a tool to accelerate understanding and using it to replace understanding. The former is how humans have always worked. The latter is something else. The uncomfortable question, the one I don’t have a clean answer to, is how easy it is to slide from one into the other without noticing.

The argument that this is self-correcting, that high stakes will force genuine learning, only works if the consequences are visible and attributable. In most knowledge work they aren’t, not quickly anyway. You can coast on AI-assisted output for years. By the time the credit line runs out, AI improvements might just extend it further.

I don’t know where this lands. Nobody does. What I’m fairly sure of is that “judgment without foundational understanding” is a reasonable description of confident ignorance, and we should probably stop acting like it isn’t.