There’s a thing that happens in tech where a capability goes from “theoretical concern” to “completely normal” without anyone really deciding that transition was okay. I’ve been watching it happen with AI agents over the past year or so, and it’s starting to sit uncomfortably with me.

Not long ago, the conversation was about chatbots giving wrong answers. Hallucinating citations. Confidently explaining that the capital of Australia is Sydney. Embarrassing, but contained. The blast radius was: someone got bad information and maybe acted on it. Bad, but recoverable.