The Most Underrated Feature in AI Agents Is Knowing When Not to Act
The Most Underrated Feature in AI Agents Is Knowing When Not to Act
The biggest lesson I learned building an agent that interacts with a real desktop: if you let it just go without confirming, people close it within 5 minutes. It does not matter how good the actions are.
The Autonomy Trap
It is natural to think that more autonomous equals more useful. The whole point of an agent is to do things for you, right? So the logical conclusion is to remove all the friction - no confirmations, no previews, just let it execute.
This kills retention. Users watch the agent click around their screen, moving faster than they can follow, and the immediate reaction is anxiety. What is it doing? Did it just delete something? Why did it open that app?
The Preview Pattern
Showing a preview of what the agent is about to do and waiting for a "go ahead" felt like slowing things down. But retention went way up.
The preview does not need to be elaborate. A simple text description works:
- "I am going to open Safari, navigate to GitHub, and create a new repository called 'project-x'. Proceed?"
- "I will move these 12 files from Downloads to Documents/invoices. Proceed?"
This takes one second to read and one click to confirm. The overhead is minimal, but the psychological impact is massive. The user feels in control.
Copilot Not Autopilot
The agents people actually keep using are the ones that feel like a copilot, not an autopilot. A copilot suggests the route and handles the mechanics, but the pilot makes the final call.
This applies especially to destructive or irreversible actions - sending emails, deleting files, submitting forms, making purchases. But even for safe actions, the confirmation step builds a trust relationship. Over time, users develop confidence in the agent and may opt into more autonomy for specific workflows they trust.
The path to full autonomy goes through earned trust, not assumed permission.
Fazm is an open source macOS AI agent. Open source on GitHub.