The Web Starts Locking Its Doors on AI Agents

Autonomous agents from OpenAI, Meta, Google, and a wave of startups promise to browse, book, buy, and clean up your inbox on your behalf — but an increasing number of websites are blocking them outright. In recent weeks, publishers and platforms have begun deploying defenses specifically aimed at agent traffic, treating it as distinct from human visitors and traditional crawlers. The result is a widening gap between what agents are marketed as capable of and what they can actually reach. The agent economy's biggest bottleneck may not be model intelligence at all, but access.

Multiple major AI labs are shipping agents that act on the open web on a user's behalf

Sites are now deploying blocks and defenses targeting agent traffic specifically

Agent access is being treated separately from both human users and legacy web crawlers

The friction threatens to slow commercial adoption of browser-based automation

Source: https://www.theverge.com/ai-artificial-intelligence/1013195/ai-agents-blocked-web