The Open Web Is Quietly Closing Its Doors to AI Agents
Autonomous agents are being sold as the next interface to the internet — booking reservations, clearing inboxes, buying shoes — but the sites they need to touch are increasingly refusing to cooperate. In recent weeks a growing number of websites have begun blocking agent traffic, creating a widening gap between what agent vendors promise and what the web will actually allow. The result is an internet that is becoming selectively readable depending on who is doing the reading.
OpenAI, Meta, Google, and others are pushing agents that act on the user's behalf across the web
A growing number of websites have started blocking autonomous agent traffic
Access is fragmenting based on whether a request comes from a human or a machine
The tension sits between agent capability and publisher control over their own content
Source: https://www.theverge.com/ai-artificial-intelligence/1013195/ai-agents-blocked-web