The Web Starts Closing Its Doors to AI Agents

Autonomous agents from OpenAI, Meta, Google and a wave of startups are being marketed as digital errand runners that can book reservations, clear inboxes and buy goods on your behalf. But a growing number of websites are actively blocking them, deploying bot detection, terms-of-service restrictions and paywalls tuned to machine traffic. The result is a fragmenting internet where agent capability is increasingly capped by whether a given site decides to cooperate. It's the first real friction point in the agent gold rush.

Publishers and commerce sites are deploying bot detection and ToS restrictions aimed specifically at agents

Agent vendors promise broad web automation that the open web is not obligated to permit

Access is becoming a commercial and contractual negotiation rather than a technical default

Blocking behavior varies wildly by site, making agent reliability unpredictable

Source: https://www.theverge.com/ai-artificial-intelligence/1013195/ai-agents-blocked-web