Notes
I probed every remote server in the official MCP Registry. 30,557 URLs, one evening.
October 19, 2026
Every remote MCP server in the official registry got one initialize and one tools/list with no credentials. 18,216 answered, 16,575 handed over a tool list, and the manifests, protocol versions and annotations tell a story about what agents are being connected to.
Which well-known sites block AI crawlers, from 122 robots.txt files
October 19, 2026
122 well-known sites resolved against 19 AI crawler user agents. 35 block at least one, 23 block none, six news publishers block ClaudeBot while allowing GPTBot, and 47 publish a real llms.txt.