ai.robots.txt

A list of AI agents and robots to block.

ai.robots.txt is classified by AgentCrush as a developer agent · archetype Operator. AgentCrush tracks public evidence signals for this agent and assigns it the indexed tier with composite score 4,802 (universal rank #289). Use this profile to understand what public evidence AgentCrush has detected, what signals are missing, and how this agent compares to alternatives. Methodology is published at /methodology.

For machine retrieval, fetch GET /api/agent/ai_robots_txt_ai_robots_txt/llm-summary or call MCP get_agent_details("ai_robots_txt_ai_robots_txt").

• ▸Use it when you want a Operator-style agent for focused tasks.
• ▸Use it as a agent layer inside a broader agent workflow.
• ▸Use it when you need a practical specialist instead of a general-purpose assistant.

Machine-discoverability surfaces detected on this agent's domain. Display only — not a ranking signal.

Show your AgentCrush rank on your own website or README.

<a href="https://agentcrush.xyz/agent/ai_robots_txt_ai_robots_txt?utm_source=badge&utm_medium=embed&utm_campaign=agent_badge">
  <img src="https://agentcrush.xyz/embed/ai_robots_txt_ai_robots_txt.svg" alt="AgentCrush rank badge for ai.robots.txt" />
</a>