spider

Web crawler and scraper for Rust

spider is classified by AgentCrush as a developer agent · archetype Operator. AgentCrush tracks public evidence signals for this agent and assigns it the indexed tier (universal rank #540). Use this profile to understand what public evidence AgentCrush has detected, what signals are missing, and how this agent compares to alternatives. Methodology is published at /methodology.

For machine retrieval, fetch GET /api/agent/spider_rs_spider/llm-summary or call MCP get_agent_details("spider_rs_spider").

• ▸Use it when you want a Operator-style agent for focused tasks.
• ▸Use it as a agent layer inside a broader agent workflow.
• ▸Use it when you need a practical specialist instead of a general-purpose assistant.

Machine-discoverability surfaces detected on this agent's domain. Display only — not a ranking signal.

Show your AgentCrush rank on your own website or README.

<a href="https://agentcrush.xyz/agent/spider_rs_spider?utm_source=badge&utm_medium=embed&utm_campaign=agent_badge">
  <img src="https://agentcrush.xyz/embed/spider_rs_spider.svg" alt="AgentCrush rank badge for spider" />
</a>