tavily-crawl
Graph-based website crawler with parallel exploration
Part of the Tavily MCP server. Enforce policies on this tool with Intercept, the open-source MCP proxy.
WHEN AI AGENTS USE THIS TOOL
AI agents call tavily-crawl to perform operations in Tavily. While the risk category is not fully classified, applying a rate limit gives you visibility into how often the tool is called and prevents unexpected bursts of activity from autonomous agents.
WHY ENFORCE A POLICY ON TAVILY-CRAWL
Applying a policy to tavily-crawl gives you an audit trail of every call an AI agent makes. Even for low-risk tools, visibility into agent behaviour helps you debug issues, optimise workflows, and maintain compliance with your organisation's security requirements.
RECOMMENDED POLICY
Apply a rate limit to control usage and monitor for unexpected behaviour.
tools:
tavily-crawl:
rules:
- action: allow
rate_limit:
max: 60
window: 60 See the full Tavily policy for all 4 tools.
DETAILS
MORE TAVILY TOOLS
SIMILAR OTHER TOOLS ON OTHER SERVERS
RELATED READING
FREQUENTLY ASKED QUESTIONS
What does the tavily-crawl tool do?
Graph-based website crawler with parallel exploration. It is categorised as a Other tool in the Tavily MCP Server, which means it performs auxiliary operations.
How do I enforce a policy on tavily-crawl?
Add a rule in your Intercept YAML policy under the tools section for tavily-crawl. You can allow, deny, rate-limit, or validate arguments. Then run Intercept as a proxy in front of the Tavily MCP server.
What risk level is tavily-crawl?
tavily-crawl is a Other tool with low risk. Read-only tools are generally safe to allow by default.
Can I rate-limit tavily-crawl?
Yes. Add a rate_limit block to the tavily-crawl rule in your Intercept policy. For example, setting max: 10 and window: 60 limits the tool to 10 calls per minute. Rate limits are tracked per agent session and reset automatically.
How do I block tavily-crawl completely?
Set action: deny in the Intercept policy for tavily-crawl. The AI agent will receive a policy violation error and cannot call the tool. You can also include a reason field to explain why the tool is blocked.
What MCP server provides tavily-crawl?
tavily-crawl is provided by the Tavily MCP server (tavily-ai/tavily-mcp). Intercept sits as a proxy in front of this server to enforce policies before tool calls reach the server.
ENFORCE POLICIES ON TAVILY
Open source. One binary. Zero dependencies.