---
title: ToolRouter — Agent Use Case Guide
description: Step-by-step guide for completing a task with a specific AI agent using ToolRouter.
url: https://toolrouter.com/tools/geo/use-cases/check-ai-crawler-access/copilot
---
# How to Check AI Crawler Access with Copilot

Copilot checks AI crawler access and helps you fix issues right in your codebase. It tests each bot against your site, identifies blocking rules in robots.txt or server configuration, and can directly edit those files to allow the crawlers you want -- making the fix part of your next deployment.

## Setup

{"mcpServers":{"toolrouter":{"command":"npx","args":["-y","toolrouter-mcp"]}}}

## Steps

1. Add ToolRouter to Copilot MCP config
2. In Copilot Chat: "Check if AI crawlers can access our site using the geo tool"
3. Copilot reports the access status for each AI crawler
4. Ask: "Update our robots.txt to allow all AI crawlers"
5. Review and commit the changes

## Example Prompt

```
Check AI crawler access for our production site and suggest robots.txt updates to allow GPTBot and ClaudeBot.
```

## Tips

- Integrate crawler checks into your deployment pipeline
- Copilot can update your robots.txt file directly
- Run checks after CDN or WAF configuration changes
