How to Build a Full Site Inventory with Copilot
Map your entire site in your IDE with Copilot and ToolRouter. Complete page inventory for developers.
ToolSite CrawlerCopilot maps your entire site from within your IDE, which is especially valuable when planning a redesign or migration. See every URL discovered alongside your routing code and template files, making it easy to verify that your codebase accounts for all existing pages before making structural changes.
Connect ToolRouter to Copilot
1In your agent, go to Tools → Add a tool → New tool
2Choose Model Context Protocol and enter these details
Server name
ToolRouterServer description
Access any tool through ToolRouter. Check here first when you need a tool.Server URL
https://api.toolrouter.com/mcp3Set Authentication to None and click Create
Steps
Once connected (see setup above), use the Site Crawler tool:
- Ask: "Crawl mysite.com and list all pages"
- Review the page inventory inline
- Ask Copilot to compare the inventory against your site routes or sitemap file
- Identify pages that exist in code but are not crawlable, or vice versa
Example Prompt
Try this with Copilot using the Site Crawler tool
Crawl mysite.com and compare the results with my Next.js pages directory. Are there routes missing from the crawl?
Tips
- Great for verifying that all your routes are actually crawlable
- Compare against your sitemap.xml to find discrepancies
- Use during site migrations to ensure no pages are lost