How to Discover Duplicate Content with Copilot
Find duplicate content in your IDE with Copilot and ToolRouter. Fix canonical and routing issues.
ToolSite CrawlerCopilot detects duplicate content issues and connects them to the templates, routing rules, or CMS configurations in your codebase that cause them. Fix canonical tags, add URL parameter handling, or adjust routing logic directly in your editor to resolve duplication at the source rather than page by page.
Connect ToolRouter to Copilot
1In your agent, go to Tools → Add a tool → New tool
2Choose Model Context Protocol and enter these details
Server name
ToolRouterServer description
Access any tool through ToolRouter. Check here first when you need a tool.Server URL
https://api.toolrouter.com/mcp3Set Authentication to None and click Create
Steps
Once connected (see setup above), use the Site Crawler tool:
- Ask: "Crawl mysite.com and detect duplicate content"
- Review duplicate page groups and their URLs
- Ask Copilot to add canonical tags or redirect rules in your code
- Re-crawl to verify duplicates are properly resolved
Example Prompt
Try this with Copilot using the Site Crawler tool
Find duplicate content on mysite.com and add canonical tags to my page templates to resolve them.
Tips
- Copilot can add canonical link elements to your layout components
- Great for fixing URL parameter-generated duplicates with route normalization
- Check your dynamic routes for patterns that create unintended duplicate pages