How to Discover Duplicate Content with Claude
Find duplicate content using Claude and ToolRouter. Fix content duplication that dilutes your rankings.
ToolSite CrawlerClaude finds duplicate content across your site and helps you understand the root cause of each duplication. Discuss whether duplicates stem from URL parameters, CMS misconfiguration, or legitimate content reuse, and get specific recommendations for canonical tags, redirects, or content consolidation for each case.
Connect ToolRouter to Claude
1Go to Settings → Connectors → Add custom connector
2Enter the details below and click Add
Name
ToolRouterURL
https://api.toolrouter.com/mcp3Done — works on Claude chat, desktop, and mobile
Steps
Once connected (see setup above), use the Site Crawler tool:
- Ask Claude: "Crawl mysite.com and find pages with duplicate or near-duplicate content"
- Claude identifies pages sharing titles, descriptions, or similar content
- Ask: "Which duplicates are hurting our rankings and how should I resolve each one?"
- Claude recommends canonical tags, redirects, or content differentiation for each case
Example Prompt
Try this with Claude using the Site Crawler tool
Crawl mysite.com and find all duplicate content issues. For each duplicate pair, tell me the best way to resolve it.
Tips
- Claude can identify URL parameter patterns that generate duplicate pages
- Ask for canonical tag recommendations for each set of duplicates
- Check for HTTP/HTTPS and www/non-www duplicates specifically