---
title: ToolRouter — Use Case
description: Step-by-step guide for a real-world ToolRouter use case with agent-specific instructions.
url: https://toolrouter.com/tools/site-crawler/use-cases/discover-duplicate-content
---
# Discover Duplicate Content

Duplicate content is one of the most misunderstood SEO problems. It does not cause penalties, but it does cause confusion -- when multiple pages have the same content, search engines must choose which one to index and rank. Often they choose wrong, ranking a less important version while ignoring your preferred page.

Duplicate content commonly arises from URL parameters creating multiple versions of the same page, HTTP/HTTPS and www/non-www variations, print-friendly page versions, paginated content, and CMS-generated category and tag pages that overlap with main content.

ToolRouter's crawl_site skill detects pages with matching or near-matching titles, descriptions, and content hashes. It identifies URL patterns likely to create duplicates and checks for proper canonical tag implementation across all variations.

**Tool:** [Site Crawler](https://toolrouter.com/tools/site-crawler)
**Skills:** crawl_site

## Agent Guides

- [How to Discover Duplicate Content with Claude](https://toolrouter.com/tools/site-crawler/use-cases/discover-duplicate-content/claude): Guide for Claude
- [How to Discover Duplicate Content with ChatGPT](https://toolrouter.com/tools/site-crawler/use-cases/discover-duplicate-content/chatgpt): Guide for ChatGPT
- [How to Discover Duplicate Content with Copilot](https://toolrouter.com/tools/site-crawler/use-cases/discover-duplicate-content/copilot): Guide for Copilot
- [How to Discover Duplicate Content with OpenClaw](https://toolrouter.com/tools/site-crawler/use-cases/discover-duplicate-content/openclaw): Guide for OpenClaw
