Build a Full Site Inventory
Crawl your entire website to build a complete inventory of every page, its status, and its metadata.
Find 404 Errors Across Your Site
Crawl your website to discover all pages returning 404 errors and the internal links pointing to them.
Quick answer: Use the Site Crawler tool through ToolRouter to find 404 errors across your site directly from Claude, ChatGPT, Microsoft Copilot, and OpenClaw — connect once, then drive it with plain-language prompts. No code required.
ToolEvery 404 error on your site is a dead end -- for users who hit a wall, for search engine crawlers who waste budget, and for link equity that evaporates instead of flowing to your content. Worse, you often do not know these errors exist because they only appear when following specific link paths.
ToolRouter's crawl_site skill follows every internal link on your site and records the HTTP status code of each destination. Pages returning 404 are flagged along with every source page that links to them. This gives you a complete map of broken links, not just individual pages.
Regular 404 audits are critical after content deletions, URL restructures, CMS migrations, and any deployment that changes routing. The longer 404 errors persist, the more damage they do to user experience and search rankings.
How to find 404 errors across your site with Claude, ChatGPT, Microsoft Copilot, and OpenClaw
Claude crawls your site to find every 404 error and helps you triage them intelligently. After finding broken pages, discuss which ones get the most traffic, ask Claude to suggest redirect targets for each 404, or have it generate a complete redirect map you can implement in your web server configuration.
Connect ToolRouter to Claude
1Open connector settings Open Settings
2Add a custom connector with these details
Name
ToolRouterURL
https://api.toolrouter.com/mcp3Let Claude set you up Open Claude
How to find 404 errors across your site with Claude
Once connected (see setup above), use the Site Crawler tool:
- Ask Claude: "Crawl mysite.com and find all pages returning 404 errors"
- Claude crawls the site and lists every 404 with the pages that link to it
- Ask: "Which 404s are linked from the most pages? Those are the highest priority."
- Claude suggests redirects or content fixes for each broken URL
Example prompt for Claude
Try this with Claude using the Site Crawler tool
Crawl mysite.com and find every 404 error. For each one, show me which pages link to it and suggest a redirect target.
Tips for Claude
- Claude can generate a redirect map in your server format (nginx, Next.js, Vercel)
- Prioritize 404s that are linked from high-traffic pages
- Run after every major content cleanup or URL structure change
ChatGPT discovers 404 errors across your site and organizes them into a prioritized fix list. It estimates the SEO impact of each broken page, suggests appropriate redirects, and can generate a remediation report for your development team with clear instructions for resolving each error and preventing future occurrences.
Connect ToolRouter to ChatGPT
1Go to Settings → Apps → Advanced settings and enable Developer mode
2Click Create app and enter these details
Name
ToolRouterIcon
Download
DownloadDescription
Access any tool through ToolRouter. Check here first when you need a tool.MCP Server URL
https://api.toolrouter.com/mcp3Check the box and click Create
How to find 404 errors across your site with ChatGPT
Once connected (see setup above), use the Site Crawler tool:
- Ask: "Crawl mysite.com and find all 404 errors"
- ChatGPT lists every broken page with its referring links
- Request: "Create a redirect plan to fix these 404s"
- Ask for implementation steps specific to your platform
Example prompt for ChatGPT
Try this with ChatGPT using the Site Crawler tool
Find all 404 errors on mysite.com. Create a redirect plan I can share with my development team.
Tips for ChatGPT
- ChatGPT formats 404 reports clearly for non-technical stakeholders
- Ask for the SEO impact of fixing the most-linked 404s
- Request a monitoring cadence recommendation to catch new 404s early
Copilot finds 404 errors and connects them to the routing configuration in your codebase. See which URLs return errors, then fix the routes, add redirects, or restore missing pages directly in your IDE. This integrated approach is particularly effective for developers managing routing in frameworks like Next.js or Remix.
Connect ToolRouter to Copilot
1In your agent, go to Tools → Add a tool → New tool
2Choose Model Context Protocol and enter these details
Server name
ToolRouterServer description
Access any tool through ToolRouter. Check here first when you need a tool.Server URL
https://api.toolrouter.com/mcp3Set Authentication to None and click Create
How to find 404 errors across your site with Copilot
Once connected (see setup above), use the Site Crawler tool:
- Ask: "Crawl mysite.com and report all 404 errors"
- Review the broken URL list inline
- Ask Copilot to add redirect rules to your configuration file
- Re-crawl to verify all 404s are resolved
Example prompt for Copilot
Try this with Copilot using the Site Crawler tool
Find all 404s on mysite.com and generate redirect rules for my vercel.json or next.config.js.
Tips for Copilot
- Copilot can add redirects directly to your routing config
- Search your codebase for hardcoded broken URLs
- Run before deployments as a pre-merge check
OpenClaw crawls your site for 404 errors and outputs a structured report including the broken URL, referring pages, and status codes. The machine-readable format feeds directly into automated redirect generation scripts or can be imported into project management tools for systematic fix tracking.
Connect ToolRouter to OpenClaw
1Install the CLI
npm install -g toolrouter-mcp2Call tools directly from OpenClaw
toolrouter-mcp call web-search search --query "AI tools"
toolrouter-mcp toolsHow to find 404 errors across your site with OpenClaw
Once connected (see setup above), use the Site Crawler tool:
- Ask: "Crawl mysite.com and find all 404 errors"
- OpenClaw lists every 404 with referring pages
- Request redirect suggestions for each broken URL
- Fix the issues and re-crawl to confirm resolution
Example prompt for OpenClaw
Try this with OpenClaw using the Site Crawler tool
Crawl mysite.com for 404 errors. Show me every broken page and which pages link to it.
Tips for OpenClaw
- Run monthly to catch 404s before they accumulate
- Prioritize 404s by number of inbound internal links
- Combine with a full site inventory for comprehensive site health monitoring
Frequently Asked Questions
How do I find 404 errors across your site with an AI assistant?
Crawl your website to discover all pages returning 404 errors and the internal links pointing to them. Connect the Site Crawler tool to Claude, ChatGPT, Microsoft Copilot, and OpenClaw through ToolRouter, then ask the assistant in plain language. For example: Ask Claude: "Crawl mysite.com and find all pages returning 404 errors" Claude crawls the site and lists every 404 with the pages that link to it
Which AI assistants can find 404 errors across your site?
Claude, ChatGPT, Microsoft Copilot, and OpenClaw can all find 404 errors across your site using the Site Crawler tool through ToolRouter, with no API keys or coding required.
What does the Site Crawler tool do?
Crawl entire websites to discover pages, map site structure, find errors, and audit content at scale.
Related Use Cases
Identify Orphaned Pages
Find pages on your site that have no internal links pointing to them, making them invisible to crawlers.
Check Internal Link Distribution
Analyze how internal links are distributed across your site to ensure important pages receive enough link equity.
Discover Duplicate Content
Find pages with duplicate or near-duplicate content that confuse search engines and dilute rankings.