How to Build a Full Site Inventory with Claude

Build a complete site inventory using Claude and ToolRouter. Discover every page on your website.

Tool
Site Crawler icon
Site Crawler

Claude crawls your entire site and builds a page inventory you can explore interactively. After the crawl, ask Claude to categorize pages by type, identify navigation dead-ends, find pages with unusual depth, or export the inventory as a structured document you can share with your team for site architecture review.

Connect ToolRouter to Claude

1Go to Settings → Connectors → Add custom connector
2Enter the details below and click Add
Name
ToolRouter
URL
https://api.toolrouter.com/mcp
3Done — works on Claude chat, desktop, and mobile

Steps

Once connected (see setup above), use the Site Crawler tool:

  1. Ask Claude: "Crawl mysite.com and build a complete inventory of every page"
  2. Claude runs crawl_site and returns a structured list of all discovered pages with metadata
  3. Ask: "How many pages are there? Group them by section and status code"
  4. Claude organizes the inventory into a navigable summary with key metrics

Example Prompt

Try this with Claude using the Site Crawler tool
Crawl mysite.com and give me a complete inventory of every page. Include URL, status code, title, and word count for each.

Tips

  • Ask Claude to export the inventory as a CSV or markdown table for your records
  • Claude can identify sections of your site with the most pages for prioritization
  • Run quarterly to track how your site grows and changes over time