How to Extract a Competitor's Product Catalogue with OpenClaw

Extract a Competitor's Product Catalogue with OpenClaw and ToolRouter. Schedule recurring catalogue extractions and track competitor product and pricing changes.

Tool
Catalogue Scraper icon
Catalogue Scraper

OpenClaw automates recurring `scrape_catalogue` jobs against competitor catalogues — running weekly or monthly extractions and surfacing what changed: new products added, products removed, price increases or drops. This is the right approach for ongoing competitive monitoring rather than one-off research.

Connect ToolRouter to OpenClaw

1Install the CLI
npm install -g toolrouter-mcp
2Call tools directly from OpenClaw
toolrouter-mcp call web-search search --query "AI tools"
toolrouter-mcp tools

Steps

Once connected (see setup above), use the Catalogue Scraper tool:

  1. List the competitor catalogue URLs to monitor.
  2. Run `catalogue-scraper` with `scrape_catalogue` for each and collect results in a normalized schema.
  3. Diff the new extraction against the previous run to identify added, removed, or repriced products.
  4. Schedule monthly runs and alert the product team when changes exceed a defined threshold.

Example Prompt

Try this with OpenClaw using the Catalogue Scraper tool
Use catalogue-scraper to scrape these competitor catalogues monthly: https://competitor-a.com/products, https://competitor-b.com/products. Extract name, price, category, and sku from each. Return all results in a stable schema so I can diff against last month's extraction to find pricing changes and new listings.

Tips

  • Use `sku` as the primary key for diffing — names can change with rephrasing even when the product is the same.
  • Alert only on material changes (price change >5%, new category added, SKU count change >10) to avoid noise.
  • Keep the schema fixed between runs so monthly diffs work without normalization.