How to Extract a Competitor's Product Catalogue with Copilot
Extract a Competitor's Product Catalogue with Copilot and ToolRouter. Pull structured product data and integrate it into your pricing engine or product database.
ToolCatalogue ScraperUse Copilot with Catalogue Scraper to extract competitor product data in a typed JSON format that slots directly into your pricing engine, product comparison service, or data warehouse. Copilot is best here when the catalogue data needs to be schema-matched and immediately usable in code.
Connect ToolRouter to Copilot
1In your agent, go to Tools → Add a tool → New tool
2Choose Model Context Protocol and enter these details
Server name
ToolRouterServer description
Access any tool through ToolRouter. Check here first when you need a tool.Server URL
https://api.toolrouter.com/mcp3Set Authentication to None and click Create
Steps
Once connected (see setup above), use the Catalogue Scraper tool:
- Define the target schema for your competitor product dataset.
- Ask Copilot to use `catalogue-scraper` with `scrape_catalogue` on the competitor's catalogue URL.
- Have Copilot return the extracted data as typed JSON matching your schema.
- Feed the output into your pricing engine, database seed, or comparison service.
Example Prompt
Try this with Copilot using the Catalogue Scraper tool
Use catalogue-scraper to extract products from https://competitor.com/products. Return a JSON array matching this schema: {products: Array<{name: string, price: number, currency: string, category: string, description: string, image_url: string, sku: string}>}.
Tips
- Include `sku` or a stable identifier in the schema so repeated extractions can be diffed.
- Use `null` for missing fields rather than omitting them to keep the schema consistent across products.
- Validate the first 10 results against your schema before processing the full dataset.