Crawl Multi-Page Sites for Structured Data
Follow links across multiple pages of a site to collect structured data from every matching page in a single crawl.
Scrape JavaScript-Rendered Pages
Extract content from single-page applications and JavaScript-rendered sites that return blank pages to standard scrapers.
Tool
Standard HTTP scrapers fetch the raw HTML response — but modern web applications render their content in the browser after the page loads. If you send a plain HTTP request to a React app, a Next.js site, or a dashboard built on a JavaScript framework, you get an empty shell with no data. You need a real browser that actually runs the JavaScript.
Stealth Scraper's `stealth_scrape` skill loads the full page in a headless browser with anti-bot evasion active, waits for dynamic content to render, and extracts the actual page content. Sites that block conventional scrapers or return CAPTCHAs to obvious bots are scraped reliably without intervention.
Developers, data engineers, and research teams use this to extract content from SPAs, pull data from dashboards that require JavaScript execution, and collect content from sites that actively detect and block automated HTTP clients.
Agent Guides
Claude
- Connect ToolRouter in Claude: claude mcp add toolrouter -- npx -y toolrouter-mcp
- Provide the URL of the JavaScript-rendered page you want to scrape.
- Ask Claude to use `stealth-scraper` with `stealth_scrape` to load and extract the page content.
ChatGPT
- Connect ToolRouter in ChatGPT: {"mcpServers":{"toolrouter":{"command":"npx","args":["-y","toolrouter-mcp"]}}}
- Provide the URL and specify what you want done with the data after extraction.
- Ask ChatGPT to use `stealth-scraper` with `stealth_scrape` to load the page.
Copilot
- Connect ToolRouter in Copilot: {"mcpServers":{"toolrouter":{"command":"npx","args":["-y","toolrouter-mcp"]}}}
- Identify the URL and the data fields your application schema requires.
- Ask Copilot to use `stealth-scraper` with `stealth_scrape` to load and extract the page.
OpenClaw
- Connect ToolRouter in OpenClaw: openclaw mcp add toolrouter -- npx -y toolrouter-mcp
- Prepare the list of JavaScript-rendered URLs to scrape.
- Run `stealth-scraper` with `stealth_scrape` for each URL and collect extracted data in a normalized schema.
Related Use Cases
Extract Data from Bot-Protected Sites
Retrieve content from sites that block automated access with Cloudflare, bot detection challenges, or rate limiting.