Scrape JavaScript-Rendered Pages
Extract content from single-page applications and JavaScript-rendered sites that return blank pages to standard scrapers.
Extract Data from Bot-Protected Sites
Retrieve content from sites that block automated access with Cloudflare, bot detection challenges, or rate limiting.
Tool
Many data-rich websites — job boards, real estate listings, travel fare aggregators, financial data sites — actively detect and block automated access. Standard scrapers get blocked within seconds: Cloudflare challenges, CAPTCHAs, IP bans, or simply empty responses masquerading as successful page loads.
Stealth Scraper uses a real headless browser with fingerprint randomization, human-like interaction patterns, and evasion techniques that make automated access look like a real user visit. The result is reliable content extraction from sites that return nothing to conventional tools.
Researchers, price monitoring teams, and competitive intelligence analysts use this to collect data from protected job boards, public pricing pages, and market data sites that would block any standard HTTP-based approach.
Agent Guides
Claude
- Connect ToolRouter in Claude: claude mcp add toolrouter -- npx -y toolrouter-mcp
- Provide the URL of the bot-protected page and specify the data you need.
- Ask Claude to use `stealth-scraper` with `stealth_scrape` — the stealth layer handles bot detection automatically.
ChatGPT
- Connect ToolRouter in ChatGPT: {"mcpServers":{"toolrouter":{"command":"npx","args":["-y","toolrouter-mcp"]}}}
- Provide the URL and describe what the extracted data will be used for.
- Ask ChatGPT to use `stealth-scraper` with `stealth_scrape` to retrieve the page.
Copilot
- Connect ToolRouter in Copilot: {"mcpServers":{"toolrouter":{"command":"npx","args":["-y","toolrouter-mcp"]}}}
- Identify the bot-protected URL and define your target schema.
- Ask Copilot to use `stealth-scraper` with `stealth_scrape` to retrieve the page content.
OpenClaw
- Connect ToolRouter in OpenClaw: openclaw mcp add toolrouter -- npx -y toolrouter-mcp
- List the bot-protected URLs to monitor and define the fields to extract from each.
- Run `stealth-scraper` with `stealth_scrape` for each URL on your monitoring schedule.
Related Use Cases
Crawl Multi-Page Sites for Structured Data
Follow links across multiple pages of a site to collect structured data from every matching page in a single crawl.