Scrape anything.
Nothing scrapes back.
A Python toolkit that bypasses Cloudflare, DataDome, Akamai, and PerimeterX — shipped as a CLI, a Python API, and a hosted service. Exports straight to CSV, JSON, Excel, or SQLite.
The old scrapers stopped working.
Cloudflare Turnstile, DataDome and Akamai fingerprint TLS, canvas, WebGL and audio — not just IPs. A rotating proxy does nothing against that.
You need matched browser fingerprints, real cookie state, and human-shaped request patterns. Otherwise you're just paying for blocked traffic.
SPAs, hydration, lazy-loaded data, infinite scroll. Anything with a real runtime needs a real browser — but only when it needs one.
Fastest method first.
Heavier weapons only when needed.
IntelliScrape runs a tiered engine. It attempts the cheapest, fastest scraping method first and escalates only when a target pushes back — so 70% of requests never leave tier 1, and hardcases still land.
curl_cffi
playwright-stealth
nodriver
camoufox
Sub-second. Speaks TLS like Chrome/Firefox/Safari. Handles ~70% of targets alone.
Renders JS-heavy pages, patched fingerprints, real DOM. Escalates when static hits a wall.
Direct CDP with no webdriver traces. Deployed against DataDome / PerimeterX hardcases.
Full fingerprint rewrite — canvas, WebGL, audio, fonts. Used only when needed.
Everything the block-page is trying to stop.
Get past anti-bot walls
Cloudflare, DataDome, Akamai, PerimeterX bypass. Canvas / WebGL / audio fingerprint spoofing. TLS impersonation across Chrome, Firefox, Safari, Edge profiles.
Log in and interact like a person
Auth flows, form submission, search inputs, click paths, human-shaped delays. Sessions survive across pages.
Never lose your place
Cookie persistence, smart retries with fallback engines, request/response interception. Resume where a run left off.
Scale without getting blocked
IP rotation, residential proxy support, per-endpoint health checking. Backoff when a target starts throttling — not after.
Get data out, not just HTML
Structured extraction from JSON-LD, meta tags, and DOM fallbacks. Export directly to CSV, JSON, Excel, or SQLite.
Whole-site crawling
Pagination detection, sitemap parsing, media downloads, per-domain concurrency limits. Point it at a domain and get a dataset.
Pick a surface.
Same engine, three entry points. The CLI is fastest for one-offs. The Python API is what you want inside a pipeline. The hosted service is what you want when you'd rather not run browsers on your own boxes.
$ intelliscrape https://example.com --export csv -o data.csv
$ intelliscrape https://site.com --login --username user --password pass
$ intelliscrape https://docs.python.org --crawl --max-pages 50Skip the "clean the HTML" step.
A scrape isn't finished until the data is queryable. IntelliScrape writes analysis-ready files: typed CSV, well-formed JSON, Excel with proper column types, or a portable SQLite database you can hand to your notebook.
| sku | name | category | price | stock | rating |
|---|---|---|---|---|---|
| p_10241 | AeroKnit Runner 3 | footwear | $142.00 | in_stock | 4.7 |
| p_10242 | Trailhead Vest | outerwear | $189.00 | in_stock | 4.6 |
| p_10243 | CoreLite Merino Tee | tops | $68.00 | low | 4.8 |
| p_10244 | GridShell Windbreaker | outerwear | $225.00 | in_stock | 4.5 |
| p_10245 | Alpine Waffle Beanie | accessory | $34.00 | in_stock | 4.9 |
| p_10246 | Sable Trail Short 7" | bottoms | $78.00 | in_stock | 4.4 |
Free. LGPL-2.1 licensed. On GitHub.
Anti-detection web scraping for 98% of the internet. CLI, Python API, and a hostable FastAPI service. Written in Python 3.10+.