Advanced

Anti-Bot Bypass

Scrape websites protected by Cloudflare, PerimeterX, DataDome, and other anti-bot systems.

Supported Protection Systems

Cloudflare
✓ Supported
PerimeterX
✓ Supported
DataDome
✓ Supported
Akamai
✓ Supported
reCAPTCHA
✓ Supported
hCaptcha
✓ Supported

Enable Anti-Bot Bypass

Add "antiBot": true to automatically handle protection:

javascript
{
  "url": "https://protected-site.com/data",
  "antiBot": true,
  "selectors": {
    "content": ".main-content"
  }
}

How It Works

When anti-bot mode is enabled, Scrpy:

  1. 1
    Detects Protection

    Automatically identifies the bot protection system in use

  2. 2
    Emulates Real Browser

    Uses undetected browser fingerprinting and behavior patterns

  3. 3
    Solves Challenges

    Automatically solves CAPTCHAs and JavaScript challenges

  4. 4
    Extracts Data

    Returns the clean data you requested

Anti-Bot Modes

javascript
{
  "url": "https://example.com",
  "antiBot": true  // or "antiBot": "standard"
}
javascript
{
  "url": "https://heavily-protected.com",
  "antiBot": "stealth"
}

Best Practices

Combine with Residential Proxies

For best results, use anti-bot with residential proxies for the highest success rates.

{ "antiBot": true, "proxy": "us", "proxyType": "residential" }

Add Reasonable Delays

When scraping multiple pages, add delays between requests to appear more human-like.

Use Sessions Wisely

Maintain session persistence for multi-page workflows to avoid re-solving challenges.

Credit Usage

ModeCredits
Standard anti-bot10 credits
Stealth mode25 credits
+ JS Rendering+5 credits

Related