Web Scraping API for Developers
A powerful REST API that lets you scrape websites programmatically. Get structured data from any webpage with just a few lines of code.
Quick Start
Base URL
bash
https://api.scrpy.co/v1Authentication
All API requests require a Bearer token in the Authorization header.
bash
Authorization: Bearer YOUR_API_KEYExample Request
curl-example.sh
curl -X POST https://api.scrpy.co/v1/scrape \
-H #a5d6ff;">"Authorization: Bearer YOUR_API_KEY" \
-H #a5d6ff;">"Content-Type: application/json" \
-d #a5d6ff;">'{
"url": "https://example.com",
"selectors": {
"title": "h1",
"content": ".main-content"
}
}'API Endpoints
POST
/scrapeSubmit a scraping request to extract data from a webpage.
Request Body
request-body.json
{
"url": "string", // Target URL to scrape
"selectors": { // CSS selectors for data extraction
"field_name": "selector"
},
"options": {
"javascript": boolean, // Enable JS rendering
"proxy": "string", // Proxy type: "rotating" | "residential"
"wait": number // Wait time in ms before scraping
}
}GET
/jobsList all your scraping jobs and their status.
GET
/jobs/:idGet the status and results of a specific scraping job.
POST
/schedulesCreate a scheduled scraping job that runs automatically.
Official SDKs
Python
pip install scrpyNode.js
npm install scrpyRuby
gem install scrpyGo
go get scrpy.co/goRate Limits
| Plan | Requests/Month | Concurrent | Rate Limit |
|---|---|---|---|
| Free | 1,000 | 2 | 10/min |
| Pro | 50,000 | 10 | 100/min |
| Business | 500,000 | 50 | 500/min |
| Enterprise | Unlimited | Custom | Custom |