Get URL Content
Extract content from any web page using our powerful scraping API.
Endpoint
GET /v1/web/scrape
Query Parameters
Parameter | Type | Required | Description |
---|---|---|---|
url | string | Yes | URL of the webpage to scrape |
Example Request
curl 'https://api.supadata.ai/v1/web/scrape?url=https://example.com' \
-H 'x-api-key: YOUR_API_KEY'
Response Format
{
"url": "string", // The URL that was scraped
"content": "string", // The content extracted from the URL
"name": "string", // The name of the webpage
"description": "string", // A description of the webpage
"ogUrl": "string", // Open Graph URL for the webpage
"countCharacters": "number", // The number of characters in the content
"urls": [
"string" // List of URLs found on the webpage
]
}
Error Codes
Status | Code | Description |
---|---|---|
400 | invalid-url | Invalid URL provided |
404 | not-found | Page not found |
403 | blocked | Access blocked by website |
429 | rate-limit | Too many requests |
500 | server-error | Internal server error |
Respect robots.txt and website terms of service when scraping web content.
Pricing
- 1 transcript request = 1 credit