Scrape full HTML, clean text
Scrape full HTML, clean text, or metadata from a website (Cached in Redis for 10 min)
Request
- x-api-key: <your-api-key>
- Content-Type: application/json
Response
{
"cached": true,
"contentLength": 16,
"html": "<h1>Hello</h1><p>From castomAPI.</p>",
"metadata": {
"canonical": "<canonical>",
"description": "Generated from the endpoint's own schema.",
"keywords": "<keywords>",
"language": "en",
"ogImage": "<og image>",
"title": "Quarterly report"
},
"status": "success",
"statusCode": 200,
"targetUrl": "https://example.com/page",
"text": "Hello from castomAPI.",
"tokensDeducted": 1
}What it does
Scrape full HTML, clean text, or metadata from a website (Cached in Redis for 10 min)
Request
Body
| Field | Type | Required | Description |
|---|---|---|---|
bypassCache | boolean | no | |
format | enum | no | One of: html, text. |
includeMeta | boolean | no | |
url | string | yes |
Example request
{
"bypassCache": false,
"format": "html",
"includeMeta": false,
"url": "https://example.com/page"
}Response
| Field | Type | Description |
|---|---|---|
cached | boolean | |
contentLength | integer | |
html | string | |
metadata | object | |
↳ canonical | string | |
↳ description | string | |
↳ keywords | string | |
↳ language | string | |
↳ ogImage | string | |
↳ title | string | |
status | string | |
statusCode | integer | |
targetUrl | string | |
text | string | |
tokensDeducted | integer |
Example response
{
"cached": true,
"contentLength": 16,
"html": "<h1>Hello</h1><p>From castomAPI.</p>",
"metadata": {
"canonical": "<canonical>",
"description": "Generated from the endpoint's own schema.",
"keywords": "<keywords>",
"language": "en",
"ogImage": "<og image>",
"title": "Quarterly report"
},
"status": "success",
"statusCode": 200,
"targetUrl": "https://example.com/page",
"text": "Hello from castomAPI.",
"tokensDeducted": 1
}Errors
Every error answers with the same envelope: an HTTP status, a machine code and a sentence.
400 | The body or a parameter failed validation. The details array names the field. |
401 | No key, a revoked key or a wrong header. Send x-api-key. |
402 | The wallet cannot cover this call. Top up or wait for the monthly grant. |
404 | The resource does not exist, or it is not yours. Both answer identically and cost nothing. |
429 | Over the per-minute quota of your tier. Back off and retry. |
5xx | Upstream refused or timed out. The call is not billed. |
Code
curl -X POST 'https://app.castomapi.com/v1/moderate' \
-H 'x-api-key: <your-api-key>' \
-H 'Content-Type: application/json' \
-d '{"bypassCache": false, "format": "html", "includeMeta": false, "url": "https://example.com/page"}'const res = await fetch('https://app.castomapi.com/v1/moderate', {
method: 'POST',
headers: { 'x-api-key': '<your-api-key>', 'Content-Type': 'application/json' },
body: JSON.stringify({"bypassCache": false, "format": "html", "includeMeta": false, "url": "https://example.com/page"})
});
const data = await res.json();
console.log(data);import { request } from 'node:https';
// Node 18+ has fetch built in
const res = await fetch('https://app.castomapi.com/v1/moderate', {
method: 'POST',
headers: { 'x-api-key': '<your-api-key>', 'Content-Type': 'application/json' },
body: JSON.stringify({"bypassCache": false, "format": "html", "includeMeta": false, "url": "https://example.com/page"})
});
const data = await res.json();
console.log(data);import requests
res = requests.post(
'https://app.castomapi.com/v1/moderate',
headers={'x-api-key': '<your-api-key>'},
json={"bypassCache": False, "format": "html", "includeMeta": False, "url": "https://example.com/page"},
timeout=30,
)
print(res.json())<?php
$ch = curl_init('https://app.castomapi.com/v1/moderate');
curl_setopt_array($ch, [
CURLOPT_CUSTOMREQUEST => 'POST',
CURLOPT_RETURNTRANSFER => true,
CURLOPT_HTTPHEADER => ['x-api-key: <your-api-key>', 'Content-Type: application/json'],
CURLOPT_POSTFIELDS => json_encode(['bypassCache' => false, 'format' => 'html', 'includeMeta' => false, 'url' => 'https://example.com/page']),
]);
$data = json_decode(curl_exec($ch), true);
print_r($data);Cost and limits
This operation costs metered. A call that fails is never billed. Every account gets 1000 free tokens a month; paid balances never expire.
Rate limits per minute
| No key | 10 |
| Free | 60 |
| Pro | 300 |
| Enterprise | 1200 |
Questions
What does Scrape full HTML, clean text cost?
metered per successful call, debited from your wallet after the response. Failed calls are free. Every account receives 1000 free tokens a month.
How do I authenticate?
Send your key in the x-api-key header. One key covers every metered endpoint; there is nothing to enable per endpoint.
Can I send an Authorization: Bearer token instead?
Not for a metered endpoint — those take the x-api-key header and nothing else. Bearer tokens belong to the account side: the dashboard and account APIs accept a JWT session, and castomapi-auth issues those through a standard OAuth2 handshake, with authorization code, client credentials and refresh grants. The auth service page covers it.
What are the limits?
10 requests a minute per IP with no key at all, 60 a minute on the free tier, 300 on Pro, 1200 on Enterprise. Above the no-key tier the quota is per account, across every endpoint.
OpenAPI: https://app.castomapi.com/docs/json