Scrapper Processing Status

Status Check API Documentation

Introduction

The Status Check API endpoint allows you to retrieve results for long-running scraping operations, whether they use basic scraping or LLM processing.

Authentication

All status checks require authentication using an API key. Include your key in the x-api-key header:

x-api-key: YOUR_API_KEY_HERE

Base URL

https://api.yetanotherapi.com/v1/llm-web-scrapper

Endpoint Details

Check Request Status

Retrieve the status and results of a previous scraping request.

HTTP Method: GET Endpoint: /{request_id}

Request Headers

Header
Value
Description

x-api-key

YOUR_API_KEY_HERE

Your unique API authentication key

URL Parameters

Parameter
Type
Description

request_id

string

The request ID received from initial request

Example Request

curl --location 'https://api.yetanotherapi.com/v1/llm-web-scrapper/c07ab203-1b4a-42f2-99dd-6628268668d2' \
--header 'x-api-key: YOUR_API_KEY_HERE'

Response Structure

For Basic Web Scraping:

{
    "request_id": "c07ab203-1b4a-42f2-99dd-6628268668d2",
    "status": "completed",
    "scraped_content": {
        "html": "<div>Content here</div>",
        "text": "Content here"
    }
}

For LLM Web Scraping:

{
    "request_id": "c07ab203-1b4a-42f2-99dd-6628268668d2",
    "status": "completed",
    "llm_json_structure": {
        // Structured data based on original prompt
    }
}

Status Values

Status
Description

pending

Request is queued for processing

processing

Content is being scraped or analyzed

completed

Results are ready

failed

Processing encountered an error

Error Responses

{
    "error": "Request ID not found",
    "status_code": 404
}
{
    "error": "Processing failed",
    "status_code": 500,
    "details": "Target website blocked access"
}

Important Notes

  • Status checks are free and don't consume API credits

  • Request IDs expire after 24 hours

  • Maximum retry attempts: 3 per request ID

  • Recommended polling interval: 5 seconds

  • Results are typically available within:

    • Basic scraping: 5-10 seconds

    • LLM processing: 15-20 seconds

Support

For technical support or to report issues, contact: hey@manojlk.work

Last updated