Skip to content

Item URL Crawler

Extract product data from e-commerce URLs. The system automatically detects the e-commerce platform from the URL and uses the appropriate crawler to extract product information.

Endpoint: POST /biz/bigdata/ecommerce/item/crawler

Parameters

ParameterTypeRequiredDescription
urlStringYesProduct page URL from a supported e-commerce platform

Request

bash
curl -X POST "https://api.alaikis.com/std/biz/bigdata/ecommerce/item/crawler" \
  -H "X-API-Key: your_api_key" \
  -H "X-API-Secret: your_api_secret" \
  -d 'bizContent={"url": "https://www.amazon.com/dp/B08N5WRWNW"}'

Response

json
{
  "code": 200,
  "msg": "success",
  "data": {
    "title": "Product Title",
    "price": "29.99",
    "currency": "USD",
    "images": ["https://example.com/image1.jpg"],
    "description": "Product description...",
    "specifications": {}
  }
}

How It Works

  1. The system parses the URL to extract the hostname
  2. The hostname is converted to a camelCase method name (e.g., www.amazon.comwwwAmazonCom)
  3. The corresponding crawler method is invoked to extract product data
  4. Results are returned in a standardized format

Supported Platforms

The crawler supports various e-commerce platforms. Platform detection is based on the URL hostname. Contact support for the current list of supported platforms.

Error Codes

CodeDescription
400Invalid JSON format or URL decode error
406Missing required parameter (url)
500Crawler execution error (unsupported platform or page parsing failure)