跳到主要内容

Item URL Crawler

Extract product data from e-commerce URLs. The system automatically detects the e-commerce platform from the URL and uses the appropriate crawler to extract product information.

Endpoint: POST /biz/bigdata/ecommerce/item/crawler

Parameters​

ParameterTypeRequiredDescription
urlStringYesProduct page URL from a supported e-commerce platform

Request​

curl -X POST "https://api.alaikis.com/std/biz/bigdata/ecommerce/item/crawler" \
-H "X-API-Key: your_api_key" \
-H "X-API-Secret: your_api_secret" \
-d 'bizContent={"url": "https://www.amazon.com/dp/B08N5WRWNW"}'

Response​

{
"code": 200,
"msg": "success",
"data": {
"title": "Product Title",
"price": "29.99",
"currency": "USD",
"images": ["https://example.com/image1.jpg"],
"description": "Product description...",
"specifications": {}
}
}

How It Works​

  1. The system parses the URL to extract the hostname
  2. The hostname is converted to a camelCase method name (e.g., www.amazon.com → wwwAmazonCom)
  3. The corresponding crawler method is invoked to extract product data
  4. Results are returned in a standardized format

Supported Platforms​

The crawler supports various e-commerce platforms. Platform detection is based on the URL hostname. Contact support for the current list of supported platforms.

Error Codes​

CodeDescription
400Invalid JSON format or URL decode error
406Missing required parameter (url)
500Crawler execution error (unsupported platform or page parsing failure)