Item URL Crawler
Extract product data from e-commerce URLs. The system automatically detects the e-commerce platform from the URL and uses the appropriate crawler to extract product information.
Endpoint: POST /biz/bigdata/ecommerce/item/crawler
Parameters
| Parameter | Type | Required | Description |
|---|---|---|---|
| url | String | Yes | Product page URL from a supported e-commerce platform |
Request
bash
curl -X POST "https://api.alaikis.com/std/biz/bigdata/ecommerce/item/crawler" \
-H "X-API-Key: your_api_key" \
-H "X-API-Secret: your_api_secret" \
-d 'bizContent={"url": "https://www.amazon.com/dp/B08N5WRWNW"}'Response
json
{
"code": 200,
"msg": "success",
"data": {
"title": "Product Title",
"price": "29.99",
"currency": "USD",
"images": ["https://example.com/image1.jpg"],
"description": "Product description...",
"specifications": {}
}
}How It Works
- The system parses the URL to extract the hostname
- The hostname is converted to a camelCase method name (e.g.,
www.amazon.com→wwwAmazonCom) - The corresponding crawler method is invoked to extract product data
- Results are returned in a standardized format
Supported Platforms
The crawler supports various e-commerce platforms. Platform detection is based on the URL hostname. Contact support for the current list of supported platforms.
Error Codes
| Code | Description |
|---|---|
| 400 | Invalid JSON format or URL decode error |
| 406 | Missing required parameter (url) |
| 500 | Crawler execution error (unsupported platform or page parsing failure) |