XCrawl Featured
Web scraping, crawling, search and map API that turns any website into clean, LLM-ready data.
Description
XCrawl is a web data API for AI agents and developers. It offers scrape, crawl, map and search endpoints that return clean Markdown, HTML or structured JSON, with JavaScript rendering, proxies and anti-bot handling built in. Use cases: RAG pipelines, AI agents, price monitoring, SEO and market research.
Category: AI
Pricing: Hybrid
Free Tier Available: Yes
API Specifications
Authentication:
API Key
HTTPS:
Yes
Type:
REST
Data Format:
JSON
Version:
v1
Rate Limits:
Free tier credits; limits scale by plan
Access Type:
Public