
Welcome to Firecrawl
Firecrawl is an API service that takes a URL, crawls it, and converts it into clean markdown. We crawl all accessible subpages and give you clean markdown for each. No sitemap required.How to use it?
We provide an easy to use API with our hosted version. You can find the playground and documentation here. You can also self host the backend if you’d like. Check out the following resources to get started:- API: Documentation
- SDKs: Python, Node, Go, Rust
- LLM Frameworks: Langchain (python), Langchain (js), Llama Index, Crew.ai, Composio, PraisonAI, Superinterface, Vectorize
- Low-code Frameworks: Dify, Langflow, Flowise AI, Cargo, Pipedream
- Others: Zapier, Pabbly Connect
- Want an SDK or Integration? Let us know by opening an issue.
API Key
To use the API, you need to sign up on Firecrawl and get an API key.Crawling
Used to crawl a URL and all accessible subpages. This submits a crawl job and returns a job ID to check the status of the crawl.Installation
Usage
wait_until_done
to false
.
This will return a jobId.
For cURL, /crawl will always return a jobId where you can use to check the status of the crawl.
Check Crawl Job
Used to check the status of a crawl job and get its result.Response
Scraping
To scrape a single URL, use thescrape_url
method. It takes the URL as a parameter and returns the scraped data as a dictionary.