Introducing /map
The easiest way to go from a single url to a map of the entire website. This is extremely useful for:- When you need to prompt the end-user to choose which links to scrape
- Need to quickly know the links on a website
- Need to scrape pages of a website that are related to a specific topic (use the
search
parameter) - Only need to scrape specific pages of a website
Mapping
/map endpoint
Used to map a URL and get urls of the website. This returns most links present on the website.Installation
Usage
Response
SDKs will return the data object directly. cURL will return the payload exactly as shown below.Title and description are not always present as it depends on the website.
Map with search
Map withsearch
param allows you to search for specific urls inside a website.
cURL
Location and Language
Specify country and preferred languages to get relevant content based on your target location and language preferences, similar to the scrape endpoint.How it works
When you specify the location settings, Firecrawl will use an appropriate proxy if available and emulate the corresponding language and timezone settings. By default, the location is set to ‘US’ if not specified.Usage
To use the location and language settings, include thelocation
object in your request body with the following properties:
country
: ISO 3166-1 alpha-2 country code (e.g., ‘US’, ‘AU’, ‘DE’, ‘JP’). Defaults to ‘US’.languages
: An array of preferred languages and locales for the request in order of priority. Defaults to the language of the specified location.