Firecrawl Go SDK is a wrapper around the Firecrawl API to help you easily turn websites into markdown.
API key
as a parameter to the FirecrawlApp
struct.API URL
and/or pass it as a parameter to the FirecrawlApp
struct. Defaults to https://api.firecrawl.dev
.version
and/or pass it as a parameter to the FirecrawlApp
struct. Defaults to v1
.ScrapeURL
method. It takes the URL as a parameter and returns the scraped data as a dictionary.
CrawlUrl
method. It takes the starting URL and optional parameters as arguments. The params
argument allows you to specify additional options for the crawl job, such as the maximum number of pages to crawl, allowed domains, and the output format.
CheckCrawlStatus
method. It takes the job ID as a parameter and returns the current status of the crawl job.
MapUrl
to generate a list of URLs from a website. The params
argument let you customize the mapping process, including options to exclude subdomains or to utilize the sitemap.