RAGaaS is a Retrieval Augmented Generation as a Service platform that helps you build AI applications with your own data. This guide explains how to use Firecrawl with RAGaaS for web scraping capabilities.

Setup

  1. First, obtain your Firecrawl API key from your Firecrawl dashboard

  2. Configure your RAGaaS namespace to use Firecrawl as the web scraping provider:

Usage

Once configured, you can use RAGaaS’s web scraping endpoints with Firecrawl’s capabilities. Here are the main ingestion methods:

URL List Ingestion

Scrape specific URLs:

Website Crawling

Crawl an entire website with custom rules:

Sitemap Processing

Process all URLs from a sitemap:

Features

When using Firecrawl with RAGaaS, you get access to:

  • JavaScript rendering support
  • Automatic rate limiting
  • CSS selector-based content extraction
  • Recursive crawling with depth control
  • Sitemap processing

Resources

For additional support: