Official Dify Plugin: marketplace.dify.ai/plugins/langgenius/firecrawlOfficial plugin by Dify team • 44,000+ installs • Chatflow & Agent apps • Free to use
Dify Integration Overview
Dify is an open-source LLM app development platform. The official Firecrawl plugin enables web crawling and scraping directly in your AI workflows.Chatflow & Workflow Apps
Build visual pipelines with Firecrawl nodes for data extraction
Agent Applications
Give AI agents the power to scrape live web data on demand
Firecrawl Tools in Dify
Scrape
Scrape
Convert any URL into clean, structured data. Transform raw HTML into actionable insights.Use Cases: Extract product data, scrape article content, get structured data with JSON mode.
Crawl
Crawl
Perform recursive crawls of websites and subdomains to gather extensive content.Use Cases: Full site content extraction, documentation scraping, multi-page data collection.
Map
Map
Generate a complete map of all URLs present on a website.Use Cases: Site structure analysis, SEO auditing, URL discovery for batch scraping.
Crawl Job
Crawl Job
Retrieve scraping results based on a Job ID or cancel ongoing tasks.Use Cases: Monitor long-running crawls, manage async scraping workflows, cancel operations when needed.
Getting Started
1
Install Firecrawl Plugin
Access the Dify Plugin Marketplace and install the Firecrawl tool
2
Get Firecrawl API Key
Visit Firecrawl API Keys and create a new API key
3
Authorize in Dify
Navigate to Plugins > Firecrawl > To Authorize and input your API key
4
Add to Your Workflow
Drag Firecrawl tools into your Chatflow, Workflow, or Agent application
5
Configure & Test
Set up parameters and test your workflow
Usage Patterns
- Chatflow Apps
- Workflow Apps
- Agent Apps
Visual Pipeline Integration
- Add Firecrawl node to your pipeline
- Select action (Map, Crawl, Scrape)
- Define input variables
- Execute pipeline sequentially
Common Use Cases
AI Chatbot with Live Data
Build RAG-powered chatbots that scrape and reference live website content
Content Analysis Agent
Agents that research topics by scraping and analyzing multiple sources
Competitor Monitoring
Automated workflows that track competitor websites and alert on changes
Data Enrichment Pipeline
Extract and enrich data from websites into structured databases
Firecrawl Actions
| Tool | Description | Best For |
|---|---|---|
| Scrape | Single-page data extraction | Quick content capture |
| Crawl | Multi-page recursive crawling | Full site extraction |
| Map | URL discovery and site mapping | SEO analysis, URL lists |
| Crawl Job | Async job management | Long-running operations |
Best Practices
Agent Apps
- Let agents decide when to scrape
- Use natural language instructions
- Enable tool calling in LLM settings
- Monitor token usage with large scrapes
Workflow Apps
- Use Map before Crawl for large sites
- Set appropriate crawl limits
- Add error handling nodes
- Test with small datasets first
Dify vs Other Platforms
| Feature | Dify | Make | Zapier | n8n |
|---|---|---|---|---|
| Type | LLM app platform | Workflow automation | Workflow automation | Workflow automation |
| Best For | AI agents & chatbots | Visual workflows | Quick automation | Developer control |
| Pricing | Open-source + Cloud | Operations-based | Per-task | Flat monthly |
| AI-Native | Yes | Partial | Partial | Partial |
| Self-Hosted | Yes | No | No | Yes |
Pro Tip: Dify excels at building AI-native applications where agents need dynamic web access. Perfect for chatbots, research assistants, and AI tools that need live data.