Scrape Web Pages to Markdown with FireCrawl & n8n
detail.loadingPreview
Automate web page scraping into Markdown format using FireCrawl and n8n. Perfect for content extraction and AI data prep.
🚀Ready to Deploy This Workflow?
🚀 Run Without Servers
Too complicated to set up? Run this workflow instantly on AIWord.
Run on AIWord Cloud ☁️About This Workflow
How it works
This n8n workflow automates the process of scraping content from any given URL and converting it into Markdown format. It starts with an Execute Workflow Trigger which expects a JSON payload containing the url to be scraped.
This URL is then passed to the FireCrawl node, which makes an API request to FireCrawl's scraping endpoint. The request is configured to return the scraped content in markdown format.
Finally, the Edit Fields node extracts the markdown content from the FireCrawl response and makes it available as a new field named response for further processing or output.
Key Features
- Automate web content scraping.
- Convert web pages directly to Markdown.
- Flexible input via workflow trigger.
- Seamless integration with FireCrawl API.
- Extract specific data fields from scraped content.
How To Use
- Set up the
Execute Workflow Triggernode. Ensure it's configured to receive JSON input with aurlparameter (e.g.,{"url": "https://example.com"}). - Configure the
FireCrawlnode:- Set the
URLtohttps://api.firecrawl.dev/v1/scrape. - Set the
MethodtoPOST. - In
JSON Body, set theurlfield to{{ $json.query.url }}andformatsto["markdown"]. - Ensure
Send BodyandSend Headersare enabled. - Specify
JSONas theSpecify Bodyoption. - Configure
HTTP Header Authcredentials for FireCrawl API key.
- Set the
- Configure the
Edit Fieldsnode to extract themarkdownfield from the FireCrawl response. Assign it to a new field namedresponseusing the expression={{ $json.data.markdown }}. - Connect the nodes as shown in the workflow diagram.
Apps Used
Workflow JSON
{
"id": "d4329ef3-1726-43a9-bdda-26f2363d9145",
"name": "Scrape Web Pages to Markdown with FireCrawl & n8n",
"nodes": 0,
"category": "DevOps",
"status": "active",
"version": "1.0.0"
}Note: This is a sample preview. The full workflow JSON contains node configurations, credentials placeholders, and execution logic.
🚀 Run Without Servers
Use our managed AI Automation Cloud. No DevOps, no errors. Start for free.
- Anti-detect Browser
- Managed Proxies
- 24/7 Uptime
Get This Workflow
ID: d4329ef3-1726...
About the Author
SaaS_Connector
Integration Guru
Connecting CRM, Notion, and Slack to automate your life.
Statistics
Related Integrations
- n8n + Schedule Trigger(72 workflows)
- n8n + Split Out(33 workflows)
- Google Drive + n8n(25 workflows)
- Facebook Graph API + Google Sheets(22 workflows)
- Facebook Graph API + Schedule Trigger(21 workflows)
- Convert To File + n8n(20 workflows)
- Execute Workflow Trigger + n8n(20 workflows)
- Facebook Graph API + Twitter(18 workflows)
- GitHub + n8n(18 workflows)
- Facebook Graph API + Linked In(16 workflows)
Related Workflows
Discover more workflows you might like
Automated n8n Workflow GitHub Backup & Sync
Automatically back up and synchronize your n8n workflows to a GitHub repository, ensuring version control, easy collaboration, and reliable recovery. This subworkflow intelligently compares existing files with new versions and updates or creates them on GitHub as needed.
Automate Claude API Calls with Batch Processing
Streamline your AI interactions with Claude by leveraging n8n for efficient batch prompt submission. This workflow automates sending multiple prompts simultaneously and retrieving their results, saving you time and resources.
Instant n8n Workflow Error Alerts via WhatsApp
Get instant WhatsApp notifications whenever one of your n8n workflows encounters an error. This dedicated error workflow ensures you're immediately aware of issues, providing crucial details directly to your phone to facilitate rapid response and minimize downtime.
Master the Art of APIs with Our Interactive Tutorial Workflow
Demystify APIs with this hands-on n8n workflow tutorial. Learn how to make requests, understand different HTTP methods, and customize your interactions using a fun restaurant analogy. Perfect for beginners looking to grasp core API concepts.
Automate Mattermost Notifications with n8n
Seamlessly integrate n8n with Mattermost to send automated notifications. This workflow triggers a message to your Mattermost channel upon n8n instance startup, keeping your team informed.
Robust Concurrency Control for n8n Workflows with Redis
Prevent simultaneous execution of critical n8n workflows or tasks using a centralized, Redis-backed locking mechanism. This reusable utility workflow ensures data integrity and resource management by allowing other workflows to acquire, check, and release locks.