Automated Competitor Price Scraping with RAG Agent
detail.loadingPreview
Scrape competitor prices automatically using a webhook trigger, process the data with a Langchain RAG Agent, and log results to Google Sheets. This workflow leverages a webhook, text splitter, embeddings, and a RAG Agent for efficient data analysis and storage.
🚀Ready to Deploy This Workflow?
About This Workflow
Overview
This n8n workflow is designed to automate the process of scraping competitor prices. It utilizes a Webhook Trigger to initiate the process, followed by Text Splitter and Embeddings nodes to prepare the data for analysis. The core of the workflow is the RAG Agent which processes the scraped data. The results are then stored in a Google Sheet using the Append Sheet node, with Slack Alert providing notifications for any errors encountered.
Key Features
- Webhook Trigger: Initiate scraping and processing via an external webhook.
- Langchain Integration: Leverages
Text Splitter,Embeddings,Vector Store (Supabase),Chat Model, andRAG Agentfor intelligent data processing. - Data Storage: Automatically logs results to a Google Sheet for easy access and analysis.
- Error Alerting: Notifies via Slack in case of any workflow failures.
How To Use
- Configure Webhook Trigger: Set up the
Webhook Triggerwith your desired path. - Set Up Langchain Nodes: Configure
Text Splitter,Embeddings(using OpenAI), andSupabase(for vector store) according to your data and setup. - Configure RAG Agent: Define the prompt and system message for your
RAG Agentto process the competitor data. - Connect to Google Sheets: Set up the
Append Sheetnode with your Google Sheet credentials and specify the target sheet. - Configure Slack Alert: Provide your Slack API credentials for error notifications.
- Activate the Workflow: Trigger the webhook to start the automated price scraping and analysis.
Apps Used
Workflow JSON
{
"id": "93247b72-3da7-4ae5-97d2-0465bfa2bb08",
"name": "Automated Competitor Price Scraping with RAG Agent",
"nodes": 0,
"category": "Data Analytics",
"status": "active",
"version": "1.0.0"
}Note: This is a sample preview. The full workflow JSON contains node configurations, credentials placeholders, and execution logic.
Get This Workflow
ID: 93247b72-3da7...
About the Author
Free n8n Workflows Official
System Admin
The official repository for verified enterprise-grade workflows.
Statistics
Verification Info
Related Workflows
Discover more workflows you might like
Universal CSV to JSON API Converter
Effortlessly transform CSV data into structured JSON with this versatile n8n workflow. Integrate it into any application as a custom API endpoint, supporting various input methods including file uploads and raw text.
Automate Local Business Outreach with AI-Powered Yelp Scraper
This workflow automates the process of scraping local business details from Yelp using AI, then leverages that data to send personalized partnership proposals via Gmail. It's perfect for sales and marketing teams looking to streamline lead generation and outreach campaigns.
Automate Getty Images Editorial Search & CMS Integration
This n8n workflow automates searching for editorial images on Getty Images, extracts key details and embed codes, and prepares them for seamless integration into your Content Management System (CMS), streamlining your content creation process.