Vision-Based AI Agent Scraper with Google Sheets, ScrapingBee, and Gemini
detail.loadingPreview
Scrape websites using a vision-based AI agent, capturing screenshots with ScrapingBee and extracting data into Google Sheets via Gemini.
🚀Ready to Deploy This Workflow?
About This Workflow
Overview
This workflow automates the process of scraping information from websites using a vision-based AI agent. It leverages ScrapingBee to capture screenshots of web pages, then utilizes Google Gemini to extract structured data from these screenshots. Finally, the extracted data is organized and stored in a Google Sheet.
Key Features
- Reads URLs from a Google Sheet.
- Captures full-page screenshots using ScrapingBee.
- Employs a vision-based AI agent (Google Gemini) to extract data from screenshots.
- Allows for customization of AI prompts for data extraction.
- Includes fallback to HTML parsing if screenshot extraction fails.
- Writes extracted data back to a Google Sheet.
How To Use
- Set up Google Sheets: Create a Google Sheet with a sheet named 'List of URLs' containing the URLs to scrape in one column. Ensure you have an example 'Results' sheet configured for e-commerce data.
- Configure Credentials: Set up and connect your Google Sheets and Google Gemini (PaLM) API credentials in n8n.
- ScrapingBee API Key: Replace
<your_scrapingbee_apikey>with your actual ScrapingBee API key in theScrapingBee - Get page HTMLandScrapingBee - Get page screenshotnodes. - Manual Trigger: Manually trigger the workflow by clicking the 'Test workflow' button.
- Monitor Results: The scraped and AI-extracted data will appear in the 'Results' sheet of your configured Google Sheet.
Apps Used
Workflow JSON
{
"id": "35f4b706-a51b-48a9-bc61-60d3c53a1255",
"name": "Vision-Based AI Agent Scraper with Google Sheets, ScrapingBee, and Gemini",
"nodes": 0,
"category": "Splitout",
"status": "active",
"version": "1.0.0"
}Note: This is a sample preview. The full workflow JSON contains node configurations, credentials placeholders, and execution logic.
Get This Workflow
ID: 35f4b706-a51b...
About the Author
Crypto_Watcher
Web3 Developer
Automated trading bots and blockchain monitoring workflows.
Statistics
Verification Info
Related Integrations
- Google Sheets + Schedule Trigger(394 workflows)
- Google Sheets + Split Out(277 workflows)
- Google Sheets + Slack(268 workflows)
- Gmail + Google Sheets(245 workflows)
- Google Drive + Google Sheets(203 workflows)
- Form Trigger + Google Sheets(163 workflows)
- Google Drive + Google Drive Trigger(135 workflows)
- Google Drive + Split Out(134 workflows)
- Google Sheets + Telegram(118 workflows)
- Execute Workflow Trigger + Google Sheets(101 workflows)
Related Workflows
Discover more workflows you might like
Restore n8n Credentials from GitHub
Automatically restore your n8n credentials from a GitHub repository.
Get Scaleway Server Information
Retrieves and filters information about Scaleway servers.
Daily AI News Digest for Executives
Automated daily digest of top AI news selected by GPT-4o for senior executives.
Gong Call Summary and Insights
Extracts key information, transcript, and insights from Gong calls for analysis and reporting.
Telegram Profanity & Toxicity Filter
This n8n workflow automatically monitors incoming Telegram messages for profanity and toxic language. It leverages Google's Perspective API to analyze message content, and if a message is deemed inappropriate, the workflow sends an automated warning response back to the sender.
Instant WooCommerce Order Notifications via Telegram
When a new order is placed on your WooCommerce store, instantly receive detailed notifications directly to your Telegram chat. Stay on top of your e-commerce operations with real-time alerts, including order specifics and a direct link to view the order.