Community Contributed Indeed Data Scraper, Summarizer with Airtable, Bright Data, and Google Gemini
detail.loadingPreview
Scrape company data from Indeed, summarize it using Google Gemini, and store/process it with Airtable and Bright Data.
🚀Ready to Deploy This Workflow?
About This Workflow
Overview
This workflow automates the process of scraping company data from Indeed. It utilizes Bright Data's Web Unlocker to bypass restrictions, processes the scraped content with Google Gemini for summarization and analysis, and integrates with Airtable for data management and storage. Finally, it can send summarized data via webhooks.
Key Features
- Scrapes company data from Indeed using Bright Data's Web Unlocker.
- Leverages Google Gemini (Flash Exp model) for text analysis and summarization.
- Integrates with Airtable to fetch Indeed links and store processed data.
- Formats scraped data into HTML or textual data.
- Sends processed data via HTTP requests to a webhook.
- Includes a manual trigger to start the workflow.
How To Use
- Import Workflow: Import this JSON into your n8n instance.
- Configure Credentials: Set up the following credentials:
- Airtable Personal Access Token account: Connect to your Airtable account.
- Header Auth account: For Bright Data API authentication.
- Google Gemini(PaLM) Api account: Connect to your Google Gemini API.
- Set Environment Variables: Ensure the following environment variables are set:
API_BASE_URL: The base URL for the Bright Data API.WEBHOOK_URL: The URL to send notifications or processed data.
- Configure Airtable: In the Airtable node, specify the correct Base ID (
appHnxLQRVHbCzDyj) and Table ID (tblS1f5XWVMfdyjOz) for your 'Indeed' base and 'Table 1' table. This table should contain the Indeed links to scrape. - Configure Bright Data Zone: In the 'Set Bright Data Zone' node, ensure the
zoneis set correctly for your Bright Data account (defaulting to 'web_unlocker1'). - Test Workflow: Click 'Test workflow' on the manual trigger node to execute the automation.
Apps Used
Workflow JSON
{
"id": "82755e39-b1f4-40c6-b8be-79923c4749ec",
"name": "Community Contributed Indeed Data Scraper, Summarizer with Airtable, Bright Data, and Google Gemini",
"nodes": 0,
"category": "Data Scraping & AI Processing",
"status": "active",
"version": "1.0.0"
}Note: This is a sample preview. The full workflow JSON contains node configurations, credentials placeholders, and execution logic.
Get This Workflow
ID: 82755e39-b1f4...
About the Author
AI_Workflow_Bot
LLM Specialist
Building complex chains with OpenAI, Claude, and LangChain.
Statistics
Verification Info
Related Integrations
- Google Sheets + Schedule Trigger(394 workflows)
- Google Sheets + Split Out(277 workflows)
- Gmail + Schedule Trigger(270 workflows)
- Google Sheets + Slack(268 workflows)
- Gmail + Google Sheets(245 workflows)
- Google Drive + Google Sheets(203 workflows)
- Form Trigger + Google Sheets(163 workflows)
- Google Drive + Google Drive Trigger(135 workflows)
- Google Drive + Split Out(134 workflows)
- Gmail + Split Out(132 workflows)
Related Workflows
Discover more workflows you might like
Automate Instagram Reel Analysis with Gemini and Apify
Unlock deeper insights into your Instagram Reels by automating analysis. This workflow leverages Apify to fetch reel data and Gemini AI to dissect key elements like background, pose, text, and context, enabling better content replication.
Automate Event Attendee Data Extraction with AI-Powered Scraping
This n8n workflow leverages AI and Bright Data's MCP to automate the scraping of event attendee, venue, and feedback data from 10times.com. Schedule the extraction to run daily and automatically save the organized data to Google Sheets.
Telegram Profanity & Toxicity Filter
This n8n workflow automatically monitors incoming Telegram messages for profanity and toxic language. It leverages Google's Perspective API to analyze message content, and if a message is deemed inappropriate, the workflow sends an automated warning response back to the sender.
Automate Competitor Tracking with Crunchbase & ClickUp
Streamline competitor analysis by automatically fetching data from Crunchbase and creating review tasks in ClickUp. Stay informed about market changes without manual effort.
Convert Any Webpage to PDF and Save Locally
This n8n workflow provides a simple way to convert any public webpage URL into a PDF document. Once converted, the PDF file is automatically saved to your local disk, making it easy to archive or share web content offline.
Automate Shipment Tracking with Telegram and n8n
Streamline your logistics operations by automating shipment tracking with Telegram and n8n. This workflow allows drivers to easily share updates, and ensures timely notifications to your team.