Community Contributed Indeed Data Scraper, Summarizer with Airtable, Bright Data, and Google Gemini
detail.loadingPreview
Scrape company data from Indeed, summarize it using Google Gemini, and store/process it with Airtable and Bright Data.
🚀Ready to Deploy This Workflow?
About This Workflow
Overview
This workflow automates the process of scraping company data from Indeed. It utilizes Bright Data's Web Unlocker to bypass restrictions, processes the scraped content with Google Gemini for summarization and analysis, and integrates with Airtable for data management and storage. Finally, it can send summarized data via webhooks.
Key Features
- Scrapes company data from Indeed using Bright Data's Web Unlocker.
- Leverages Google Gemini (Flash Exp model) for text analysis and summarization.
- Integrates with Airtable to fetch Indeed links and store processed data.
- Formats scraped data into HTML or textual data.
- Sends processed data via HTTP requests to a webhook.
- Includes a manual trigger to start the workflow.
How To Use
- Import Workflow: Import this JSON into your n8n instance.
- Configure Credentials: Set up the following credentials:
- Airtable Personal Access Token account: Connect to your Airtable account.
- Header Auth account: For Bright Data API authentication.
- Google Gemini(PaLM) Api account: Connect to your Google Gemini API.
- Set Environment Variables: Ensure the following environment variables are set:
API_BASE_URL: The base URL for the Bright Data API.WEBHOOK_URL: The URL to send notifications or processed data.
- Configure Airtable: In the Airtable node, specify the correct Base ID (
appHnxLQRVHbCzDyj) and Table ID (tblS1f5XWVMfdyjOz) for your 'Indeed' base and 'Table 1' table. This table should contain the Indeed links to scrape. - Configure Bright Data Zone: In the 'Set Bright Data Zone' node, ensure the
zoneis set correctly for your Bright Data account (defaulting to 'web_unlocker1'). - Test Workflow: Click 'Test workflow' on the manual trigger node to execute the automation.
Apps Used
Workflow JSON
{
"id": "82755e39-b1f4-40c6-b8be-79923c4749ec",
"name": "Community Contributed Indeed Data Scraper, Summarizer with Airtable, Bright Data, and Google Gemini",
"nodes": 0,
"category": "Data Scraping & AI Processing",
"status": "active",
"version": "1.0.0"
}Note: This is a sample preview. The full workflow JSON contains node configurations, credentials placeholders, and execution logic.
Get This Workflow
ID: 82755e39-b1f4...
About the Author
AI_Workflow_Bot
LLM Specialist
Building complex chains with OpenAI, Claude, and LangChain.
Statistics
Verification Info
Related Workflows
Discover more workflows you might like
Telegram Profanity & Toxicity Filter
This n8n workflow automatically monitors incoming Telegram messages for profanity and toxic language. It leverages Google's Perspective API to analyze message content, and if a message is deemed inappropriate, the workflow sends an automated warning response back to the sender.
Automated Multi-Platform Influencer Discovery & Qualification
This powerful n8n workflow automates the entire process of discovering, scoring, and qualifying ideal influencers across Instagram, TikTok, and YouTube for your marketing campaigns. Streamline your talent acquisition by leveraging custom criteria and a sophisticated scoring algorithm.
Convert Any Webpage to PDF and Save Locally
This n8n workflow provides a simple way to convert any public webpage URL into a PDF document. Once converted, the PDF file is automatically saved to your local disk, making it easy to archive or share web content offline.
Robust Concurrency Control for n8n Workflows with Redis
Prevent simultaneous execution of critical n8n workflows or tasks using a centralized, Redis-backed locking mechanism. This reusable utility workflow ensures data integrity and resource management by allowing other workflows to acquire, check, and release locks.
Weekly Cocktail Inspiration for Your Team
Automatically share engaging cocktail recipes with your team or community every week. This workflow fetches a random recipe, generates a beautiful visual card using Bannerbear, and posts it directly to your Rocket.Chat channel, fostering fun and connection.
Automated Multi-Platform Social Media Publisher
Streamline your social media content creation and publishing with this n8n workflow. Simply fill out a web form with your caption, media (image or video), and target platforms, and let n8n automate the posting process across multiple social networks.