Automate Social Media Discovery: Your AI Agent for Hacker News & GitHub
detail.loadingPreview
Leverage AI to automatically discover and curate trending GitHub projects from Hacker News. This n8n workflow scrapes Hacker News, extracts relevant GitHub links, visits those pages, converts their content to markdown, and prepares it for automated posting.
About This Workflow
This n8n workflow acts as an intelligent social media agent, designed to sift through the noise and bring you the most relevant GitHub projects shared on Hacker News. It begins by crawling the Hacker News homepage, then employs a Python-based code node to intelligently parse the HTML, identifying posts that link to GitHub. It filters out already processed items, visits each unique GitHub page to gather content, and converts the HTML to a clean markdown format. Finally, it prepares this curated information, ready for distribution via platforms like Telegram, ensuring you never miss out on valuable development insights.
Key Features
- Automated Hacker News Crawling: Continuously monitors Hacker News for new posts.
- Intelligent GitHub Link Extraction: Uses BeautifulSoup to accurately identify and extract GitHub repository links.
- Duplicate Content Filtering: Prevents redundant processing and posting of the same items.
- Content Enrichment: Visits GitHub pages to gather detailed information.
- HTML to Markdown Conversion: Transforms web content into a clean, shareable markdown format.
- Extensible Posting Capabilities: Designed to integrate with platforms like Telegram for seamless sharing.
How To Use
- Crawl HN Home: Configure the
httpRequestnode to accesshttps://news.ycombinator.com/. EnsureexecuteOnceis true. - Extract Meta: Utilize the provided Python code within the
codenode. This node scrapes the HTML, extracts GitHub links, and gathers post metadata (title, URL, score, author, etc.). Ensure package installations forbeautifulsoup4andsimplejsonare handled. - Filter Unposted Items: Use the
codenode with the provided JavaScript to filter out any posts that have already been processed, preventing duplicates. - Visit GH Page: Configure the
httpRequestnode to dynamically visit theurlof each filtered GitHub post. - Convert HTML To Markdown: Use the
markdownnode to convert the HTML content fetched from the GitHub pages into a markdown format. Thehtmlparameter should be set to={{ $json.data }}. - Filter Errored: Add a
filternode to ensure that only successfully processed items proceed. Configure it to only allow items whereerroris empty. - Update X Status (Optional): This node is configured to update an Airtable base. You can modify or replace this with your desired Telegram posting node (e.g.,
telegramnode) to send the curated content. Ensure you map the relevant markdown content and other details. - No Operation, do nothing: This node serves as a placeholder for the end of the workflow, indicating that no further automated action is taken after the content is prepared for posting.
Apps Used
Workflow JSON
{
"id": "14398bb0-d365-4d62-a8de-1df24beca64b",
"name": "Automate Social Media Discovery: Your AI Agent for Hacker News & GitHub",
"nodes": 14,
"category": "DevOps",
"status": "active",
"version": "1.0.0"
}Note: This is a sample preview. The full workflow JSON contains node configurations, credentials placeholders, and execution logic.
Get This Workflow
ID: 14398bb0-d365...
About the Author
SaaS_Connector
Integration Guru
Connecting CRM, Notion, and Slack to automate your life.
Statistics
Related Workflows
Discover more workflows you might like
Automated PR Merged QA Notifications
Streamline your QA process with this automated workflow that notifies your team upon successful Pull Request merges. Leverage AI and vector stores to enrich notifications and ensure seamless integration into your development pipeline.
Automate Qualys Report Generation and Retrieval
Streamline your Qualys security reporting by automating the generation and retrieval of reports. This workflow ensures timely access to crucial security data without manual intervention.
Visualize Your n8n Workflows: Interactive Dashboard with Mermaid.js
Gain unparalleled visibility into your n8n automation landscape. This workflow transforms your n8n instance into a dynamic, interactive dashboard, leveraging Mermaid.js to visualize all your workflows in one accessible place.