Uncover Hidden Website API Endpoints with AI and Regex
detail.loadingPreview
Automate the discovery of hidden API endpoints on websites by intelligently combining regular expressions and AI. This workflow extracts potential API routes from JavaScript files, filters them for relevance, and prepares them for deeper analysis.
About This Workflow
This n8n workflow is designed to efficiently uncover potentially hidden or undocumented API endpoints within a target website. It begins by fetching the website's HTML and extracting all JavaScript file URLs. These URLs are then filtered to keep only those likely to contain API definitions, using a combination of common patterns like relative paths, CDN references, and specific keywords. The extracted URLs are cleaned and deduplicated before being processed further. Finally, an AI-powered output parser is employed for validation and refinement, ensuring the identified endpoints are accurate and useful for security audits, development, or competitive analysis.
Key Features
- Automated JS File Extraction: Scans websites for all JavaScript file references.
- Intelligent Filtering: Employs regex and customizable rules to identify relevant JS files containing API endpoint candidates.
- AI-Powered Validation: Leverages an AI agent to self-evaluate and iteratively improve endpoint discovery.
- URL Cleaning & Deduplication: Ensures a clean and accurate list of potential API endpoints.
- Customizable Logic: Easily adapt the filtering criteria to suit specific website structures or analysis needs.
How To Use
- Configure the Website URL: In the 'Configuration' node, replace
<URL of the website i.e. https://example.com>with the target website's URL. - Adjust User-Agent (Optional): Modify the 'User-Agent' in the 'Configuration' node if necessary for specific website requirements.
- Run the Workflow: Trigger the 'Start API Discovery' manual node.
- Review Extracted URLs: Examine the output of the 'Keep Relevant JS Files' node to see the filtered JavaScript file URLs.
- Further AI Analysis: The workflow continues to process these URLs, and the 'Auto-fixing Output Parser' node will provide validated API endpoint candidates.
Apps Used
Workflow JSON
{
"id": "3c9661ce-251b-4c42-ab5c-cfa431628b77",
"name": "Uncover Hidden Website API Endpoints with AI and Regex",
"nodes": 17,
"category": "DevOps",
"status": "active",
"version": "1.0.0"
}Note: This is a sample preview. The full workflow JSON contains node configurations, credentials placeholders, and execution logic.
Get This Workflow
ID: 3c9661ce-251b...
About the Author
Free n8n Workflows Official
System Admin
The official repository for verified enterprise-grade workflows.
Statistics
Related Workflows
Discover more workflows you might like
Automated PR Merged QA Notifications
Streamline your QA process with this automated workflow that notifies your team upon successful Pull Request merges. Leverage AI and vector stores to enrich notifications and ensure seamless integration into your development pipeline.
Visualize Your n8n Workflows: Interactive Dashboard with Mermaid.js
Gain unparalleled visibility into your n8n automation landscape. This workflow transforms your n8n instance into a dynamic, interactive dashboard, leveraging Mermaid.js to visualize all your workflows in one accessible place.
Effortless Bug Reporting: Slack Slash Command to Linear Issue
Streamline your bug reporting process by instantly creating Linear issues directly from Slack using a simple slash command. This workflow enhances team collaboration by providing immediate feedback and a structured approach to logging defects, saving valuable time for development and QA teams.