Community Contributed: A/B Split Testing
detail.loadingPreview
A/B test different AI agent prompts using Supabase for session management and OpenAI for LLM interaction.
🚀Ready to Deploy This Workflow?
About This Workflow
Overview
This workflow allows you to perform A/B testing on different prompts for your AI agent. It utilizes Supabase to manage and track user sessions, ensuring consistent prompt assignment for each session, and integrates with OpenAI to generate responses based on the assigned prompt. This is particularly useful for optimizing AI behavior by comparing performance metrics between different prompt variations.
Key Features
- Dynamically assigns one of two prompts to a user session.
- Stores session information and prompt assignment in Supabase.
- Uses OpenAI's chat models for AI response generation.
- Integrates with PostgreSQL for chat history management (optional).
- Provides a structured approach to prompt optimization.
How To Use
- Setup Supabase Table: Create a table named
split_test_sessionsin your Supabase project with columnssession_id(text) andshow_alternative(boolean). - Configure Credentials: Add your Supabase API, OpenAI API, and PostgreSQL credentials in n8n.
- Define Prompts: In the
Define Path Valuesnode, set thebaseline_valueandalternative_valuefor your AI prompts. - Activate and Test: Activate the workflow and send messages through n8n's built-in chat. You can experiment with different
session_idvalues to see both prompt variations in action.
Apps Used
Workflow JSON
{
"id": "148f8b68-21dc-4f79-ac1d-6ebac2776aeb",
"name": "Community Contributed: A/B Split Testing",
"nodes": 0,
"category": "Community Contributed (Unverified)",
"status": "active",
"version": "1.0.0"
}Note: This is a sample preview. The full workflow JSON contains node configurations, credentials placeholders, and execution logic.
Get This Workflow
ID: 148f8b68-21dc...
About the Author
SaaS_Connector
Integration Guru
Connecting CRM, Notion, and Slack to automate your life.
Statistics
Verification Info
Related Workflows
Discover more workflows you might like
Community Contributed Rundeck Job Executor (Unverified)
Executes a specified Rundeck job using provided credentials.
Community Crypto Example
A manual workflow demonstrating the Crypto node.
Manual Trigger Workflow - Cleanup Old Executions
Cleans up old n8n workflow executions triggered manually.
CrateDB Insert Example
An example workflow demonstrating how to insert data into CrateDB.
Community Contributed: Form to Google Doc Template
Automatically populates a Google Doc template with data from a form submission.
Proxmox Custom AI Agent (Unverified)
An unverified community template for an AI agent that interacts with Proxmox.