AI Voice Chat Workflow with Webhook, OpenAI, Gemini, and ElevenLabs

Name: AI Voice Chat Workflow with Webhook, OpenAI, Gemini, and ElevenLabs
Rating: 5 (9 reviews)
Author: Free N8N

Community Verified

Beginner

0 nodes connected

detail.loadingPreview

Free N8N Temples

141 views

0 downloads

AI & Machine LearningAIAutomationElevenLabsGoogle GeminiLLMOpenAIVoice ChatWebhook

Automate voice conversations using a webhook. This workflow transcribes speech with OpenAI, processes it with Google Gemini, and synthesizes a response with ElevenLabs, maintaining chat context.

🚀Ready to Deploy This Workflow?

⚡Deploy on Zeabur 🎁Get $200 Credit on DigitalOcean

About This Workflow

Overview

This n8n workflow enables real-time AI voice chat functionality. It leverages a webhook to receive audio input, converts speech to text using OpenAI's Whisper model, and then processes the text through a Google Gemini language model to generate a response. To ensure conversational coherence, memory management nodes (Get Chat, Insert Chat, Window Buffer Memory) are used to maintain chat history. Finally, the AI's text response is converted back into speech using ElevenLabs.io and sent back to the user via the webhook response.

This workflow solves the problem of integrating voice interaction with AI language models within an automation platform, offering a hands-free way to communicate with an AI.

Key Features

Real-time voice input via webhook.
Speech-to-text transcription using OpenAI.
Conversational AI response generation with Google Gemini.
Contextual memory management for natural dialogue.
Text-to-speech synthesis with ElevenLabs.
Seamless integration of multiple AI services.

How To Use

Set up the Webhook node to receive audio data.
Configure the OpenAI - Speech to Text node with your OpenAI API credentials to transcribe the incoming audio.
Connect the Get Chat and Insert Chat nodes with the Window Buffer Memory node to manage conversation context.
Integrate the Google Gemini Chat Model node for AI response generation, ensuring the Basic LLM Chain node includes the conversation history.
Set up the ElevenLabs - Generate Audio node with your ElevenLabs API key and voice ID to convert the AI's text response into speech.
Use the Respond to Webhook node to send the synthesized audio back as a response.

Apps Used

Automation

ElevenLabs

Google Gemini

LLM

OpenAI

Voice Chat

Webhook

Workflow JSON

{
  "id": "d986b75a-4609-44a7-91c5-8b20113bbf42",
  "name": "AI Voice Chat Workflow with Webhook, OpenAI, Gemini, and ElevenLabs",
  "nodes": 0,
  "category": "AI & Machine Learning",
  "status": "active",
  "version": "1.0.0"
}

Note: This is a sample preview. The full workflow JSON contains node configurations, credentials placeholders, and execution logic.