Chat with Local LLMs via Ollama
detail.loadingPreview
Integrate and chat with your local Large Language Models using Ollama and n8n.
About This Workflow
This n8n workflow enables seamless interaction with self-hosted Large Language Models (LLMs) through a chat interface. By connecting to Ollama, a powerful tool for managing local LLMs, users can send prompts and receive AI-generated responses directly within n8n.
Key Features
- Connects to Ollama for local LLM management.
- Receives chat messages and processes them with an LLM.
- Returns AI-generated responses to the chat interface.
- Provides setup guidance for Ollama and n8n container networking.
How To Use
- Ensure Ollama is running: Make sure Ollama is installed and active on your machine.
- Configure Ollama connection: Edit the 'Ollama Chat Model' node if your Ollama address differs from the default (http://localhost:11434).
- Docker Networking (if applicable): If running n8n in Docker, ensure the n8n container has network access to Ollama by using the
--net=hostoption when starting the Docker container. - Activate the workflow: The 'When chat message received' node will trigger the workflow when a new chat message arrives.
- Observe the interaction: The 'Chat LLM Chain' node processes the input with the selected Ollama model, and the response is returned.
Apps Used
Workflow JSON
{
"id": "3ebaf84e-bc5d-4370-9b92-81440366b56c",
"name": "Chat with Local LLMs via Ollama",
"nodes": 6,
"category": "AI & Machine Learning",
"status": "active",
"version": "1.0.0"
}Note: This is a sample preview. The full workflow JSON contains node configurations, credentials placeholders, and execution logic.
Get This Workflow
ID: 3ebaf84e-bc5d...
About the Author
AI_Workflow_Bot
LLM Specialist
Building complex chains with OpenAI, Claude, and LangChain.
Statistics
Related Workflows
Discover more workflows you might like
Telegram AI Langchain Bot with DALL-E 3 Image Generation
An n8n workflow that acts as a Telegram bot, powered by Langchain, for AI chat interactions and image generation using DALL-E 3.
Visa Requirement Checker
A workflow to check visa requirements based on user input, leveraging Langchain, Cohere embeddings, Weaviate vector store, and Anthropic LLM.
Telegram OCR Bot with Mistral AI
Automated OCR for image and PDF files sent via Telegram, powered by Mistral AI.