Chat with Local LLMs via Ollama

Name: Chat with Local LLMs via Ollama
Rating: 5 (5 reviews)
Author: Free N8N

Beginner

6 nodes connected

detail.loadingPreview

Free N8N Temples

135 views

0 downloads

AI & Machine Learningchatlangchainllmlocalollama

Integrate and chat with your local Large Language Models using Ollama and n8n.

About This Workflow

This n8n workflow enables seamless interaction with self-hosted Large Language Models (LLMs) through a chat interface. By connecting to Ollama, a powerful tool for managing local LLMs, users can send prompts and receive AI-generated responses directly within n8n.

Key Features

Connects to Ollama for local LLM management.
Receives chat messages and processes them with an LLM.
Returns AI-generated responses to the chat interface.
Provides setup guidance for Ollama and n8n container networking.

How To Use

Ensure Ollama is running: Make sure Ollama is installed and active on your machine.
Configure Ollama connection: Edit the 'Ollama Chat Model' node if your Ollama address differs from the default (http://localhost:11434).
Docker Networking (if applicable): If running n8n in Docker, ensure the n8n container has network access to Ollama by using the --net=host option when starting the Docker container.
Activate the workflow: The 'When chat message received' node will trigger the workflow when a new chat message arrives.
Observe the interaction: The 'Chat LLM Chain' node processes the input with the selected Ollama model, and the response is returned.

Apps Used

chat

langchain

llm

local

ollama

Workflow JSON

{
  "id": "3ebaf84e-bc5d-4370-9b92-81440366b56c",
  "name": "Chat with Local LLMs via Ollama",
  "nodes": 6,
  "category": "AI & Machine Learning",
  "status": "active",
  "version": "1.0.0"
}

Note: This is a sample preview. The full workflow JSON contains node configurations, credentials placeholders, and execution logic.