Sync Google Drive Files with OpenAI Vector Store

Name: Sync Google Drive Files with OpenAI Vector Store
Rating: 5 (5 reviews)
Author: Free N8N

Beginner

7 nodes connected

detail.loadingPreview

Free N8N Temples

170 views

0 downloads

Data Managementaiautomationgoogle driveopenaisyncvector store

Automatically syncs files from Google Drive to an OpenAI vector store, ensuring up-to-date embeddings for AI applications.

About This Workflow

This workflow automates the process of synchronizing files stored in Google Drive with an OpenAI vector store. It identifies new, updated, or deleted files in Google Drive and reflects these changes in the vector store, maintaining accurate and relevant data for AI models.

The workflow starts by fetching files from Google Drive and listing existing files in the OpenAI vector store. It then compares these two sets of files to determine which actions need to be taken: creating new entries, updating existing ones, or deleting obsolete ones from the vector store. Finally, it executes the necessary operations to keep the vector store synchronized.

Key Features

Google Drive Integration: Connects to your Google Drive to list and download files.
OpenAI Vector Store Integration: Interacts with OpenAI's vector store to manage embeddings.
Delta Detection: Efficiently identifies new, updated, and deleted files.
Automated Synchronization: Keeps your vector store aligned with your Google Drive content.
Configurable Triggers: Can be triggered manually or on a schedule.

How To Use

Triggers: Configure either the Schedule trigger for periodic synchronization or the "Test workflow" clicked trigger for manual runs.
Set variables (Set variables): This node is likely used to define initial parameters or credentials. Ensure it's configured correctly for both Google Drive and OpenAI API access.
List Google Drive Files (List files from folder): Specify the Google Drive folder containing the files you want to sync.
List Vector Store Files (List vector store files [OpenAI]): This node interacts with the OpenAI API to retrieve information about existing files in your vector store.
Compare and Prepare Actions (Compare Google Drive files with vector store files and subsequent Set nodes): This section determines the differences. The Set Google Drive file to create in vector store, Set Google Drive file to ignore, Set Google Drive file to update in vector store, and Set Google Drive file to delete from vector store nodes prepare data for the next steps based on the comparison.
**Process Changes (Filter out files to ignore -> Loop over files -> Does file need to be created in vector store? -> Download new or updated file -> Upload new or updated file -> Add uploaded file to vector store [OpenAI] -> Has file been created or updated? -> Delete outdated file or previous version):
- Files marked for creation are downloaded and uploaded to the vector store.
- Files marked for update or deletion are processed by the Does file need to be updated or deleted from vector store? node, which leads to downloading the file (for updates) or initiating a deletion process.
Finalization (End loop, End workflow): The workflow concludes after all files have been processed.

Apps Used

automation

google drive

openai

sync

vector store

Workflow JSON

{
  "id": "24e0e87a-6234-4e17-a0c4-04dcfd38f698",
  "name": "Sync Google Drive Files with OpenAI Vector Store",
  "nodes": 7,
  "category": "Data Management",
  "status": "active",
  "version": "1.0.0"
}

Note: This is a sample preview. The full workflow JSON contains node configurations, credentials placeholders, and execution logic.