Secure Google Drive to S3 Sync with Deduplication
detail.loadingPreview
This workflow automates the secure transfer of files from a specified Google Drive folder to an AWS S3 bucket. It intelligently checks for existing files in S3 and only uploads newly updated or unique files, preventing redundant uploads. Files are encrypted and tagged upon arrival in S3 for enhanced security and traceability.
About This Workflow
This n8n workflow provides a robust solution for syncing specific content from Google Drive to AWS S3. Whenever a file is updated within a designated Google Drive folder, the system springs into action. It first inventories your S3 bucket, then meticulously compares the updated Google Drive files against existing S3 objects. Only files that are either entirely new or represent unique updates (not already present in S3 by name) are passed through. Finally, these filtered files are securely uploaded to your S3 bucket, complete with AES256 server-side encryption and a source:gdrive tag for easy identification and compliance. Ideal for ensuring your critical documents are backed up efficiently without duplicating efforts.
Key Features
- Automated Google Drive Monitoring: Triggers automatically when files are updated in a specific Google Drive folder.
- Intelligent Deduplication: Prevents redundant uploads by comparing updated Google Drive files against existing S3 objects and only processing unique items.
- Secure AWS S3 Uploads: Files are uploaded to S3 with robust AES256 server-side encryption applied automatically.
- Enhanced Traceability: Each uploaded file is tagged with
source: gdrive, allowing for easy tracking and management within your S3 environment. - Configurable Folder Watch: Easily specify which Google Drive folder to monitor for updates.
How To Use
- Configure Google Drive Trigger:
- Connect your Google Drive account credentials.
- Set the "Event" to
fileUpdated. - Choose "Trigger On" as
specificFolderand paste the URL of the Google Drive folder you wish to monitor.
- Configure AWS S3 - get:
- Connect your AWS credentials.
- Ensure "Operation" is set to
getAll. - Specify the
bucketNamefrom which to retrieve existing files for comparison.
- Configure Merge Node:
- The merge node is set to
removeKeyMatches. This will filter out Google Drive files that have names matching existing S3 keys. - Ensure
propertyName1isname.value(from Google Drive output) andpropertyName2isKey.value(from AWS S3 get output).
- The merge node is set to
- Configure AWS S3 - upload:
- Connect your AWS credentials (should be the same as the "get" node).
- Set "Operation" to
upload. - Specify the
bucketNamewhere files will be uploaded. - For
fileName, use an expression like={{$json["name"]}}to use the original Google Drive filename. - In "Additional Fields", set
serverSideEncryptiontoAES256. - Under "Tags", add a tag with
key: sourceandvalue: gdrive. - Important: The
binaryDataparameter should be set appropriately. If uploading non-text files (e.g., images, PDFs), setbinaryDatatotrue. For text-based files where content is passed as a string,falseis correct.
Apps Used
Workflow JSON
{
"id": "ef98aee5-27d4-447c-a7e6-c71d90e7b0e7",
"name": "Secure Google Drive to S3 Sync with Deduplication",
"nodes": 16,
"category": "Operations",
"status": "active",
"version": "1.0.0"
}Note: This is a sample preview. The full workflow JSON contains node configurations, credentials placeholders, and execution logic.
Get This Workflow
ID: ef98aee5-27d4...
About the Author
Free n8n Workflows Official
System Admin
The official repository for verified enterprise-grade workflows.
Statistics
Related Workflows
Discover more workflows you might like
Google Sheets to Icypeas: Automated Bulk Domain Scanning
This workflow streamlines the process of performing bulk domain scans by integrating your Google Sheets data directly with the Icypeas platform. Automate the submission of company names from your spreadsheet to Icypeas for comprehensive domain information, saving valuable time and effort.
Instant WooCommerce Order Notifications via Telegram
When a new order is placed on your WooCommerce store, instantly receive detailed notifications directly to your Telegram chat. Stay on top of your e-commerce operations with real-time alerts, including order specifics and a direct link to view the order.
On-Demand Microsoft SQL Query Execution
This workflow allows you to manually trigger and execute any SQL query against your Microsoft SQL Server database. Perfect for ad-hoc data lookups, administrative tasks, or quick tests, giving you direct control over your database operations.