Skip to content

muzahidulislamhadi/server-to-gcs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

6 Commits
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

This Shell Script will move folders/files to Google Cloud Storage...

πŸš€ GCS Enterprise Transfer Tool

License: MIT Shell Script Platform Version

Enterprise-grade GCS file transfer script. Built for speed, resiliency, and automation in production environments.

This Bash-based CLI tool enables fast, reliable, and monitored transfers to Google Cloud Storage using gsutil and gcloud. Designed for sysadmins, data engineers, and DevOps teams needing robust, resumable, and secure uploads with live feedback and alerting.


βœ… Features

  • πŸ”„ Auto-resume, retry logic, and SHA256 integrity checks
  • ⚑ Parallel uploads (default: 100 concurrent)
  • πŸ“€ Filters by file size, extension, or modified date
  • πŸ“ˆ Real-time logs, metrics, and webhook/email alerts
  • πŸ”’ Secure service account authentication (JSON or ADC)
  • 🧰 Compatible with any Linux distribution (Bash β‰₯ 4.2)
  • πŸ§ͺ Dry-run support, optional zipping, chunking & batching
  • πŸ”§ Easily customizable .env for automation

πŸš€ Quick Start

# Clone the repo
git clone https://github.com/muzahidulislamhadi/server-to-gcs
.git
cd server-to-gcs

# Make script executable
chmod +x server-to-gcs.sh

# Configure environment variables
cp .env.sample .env
vim .env  # Set PROJECT_ID, BUCKET_NAME, SOURCE_PATH, etc.

# Run in automated mode
./gcs_enterprise_transfer.sh --automated

About

This Shell Script will move folders/files from your server to your Google Cloud Storage bucket...

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages