This Shell Script will move folders/files to Google Cloud Storage...
Enterprise-grade GCS file transfer script. Built for speed, resiliency, and automation in production environments.
This Bash-based CLI tool enables fast, reliable, and monitored transfers to Google Cloud Storage using gsutil and gcloud. Designed for sysadmins, data engineers, and DevOps teams needing robust, resumable, and secure uploads with live feedback and alerting.
- π Auto-resume, retry logic, and SHA256 integrity checks
- β‘ Parallel uploads (default: 100 concurrent)
- π€ Filters by file size, extension, or modified date
- π Real-time logs, metrics, and webhook/email alerts
- π Secure service account authentication (JSON or ADC)
- π§° Compatible with any Linux distribution (Bash β₯ 4.2)
- π§ͺ Dry-run support, optional zipping, chunking & batching
- π§ Easily customizable
.envfor automation
# Clone the repo
git clone https://github.com/muzahidulislamhadi/server-to-gcs
.git
cd server-to-gcs
# Make script executable
chmod +x server-to-gcs.sh
# Configure environment variables
cp .env.sample .env
vim .env # Set PROJECT_ID, BUCKET_NAME, SOURCE_PATH, etc.
# Run in automated mode
./gcs_enterprise_transfer.sh --automated