Skip to content

v0.1.0 - Spark K8s Constructor

Latest
Latest

Choose a tag to compare

View all tags
@fall-out-bug fall-out-bug released this 26 Jan 19:38
· 7 commits to main since this release
v0.1.0
e2286a8
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

🚀 Spark K8s Constructor v0.1.0

First production release! Modular Helm charts for deploying Apache Spark on Kubernetes.

✨ Features

  • Spark 3.5.7 & 4.1.0 - Full support for both versions
  • 11 Preset Configurations - Ready-to-use values files for common scenarios
  • 23 Recipe Guides - Operations, Troubleshooting, Deployment, Integration
  • E2E Test Suite - Minikube-validated end-to-end tests
  • Load Testing - Tested with 11M+ records (NYC taxi dataset)
  • Policy-as-Code - OPA/Conftest security validation

📚 Documentation

🐛 Fixes

  • ✅ ISSUE-031: Auto-create s3-credentials secret
  • ✅ ISSUE-033: RBAC configmaps create permission
  • ✅ ISSUE-034: Jupyter Python dependencies
  • ✅ ISSUE-035: Parquet data loader upload mechanism

⚠️ Known Issues

  • ISSUE-030: Helm "N/A" label validation (workaround available)

🚀 Quick Start

helm install spark charts/spark-4.1 \
  -f charts/spark-4.1/values-scenario-jupyter-connect-k8s.yaml \
  -n spark --create-namespace

Full Changelog: https://github.com/fall-out-bug/spark_k8s/blob/v0.1.0/CHANGELOG.md

Assets 2
Loading