v1.0.0-rc3

What's New

• CRUD capabilities with new UX experiences
  • Create/update/delete ISB Services
  • Create/update/delete pipelines
  • Update vertices
  • Pause/resume pipelines
• AuthN/AuthZ support for the UX
  • Dex integration to support OAuth authentication
  • Role-based access control (RBAC)

Note: The controller and UX server pods will be enforced with a new label app.kubernetes.io/name, if you see complains when applying new manifests, please run kubectl apply with --force.

Pull Requests

v0.11.0...v1.0.0-rc3

Installation

kubectl create namespace numaflow-system

# Install numaflow controller and UI
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.0.0-rc3/install.yaml

# Install validating webhook (Optional)
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.0.0-rc3/validating-webhook-install.yaml

Check more installation options here.

v1.0.0-rc2

What's New

• CRUD capabilities with new UX experiences
  • Create/update/delete ISB Services
  • Create/update/delete pipelines
  • Update vertices
  • Pause/resume pipelines
• AuthN/AuthZ support for the UX
  • Dex integration to support OAuth authentication
  • Role-based access control (RBAC)

Note: The controller and UX server pods will be enforced with a new label app.kubernetes.io/name, if you see complains when applying new manifests, please run kubectl apply with --force.

Pull Requests

v0.11.0...v1.0.0-rc2

Installation

kubectl create namespace numaflow-system

# Install numaflow controller
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.0.0-rc2/install.yaml

# Install validating webhook (Optional)
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.0.0-rc2/validating-webhook-install.yaml

Check more installation options here.

v1.0.0-rc1

What's New

• CRUD capabilities with new UX experiences
  • Create/update/delete ISB Services
  • Create/update/delete pipelines
  • Update vertices
  • Pause/resume pipelines
• AuthN/AuthZ support for the UX
  • Dex integration to support OAuth authentication
  • Role-based access control (RBAC)

Note: The controller and UX server pods will be enforced with a new label app.kubernetes.io/name, if you see complains when applying new manifests, please run kubectl apply with --force.

Pull Requests

v0.11.0...v1.0.0-rc1

Installation

kubectl create namespace numaflow-system

# Install numaflow controller
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.0.0-rc1/install.yaml

# Install validating webhook (Optional)
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.0.0-rc1/validating-webhook-install.yaml

Check more installation options here.

v0.11.0

Major Changes

• User-Defined Source Support
  Support using the latest Numaflow SDKs(numaflow-go 0.5.2, numaflow-java 0.5.4 and numaflow-python 0.5.3) to craft your own User-Defined Source.

• UX Improvements
  Improved the overall look and feel of the user interface, making it more visually appealing and user-friendly.

Other enhancements

• Enhanced Pipeline Validations to cover more edge cases.
• Optimized Back Pressure Measurement to always treat dropOnFull buffer as not having back pressure.
• Single-Pod JetStream Inter-Step Buffer Service to support the case when availability is not as important as saving cost.
• Simplified Java UDSink SDK.

Pull Requests

v0.10.0...v0.11.0

Installation

kubectl create namespace numaflow-system
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v0.11.0/install.yaml

v0.11.0-rc2

Major Changes

• Fixed some new UI bugs
• Do not consider it is back pressured if the edge to the vertex is configured as drop latest on full.

Pull Requests

v0.11.0-rc1...v0.11.0-rc2

Installation

kubectl create namespace numaflow-system
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v0.11.0-rc2/install.yaml

v0.11.0-rc1

Major Changes

• Added user-defined source support.
• Enhanced user experience - Numaflow UI 1.0.
• Enhanced pipeline validation to avoid creating a disjointed pipeline.
• Fixed a bug related to resuming a paused pipeline.

Pull Requests

v0.10.0...v0.11.0-rc1

Installation

kubectl create namespace numaflow-system
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v0.11.0-rc1/install.yaml

v0.10.1

Major Changes

• Fixed a bug related to vertex processing rate calculation.
• Enhanced pipeline spec validation.
• UI improvements to show colored logs and the ability to toggle the order.

Check out our v0.10 release blog.

Pull Requests

v0.10.0...v0.10.1

Installation

kubectl create namespace numaflow-system
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v0.10.1/install.yaml

v0.10.0

Major Changes

• Side Inputs support to be able to broadcast slow updated data or configuration automatically without needing to load it during each message processing; see the detail in the proposal.
• Support join vertex and cycle (for retrying) topologies in the pipeline spec for more complex use cases.
• SDK changes for easier user-defined functions implementation.
• Deprecated cooldownSeconds for auto-scaling; use scaleUpCooldownSeconds and scaleDownCooldownSeconds instead.
• Added Vertex template to pipeline spec for common specs (such as metadata, resources, etc.) of the vertices in the same pipeline.
• UI improvements.

🚨 Breaking Change 🚨

SDKs updated to version 0.5.0 with significant changes to the signature and structure. The servers for each operation have been separated, and all types have been moved to specific packages. For example, the types required for writing map UDFs are now available in the mapper package, and similar changes have been made for other operations. Please update your SDKs accordingly.

⚠️ Note: Version 0.10.0 will only work for SDKs with a version greater than or equal to 0.5.0.

Check out our v0.10 release blog.

Pull Requests

v0.9.0...v0.10.0

Contributors

@KeranYang
@vigith
@yhl25
@juliev0
@chromevoid
@dpadhiar
@veds-g
@whynowy
@kohlisid
@xdevxy

Installation

kubectl create namespace numaflow-system
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v0.10.0/install.yaml

v0.9.3

Major Changes

• Fixed the problem of controller crash due to isbsvc not being ready.

Pull Requests

v0.9.2...v0.9.3

Installation

kubectl create namespace numaflow-system
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v0.9.3/install.yaml

v0.9.2

Major Changes

• Fixed JetStream K/V watch error when there's no entry existing

Pull Requests

v0.9.1...v0.9.2

Installation

kubectl create namespace numaflow-system
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v0.9.2/install.yaml