Skip to content

Allow passing SessionState into OptimizeBuilder #3797

@abhi-airspace-intelligence

Description

Description

Use Case

I set a global RuntimeEnv with a memory pool to limit the amount of ram datafusion is allowed to use globally in my application to prevent Kubernetes OOMs since I'm working with multiple tables concurrently. This works wonderfully for WriteBuilder / MergeBuilder / DeleteBuilder which have a with_session_state builder. The one holdout is OptimizeBuilder, which as of #3751 allows passing a SessionConfig, but not a runtime env, which I'd like to globally limit the amount of ram it uses.

Related Issue(s)

Metadata

Metadata

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions