Skip to content

feat: Add basic MemoryManager to track buffered dataframes for out-of-core support later#26443

Draft
azimafroozeh wants to merge 15 commits intopola-rs:mainfrom
azimafroozeh:feat/ooc/memory_manager
Draft

feat: Add basic MemoryManager to track buffered dataframes for out-of-core support later#26443
azimafroozeh wants to merge 15 commits intopola-rs:mainfrom
azimafroozeh:feat/ooc/memory_manager

Conversation

@azimafroozeh
Copy link
Collaborator

No description provided.

@codecov
Copy link

codecov bot commented Feb 5, 2026

Codecov Report

❌ Patch coverage is 73.60775% with 109 lines in your changes missing coverage. Please review.
✅ Project coverage is 81.39%. Comparing base (2892ced) to head (8b4434b).
⚠️ Report is 14 commits behind head on main.

Files with missing lines Patch % Lines
crates/polars-ooc/src/memory_manager.rs 75.13% 45 Missing ⚠️
crates/polars-config/src/spill_policy.rs 18.18% 18 Missing ⚠️
crates/polars-config/src/parse.rs 0.00% 14 Missing ⚠️
crates/polars-config/src/spill_format.rs 23.52% 13 Missing ⚠️
crates/polars-ooc/src/spiller.rs 27.27% 8 Missing ⚠️
crates/polars-ooc/src/token.rs 83.33% 3 Missing ⚠️
crates/polars-error/src/lib.rs 0.00% 2 Missing ⚠️
crates/polars-stream/src/nodes/joins/mod.rs 81.81% 2 Missing ⚠️
crates/polars-stream/src/nodes/multiplexer.rs 66.66% 2 Missing ⚠️
crates/polars-python/src/error.rs 0.00% 1 Missing ⚠️
... and 1 more
Additional details and impacted files
@@           Coverage Diff            @@
##             main   #26443    +/-   ##
========================================
  Coverage   81.38%   81.39%            
========================================
  Files        1792     1800     +8     
  Lines      244414   245318   +904     
  Branches     3078     3079     +1     
========================================
+ Hits       198913   199669   +756     
- Misses      44715    44863   +148     
  Partials      786      786            

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@azimafroozeh azimafroozeh force-pushed the feat/ooc/memory_manager branch 3 times, most recently from ee0a4c9 to 74c1bd5 Compare February 12, 2026 11:51
@azimafroozeh azimafroozeh force-pushed the feat/ooc/memory_manager branch from 70e4188 to 53a9d1f Compare February 16, 2026 21:40
@azimafroozeh azimafroozeh changed the title WIP: Add basic MemoryManager to track buffered morsels for out-of-core support later WIP: Add basic MemoryManager to track buffered dataframes for out-of-core support later Feb 16, 2026
@azimafroozeh azimafroozeh changed the title WIP: Add basic MemoryManager to track buffered dataframes for out-of-core support later feat: Add basic MemoryManager to track buffered dataframes for out-of-core support later Feb 17, 2026
@github-actions github-actions bot added enhancement New feature or an improvement of an existing feature python Related to Python Polars rust Related to Rust Polars and removed title needs formatting labels Feb 17, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or an improvement of an existing feature python Related to Python Polars rust Related to Rust Polars

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments