DAOS: zero-copy data-path counters + cold-buffer warmth guard#5107
Merged
Conversation
Add two pieces to DaosWriter, both around the existing MinDeferredSize zero-copy gate (large deferred array Puts already write zero-copy straight from the user buffer; small ones copy-and-aggregate): - Data-path counters: per-rank split of array Puts between the zero-copy (External) and copy paths, emitted as DAOS_ZeroCopy*/DAOS_Copy* timers in profiling.json (count carried in nCalls, the FreshChunkAllocs idiom). Lets us see the actual split on any workload. - Warmth guard: a large buffer that has never recurred is forced to copy instead of zero-copied, since a cold (unregistered) zero-copy loses to a memcpy into the already-registered chunk. Reuse is tracked global-by-address (matching the VA-keyed MR cache) over a small step window whose depth covers multi-buffering. On by default (DAOS_WARMTH_WINDOW=8); env overrides, 0 disables. Strictly >= prior behavior: catches the never-reused large-buffer case, otherwise falls back to today's path; failure mode is a copy. Not yet validated at scale. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
pnorbert
approved these changes
Jul 7, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Two small additions to DaosWriter, both around the existing MinDeferredSize zero-copy test: