Skip to content

Introduce RejectSet#1347

Closed
blt wants to merge 2 commits intomainfrom
blt/introduce_rejectset
Closed

Introduce RejectSet#1347
blt wants to merge 2 commits intomainfrom
blt/introduce_rejectset

Conversation

@blt
Copy link
Copy Markdown
Collaborator

@blt blt commented May 8, 2025

What does this PR do?

We create and then toss a large number of blocks at startup time.
We do this because we randomly sample the state space with no rejections.
Because of the way blocks are constructed it stands to reason that there
are ranges of invalid samples and this structure is used to avoid those
invalid ranges.

Hyperfine results are now min 1.687, max 1.707 with the stdev reduced to
0.006 from 0.018. The block reject rate is now lower, which will improve
our large entropy generation non-trivially.

Motivation

REF SMPTNG-659

blt added 2 commits May 8, 2025 12:13
We create and then toss a large number of blocks at startup time.
We do this because we randomly sample the state space with no rejections.
Because of the way blocks are constructed it stands to reason that there
are ranges of invalid samples and this structure is used to avoid those
invalid ranges.

Hyperfine results are now min 1.687, max 1.707 with the stdev reduced to
0.006 from 0.018. The block reject rate is now lower, which will improve
our large entropy generation non-trivially.

REF SMPTNG-659

Signed-off-by: Brian L. Troutwine <brian.troutwine@datadoghq.com>
Signed-off-by: Brian L. Troutwine <brian.troutwine@datadoghq.com>
@blt blt changed the base branch from blt/blockgen_binary to graphite-base/1347 May 8, 2025 19:14
@blt blt force-pushed the blt/introduce_rejectset branch from d2fb174 to c86fe53 Compare May 8, 2025 19:14
@blt blt force-pushed the graphite-base/1347 branch from 709b1ce to 8fd2c09 Compare May 8, 2025 19:14
@blt blt changed the base branch from graphite-base/1347 to main May 8, 2025 19:14
@blt blt closed this May 12, 2025
@blt
Copy link
Copy Markdown
Collaborator Author

blt commented May 12, 2025

Turns out, I've misread the situation. Most payloads do not suffer from high rejected block counts which strongly implies that either the otel metrics payload is buggy or is lacking sufficient information.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant