Skip to content

Make prefix block size configurable via env var#120

Merged
vMaroon merged 2 commits intomainfrom
block-size
May 19, 2025
Merged

Make prefix block size configurable via env var#120
vMaroon merged 2 commits intomainfrom
block-size

Conversation

@oglok
Copy link
Contributor

@oglok oglok commented May 19, 2025

It solves #111

@oglok oglok requested a review from elevran May 19, 2025 14:33
Copy link
Collaborator

@elevran elevran left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please confirm that the addition of new block size environment variable does not affect deployer configuration

@Gregory-Pereira
Copy link
Member

awesome feature, excited for this!

oglok added 2 commits May 19, 2025 18:39
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com>
Signed-off-by: Ricardo Noriega De Soto <rnoriega@redhat.com>
@vMaroon vMaroon merged commit 51fb8c1 into main May 19, 2025
1 check passed
@vMaroon vMaroon deleted the block-size branch May 19, 2025 22:57
Jooho referenced this pull request in Jooho/llm-d-inference-scheduler Sep 17, 2025
Signed-off-by: konflux-internal-p02 <170854209+konflux-internal-p02[bot]@users.noreply.github.com>
Co-authored-by: konflux-internal-p02[bot] <170854209+konflux-internal-p02[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants