Skip to content

[Bug] Indexer blockSize not propagated from scheduler TokenProcessorConfig #490

@sagearc

Description

@sagearc

TokenProcessorConfig was added back to kvcache.Config (indexer level) at #444, but the scheduler never sets IndexerConfig.TokenProcessorConfig when building the indexer. It only sets the top-level TokenProcessorConfig (used to build the tokenProcessor), leaving indexer.blockSize() to fall back to the default of 16.

This causes a mismatch in GetPodScores: ComputeBlockExtraFeatures uses indexer.blockSize() (16) while tokenProcessor.chunkTokens uses the actual configured block size (e.g. 64), producing different counts for extraFeatures and token chunks.

The fix is either to propagate TokenProcessorConfig from the scheduler into IndexerConfig, or have indexer.blockSize() derive the block size from the tokenProcessor directly.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions