perf(metrics): batch tokenization with defer-to-flush drain#350

Open

viraatc wants to merge 18 commits into

mainfrom

perf/tok-batch-clean

Commits on Jun 10, 2026

perf(metrics): batch tokenization with defer-to-flush drain

viraatc
and
claude
committed
fix(metrics): never skip finalize on tokenizer drain failure; cleanup

viraatc
and
claude
committed
fix(metrics): tokenizer stage uses the whole machine; restore --tokenizer-workers

viraatc
and
claude
committed
chore(metrics): use pass bodies in TokenCounter protocol stubs

viraatc
and
claude
committed
docs(metrics): add metrics-aggregator design doc; refresh services overview

viraatc
and
claude
committed
fix(metrics): publish live snapshots through tokenizer failures; bound shard warmup

viraatc
and
claude
committed
feat(metrics): no silent tokenizer fallbacks — shard or exit cleanly

viraatc
and
claude
committed
fix(metrics): shard unpinned on platforms without CPU affinity (macOS)

viraatc
and
claude
committed
refactor(metrics): queue-owned live flush lane; drop the pre_publish hook

viraatc
and
claude
committed
fix(metrics): bound live flushes; align defaults; audit-driven hardening

viraatc
and
claude
committed
fix(metrics): call-shaped awaits for cancelled tasks; pin aggregator-args seam

viraatc
and
claude
committed
fix(metrics): requeue messages on live-cancel; shrink the tokenizer API

viraatc
and
claude
committed

Commits on Jun 11, 2026