Skip to content

πŸ“„ The Token-Accounting Bug Report: ~110 tools audited, 45+ verified bugs, 10 merged fixesΒ #18

Description

@roy-tong

The Token-Accounting Bug Report is out

We audited ~110 AI usage/cost tools with synthetic fixtures and filed 65+ evidence-backed findings β€” 10 already merged/accepted by maintainainers. The five classes that keep appearing (per-block re-summation, re-emitted events, cache-pricing semantics, price-table drift, resume/fork loss) are documented with links to every public filing:

πŸ“„ Read the report

Maintain a usage tool? Audit it in 10 minutes with the open fixture corpus (plain JSONL, no runtime install).

If the report or the fixtures saved you a bug, a ⭐ helps others find them β€” and a link to your fixed issue grows the shared casebook.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions