Skip to content

Report context usage as usage_update - #114

Open
monroe-tuple wants to merge 1 commit into
svkozak:mainfrom
monroe-tuple:feat/report-context-usage
Open

Report context usage as usage_update#114
monroe-tuple wants to merge 1 commit into
svkozak:mainfrom
monroe-tuple:feat/report-context-usage

Conversation

@monroe-tuple

Copy link
Copy Markdown

pi puts token usage on every assistant message but states the context window only in its model list, so the two halves are gathered separately: the window is looked up once per model and cached, and the tokens are read from the final message on done, which also names the model they were spent on.

Cost is omitted -- ACP requires an ISO 4217 currency code and pi states none.

pi puts token usage on every assistant message but states the context window only in its model list, so the two halves are gathered separately: the window is looked up once per model and cached, and the tokens are read from the final message on `done`, which also names the model they were spent on.

Cost is omitted -- ACP requires an ISO 4217 currency code and pi states none.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant