Skip to content

Usage and Meta classes are required in responses but specific to OpenAI-like APIs #691

@aimeos

Description

@aimeos

Prism is currently tailored to OpenAI and compatible APIs, esp. the Usage and Meta classes that are required in responses. Other LLM APIs doesn't provide this information or different ones, e.g. the number of used and still available credits.

Therefore, usage and meta information should be treated as optional and provider specific. The only numbers that are available across many providers are "used" and "available" but the values have different meanings across providers.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions