Skip to content

[Issue]: Need to improve the inference documentation to articulate information around adaptive allocations. #1393

Open
@georgewallace

Description

@georgewallace

Type of issue

None

What documentation page is affected

Inference documentation

What happened?

The cost implication of creating a custom inference endpoint without allowing adaptive allocations to scale down to 0 is not clearly explained in our documentation/UI.

Additional info

Additional email will be provided directly.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Team:SearchIssues owned by the Search Docs Team

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions