Skip to content

thv llm: support the OAuth device flow for headless and remote SSH boxes #6357

Description

@jerm-dro

As a developer working on a remote or headless box
I want to authenticate to the LLM gateway with the OAuth device flow
So that I can log in without a local browser that can call back to localhost.

Why

thv llm token completes its OIDC login by having the browser redirect to a localhost callback. On a headless Linux box or over SSH there is no browser on the machine, so the flow cannot complete. The only route today is SSH localhost port forwarding, which is not discoverable and not automatable.

Raised twice last week during dogfooding:

  • Headless box thread — "when running on a headless box, it expects that my browser can call back to localhost. But I'm not running a browser there. This whole codepath keeps giving me errors and is super frustrating… We should support the OAuth device flow for situations like this." The reporter ultimately abandoned thv llm and switched to a static API key.
  • thv-dependency thread — the same friction framed as an argument for not requiring thv at all.

Notes

Metadata

Metadata

Assignees

No one assigned

    Labels

    llm gatewayLLM gateway authentication featureoauth

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions