Skip to content

Add a intelligent smart home chat bot to the UI #2995

Open
@florian-h05

Description

@florian-h05

I am thinking of having a smart home chatbot for openHAB 5, a bit like HABot but more intelligent, integrated into Main UI and not only limited to smart home related stuff.

This would require the following bits:

  • A powerful, LLM-based human language interpreter available: Something like [ChatGPT] Enhance binding openhab-addons#17320.
  • New core APIs that not only allow answering with text to a prompt (like current HLI interface), but provide a payload for the UI that can e.g. make it render a card widget to show an Item state. / Extend the dialog process to support text as well and take care of chat history.
  • Probably: Shared core logic to be used by LLM based HLIs for Item control, so we don't have to duplicate code for OpenAI API, Google Vertex API etc.
  • The chatbot UI. Framework7 provides something we can use for that: https://framework7.io/docs/messages

Unfortunately anything LLM-based is unlikely to work locally on embedded hardware like Pis or NAS, however is OpenAI's GPT 4o Mini relatively cheap and I don't have large privacy concerns as it is only used to interpret a text prompt - it does not have direct access to openHAB.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions