Feature Description
Prometheus is a FOSS monitoring and alerting tool widely used by the self-hosting community, commonly paired with Grafana for visualization. We want to add a Prometheus integration to Lemonade to aggregate hardware and Lemonade-specific statistics (ie. CPU, RAM, token/s).
As an additional feature, we can also look into building a customizable, default Grafana dashboard and integrate it into the current Lemonade dashboard.
We will write documentation/blog post on how to use these features.
sbates130272 has already done some work on this in #996
Use Case / Motivation
Running models locally is resource intensive, so good metrics aggregation and alerting mechanisms are must-haves. A Lemonade Prometheus integration would allow users to integrate Lemonade statistics to their existing observability stack seamlessly, greatly benefiting the self-hosting community.
The default Grafana dashboard can also enhance the dashboard user experience, especially for users who don't have their own Grafana instance running.
Platform Relevance
All platforms
Additional Context
No response
Feature Description
Prometheus is a FOSS monitoring and alerting tool widely used by the self-hosting community, commonly paired with Grafana for visualization. We want to add a Prometheus integration to Lemonade to aggregate hardware and Lemonade-specific statistics (ie. CPU, RAM, token/s).
As an additional feature, we can also look into building a customizable, default Grafana dashboard and integrate it into the current Lemonade dashboard.
We will write documentation/blog post on how to use these features.
sbates130272 has already done some work on this in #996
Use Case / Motivation
Running models locally is resource intensive, so good metrics aggregation and alerting mechanisms are must-haves. A Lemonade Prometheus integration would allow users to integrate Lemonade statistics to their existing observability stack seamlessly, greatly benefiting the self-hosting community.
The default Grafana dashboard can also enhance the dashboard user experience, especially for users who don't have their own Grafana instance running.
Platform Relevance
All platforms
Additional Context
No response