add manifests and documentation for observability#57
add manifests and documentation for observability#57cooktheryan merged 5 commits intoogx-ai:mainfrom
Conversation
sallyom
force-pushed
the
observability-hub
branch
2 times, most recently
from
69b1988 to
7711fea
Compare
Signed-off-by: sallyom <somalley@redhat.com>
Signed-off-by: sallyom <somalley@redhat.com>
sallyom
force-pushed
the
observability-hub
branch
2 times, most recently
from
c2e3a79 to
2b11b5c
Compare
Signed-off-by: sallyom <somalley@redhat.com>
sallyom
force-pushed
the
observability-hub
branch
from
2b11b5c to
5e45f76
Compare
| editable: true | ||
| type: tempo | ||
| # This is specific to "observability-hub" namespace. If running tempostack elsewhere, need to update | ||
| url: "https://tempo-tempostack-gateway-observability-hub.apps.ocp-beta-test.nerc.mghpcc.org/api/traces/v1/dev/tempo" |
There was a problem hiding this comment.
hopefully, yes - I think I had an issue with that - I'll ask Pavol when we meet today what's up
|
|
||
| #### metrics | ||
|
|
||
| For vLLM, metrics are generated by default and are exposed at `vllm-endpoint:port/metrics`. For a list of metrics, |
There was a problem hiding this comment.
@sallyom can we follow up on that one jira ticket to see if there is an open data hub vllm image we could use that includes your fix?
There was a problem hiding this comment.
the metrics are available with the opendatahub image but not tracing - I'll check the jira - if there are no plans on including the tracing pkgs, I'll remove the vllm-tracing docs from here.
|
|
||
| #### metrics | ||
|
|
||
| For vLLM, metrics are generated by default and are exposed at `vllm-endpoint:port/metrics`. For a list of metrics, |
There was a problem hiding this comment.
@sallyom can we follow up on that one jira ticket to see if there is an open data hub vllm image we could use that includes your fix?
There was a problem hiding this comment.
this shouldn't pause the merging but something we maybe make a note of to patch later
Signed-off-by: sallyom <somalley@redhat.com>
Signed-off-by: sallyom <somalley@redhat.com>
sallyom
force-pushed
the
observability-hub
branch
from
d0c8469 to
4cca9b0
Compare
2 participants
Description
Provides documentation for setting up a minimal observability stack on OpenShift for collecting LLamastack and vLLM telemetry
How Has This Been Tested?
Follow the
kubernetes/observability/README.mdto set up the observability stack.