Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error adding metric sample for container #7198

Open
BestChinchilla opened this issue Aug 22, 2024 · 6 comments
Open

Error adding metric sample for container #7198

BestChinchilla opened this issue Aug 22, 2024 · 6 comments
Labels
area/vertical-pod-autoscaler kind/bug Categorizes issue or PR as related to a bug.

Comments

@BestChinchilla
Copy link

Which component are you using?:

VPA

What version of the component are you using?:

Component version: 1.2.0

What k8s version are you using (kubectl version)?:

kubectl version Output
OKD: 4.12.0-0.okd-2023-02-04-212953
Kubernetes Version: v1.25.0-2653+a34b9e9499e6c3-dirty

What environment is this in?:

On Premise in OpenStack

What did you expect to happen?:

No errors in logs every minute

What happened instead?:

We are getting a error something like this: W0822 08:38:08.999233 1 cluster_feeder.go:443] Error adding metric sample for container {{openshift-multus multus-additional-cni-plugins-ql9hs} POD}: KeyError: {{openshift-multus multus-additional-cni-plugins-ql9hs} POD} in recommender pod every minute on all system NS (openshift*, kube*, calico*, tigera-operator and etc) in OKD cluster, in these NS there's no VPA objects created and I cannot understand why VPA trying to get metrics from pods.
I'm added new arg --ignored-vpa-object-namespaces=tigera-operator,openshift,openshift-apiserver,...,argocd-operator but this not resolving the issue

How to reproduce it (as minimally and precisely as possible):

Just install VPA

Anything else we need to know?:

@BestChinchilla BestChinchilla added the kind/bug Categorizes issue or PR as related to a bug. label Aug 22, 2024
@adrianmoisey
Copy link
Member

/area vertical-pod-autoscaler

@adrianmoisey
Copy link
Member

We are getting a error something like this: W0822 08:38:08.999233 1 cluster_feeder.go:443] Error adding metric sample for container {{openshift-multus multus-additional-cni-plugins-ql9hs} POD}: KeyError: {{openshift-multus multus-additional-cni-plugins-ql9hs} POD}

Are some of these containers sidecars?

I'm wondering if this issue is a dupe of #6691

@BestChinchilla
Copy link
Author

@adrianmoisey I'm checked two random pods and in first of these has 2 sidecars and 0 initcontainers, but second has not both sidecars and initcontainder, but i see this pod in log error too

@adrianmoisey
Copy link
Member

@adrianmoisey I'm checked two random pods and in first of these has 2 sidecars and 0 initcontainers, but second has not both sidecars and initcontainder, but i see this pod in log error too

Sounds like the issue you're facing is this bug? #7229

@BestChinchilla
Copy link
Author

@adrianmoisey We are not using native sidecars and we have an error in pod, that don't have any initContainer or sidecar in manifest

@adrianmoisey
Copy link
Member

Can you provide more details on reproducing this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/vertical-pod-autoscaler kind/bug Categorizes issue or PR as related to a bug.
Projects
None yet
Development

No branches or pull requests

3 participants