Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

config: add all image-pushing jobs to a wg-k8s-infra-gcb testgrid dashboard #22898

Merged
merged 5 commits into from
Jul 15, 2021

Conversation

spiffxp
Copy link
Member

@spiffxp spiffxp commented Jul 15, 2021

I'd recommend reviewing by commit rather than everything at once, see commit messages for details.

This provides a single location to check on the status of image pushing across the entire kubernetes project, to help track #20652

@k8s-ci-robot k8s-ci-robot added do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. approved Indicates a PR has been approved by an approver from all required OWNERS files. area/config Issues or PRs related to code in /config area/release-eng Issues or PRs related to the Release Engineering subproject area/testgrid sig/release Categorizes an issue or PR as relevant to SIG Release. sig/testing Categorizes an issue or PR as relevant to SIG Testing. wg/k8s-infra size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. labels Jul 15, 2021
Currently it only reformats according to hardcoded settings
In preparation for mass-editing jobs with ruamel.yaml, which will
enforce _some_ kind of formatting changes re: indentation, move all jobs
to whichever format causes the least amount of delta. This will allow
the mass-edit commit to be isolated just to job changes vs. formatting
changes.

There are two classes of changes squashed into this commit.

First, two staging repos that generate their jobs from a shell script,
so update the formatting in the script, and regenerate the jobs:
- k8s-staging-e2e-test-images
- k8s-staging-sig-storage

Second, format everything else using experiment/edit-prowjobs.py. Since
most people copy-pasted from the same example, this changed:
- k8s-staging-cluster-api
- k8s-staging-kubetest2
- k8s-staging-releng
Split checks that are specific to whether a job is a valid image-pushing
job out of whether it is authorized to run on
k8s-infra-prow-build-trusted

Add a new check (that will fail until following commits) that enforces all
image-pushing jobs must be on the new wg-k8s-infra-gcb testgrid
dashboard
@spiffxp spiffxp force-pushed the wg-k8s-infra-gcb-dashboard branch from 968873b to c7359b1 Compare July 15, 2021 04:39
spiffxp and others added 2 commits July 14, 2021 22:31
also addressed pylint errors and warnings
This involves three sets of changes:
- adding the wg-k8s-infra-gcb dashboard to config/testgrids
- using edit-prowjobs.py to mass-edit all but one image-pushing job
- manually edit post-security-profiles-operator-push-image in
  k8s-staging-seccomp-operator.yaml to add a testgrid-dashboards
  annotation

The last change exposes the fact that there is no one-true-yaml that
defines both prowjobs and all of their testgrid dashboards. The job
has another testgrid dashboard tab defined in a testgrid config. It
can't be moved to the prowjob config as-is, because it has a custom
base_options setting for width, and acontext-free name that wouldn't
make sense on the wg-k8s-infra-gcb dashboard. Neither base_options
nor different tab names are currently supported by the
prowjob-annotation-based testgrid configurator.
@spiffxp spiffxp force-pushed the wg-k8s-infra-gcb-dashboard branch from c7359b1 to d936390 Compare July 15, 2021 05:33
@spiffxp spiffxp changed the title [wip] config: add all image-pushing jobs to a wg-k8s-infra-gcb testgrid dashboard config: add all image-pushing jobs to a wg-k8s-infra-gcb testgrid dashboard Jul 15, 2021
@k8s-ci-robot k8s-ci-robot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jul 15, 2021
@spiffxp
Copy link
Member Author

spiffxp commented Jul 15, 2021

/cc @cpanato @puerco
FYI @kubernetes/release-engineering
/cc @ameukam

Copy link
Member

@cpanato cpanato left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I did not find anything wrong if I can say that

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jul 15, 2021
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: cpanato, spiffxp

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot merged commit 94d8752 into kubernetes:master Jul 15, 2021
@k8s-ci-robot k8s-ci-robot added this to the v1.22 milestone Jul 15, 2021
@k8s-ci-robot
Copy link
Contributor

@spiffxp: Updated the job-config configmap in namespace default at cluster test-infra-trusted using the following files:

  • key k8s-staging-apiserver-network-proxy.yaml using file config/jobs/image-pushing/k8s-staging-apiserver-network-proxy.yaml
  • key k8s-staging-apisnoop.yaml using file config/jobs/image-pushing/k8s-staging-apisnoop.yaml
  • key k8s-staging-boskos.yaml using file config/jobs/image-pushing/k8s-staging-boskos.yaml
  • key k8s-staging-cloud-provider-aws.yaml using file config/jobs/image-pushing/k8s-staging-cloud-provider-aws.yaml
  • key k8s-staging-cloud-provider-gcp.yaml using file config/jobs/image-pushing/k8s-staging-cloud-provider-gcp.yaml
  • key k8s-staging-cluster-addons.yaml using file config/jobs/image-pushing/k8s-staging-cluster-addons.yaml
  • key k8s-staging-cluster-api.yaml using file config/jobs/image-pushing/k8s-staging-cluster-api.yaml
  • key k8s-staging-cri-tools.yaml using file config/jobs/image-pushing/k8s-staging-cri-tools.yaml
  • key k8s-staging-csi-secrets-store.yaml using file config/jobs/image-pushing/k8s-staging-csi-secrets-store.yaml
  • key k8s-staging-descheduler.yaml using file config/jobs/image-pushing/k8s-staging-descheduler.yaml
  • key k8s-staging-dns.yaml using file config/jobs/image-pushing/k8s-staging-dns.yaml
  • key k8s-staging-e2e-test-images.yaml using file config/jobs/image-pushing/k8s-staging-e2e-test-images.yaml
  • key k8s-staging-etcdadm.yaml using file config/jobs/image-pushing/k8s-staging-etcdadm.yaml
  • key k8s-staging-external-dns.yaml using file config/jobs/image-pushing/k8s-staging-external-dns.yaml
  • key k8s-staging-gateway-api.yaml using file config/jobs/image-pushing/k8s-staging-gateway-api.yaml
  • key k8s-staging-infra-tools.yaml using file config/jobs/image-pushing/k8s-staging-infra-tools.yaml
  • key k8s-staging-ingress-controller-conformance.yaml using file config/jobs/image-pushing/k8s-staging-ingress-controller-conformance.yaml
  • key k8s-staging-ingress-nginx.yaml using file config/jobs/image-pushing/k8s-staging-ingress-nginx.yaml
  • key k8s-staging-k8s-gsm-tools.yaml using file config/jobs/image-pushing/k8s-staging-k8s-gsm-tools.yaml
  • key k8s-staging-kind.yaml using file config/jobs/image-pushing/k8s-staging-kind.yaml
  • key k8s-staging-kops.yaml using file config/jobs/image-pushing/k8s-staging-kops.yaml
  • key k8s-staging-kube-state-metrics.yaml using file config/jobs/image-pushing/k8s-staging-kube-state-metrics.yaml
  • key k8s-staging-kubetest2.yaml using file config/jobs/image-pushing/k8s-staging-kubetest2.yaml
  • key k8s-staging-kustomize.yaml using file config/jobs/image-pushing/k8s-staging-kustomize.yaml
  • key k8s-staging-metrics-server.yaml using file config/jobs/image-pushing/k8s-staging-metrics-server.yaml
  • key k8s-staging-multitenancy.yaml using file config/jobs/image-pushing/k8s-staging-multitenancy.yaml
  • key k8s-staging-nfd-operator.yaml using file config/jobs/image-pushing/k8s-staging-nfd-operator.yaml
  • key k8s-staging-nfd.yaml using file config/jobs/image-pushing/k8s-staging-nfd.yaml
  • key k8s-staging-node-problem-detector.yaml using file config/jobs/image-pushing/k8s-staging-node-problem-detector.yaml
  • key k8s-staging-prometheus-adapter.yaml using file config/jobs/image-pushing/k8s-staging-prometheus-adapter.yaml
  • key k8s-staging-provider-azure.yaml using file config/jobs/image-pushing/k8s-staging-provider-azure.yaml
  • key k8s-staging-scheduler-plugins.yaml using file config/jobs/image-pushing/k8s-staging-scheduler-plugins.yaml
  • key k8s-staging-seccomp-operator.yaml using file config/jobs/image-pushing/k8s-staging-seccomp-operator.yaml
  • key k8s-staging-sig-docs.yaml using file config/jobs/image-pushing/k8s-staging-sig-docs.yaml
  • key k8s-staging-sig-storage.yaml using file config/jobs/image-pushing/k8s-staging-sig-storage.yaml
  • key k8s-staging-slack-infra.yaml using file config/jobs/image-pushing/k8s-staging-slack-infra.yaml
  • key k8s-staging-storage-migrator.yaml using file config/jobs/image-pushing/k8s-staging-storage-migrator.yaml
  • key k8s-staging-artifact-promoter.yaml using file config/jobs/image-pushing/releng/k8s-staging-artifact-promoter.yaml
  • key k8s-staging-build-image.yaml using file config/jobs/image-pushing/releng/k8s-staging-build-image.yaml
  • key k8s-staging-kubernetes.yaml using file config/jobs/image-pushing/releng/k8s-staging-kubernetes.yaml
  • key k8s-staging-releng.yaml using file config/jobs/image-pushing/releng/k8s-staging-releng.yaml

In response to this:

I'd recommend reviewing by commit rather than everything at once, see commit messages for details.

This provides a single location to check on the status of image pushing across the entire kubernetes project, to help track #20652

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@spiffxp spiffxp deleted the wg-k8s-infra-gcb-dashboard branch July 15, 2021 14:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. area/config Issues or PRs related to code in /config area/release-eng Issues or PRs related to the Release Engineering subproject area/testgrid cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. sig/release Categorizes an issue or PR as relevant to SIG Release. sig/testing Categorizes an issue or PR as relevant to SIG Testing. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants