Skip to content

[ecosystem CI] pass BUILDKITE_ANALYTICS_TOKEN into test job containers - #499

Merged
elliot-barn merged 1 commit into
mainfrom
elliot-barn-ecosystem-analytics-token
Aug 19, 2026
Merged

[ecosystem CI] pass BUILDKITE_ANALYTICS_TOKEN into test job containers#499
elliot-barn merged 1 commit into
mainfrom
elliot-barn-ecosystem-analytics-token

Conversation

@elliot-barn

Copy link
Copy Markdown
Collaborator

Summary

Ecosystem CI test jobs run under the docker#v5.3.0 plugin with propagate-environment: false and an explicit environment allowlist in ecosystem_ci/step.json — so pipeline-level env vars are dropped at the container boundary and never reach the test suites.

This allowlists BUILDKITE_ANALYTICS_TOKEN (name only — the value is being set as pipeline-level env in the Buildkite UI for the KubeRay ecosystem pipeline) so Buildkite Test Engine collectors running inside the test containers can upload results.

Safety notes:

  • Name-only entry: no secret value lands in this repo or in the generated pipeline JSON.
  • BUILDKITE_ANALYTICS_TOKEN matches the agent's *_TOKEN log-redaction pattern.
  • Test Engine analytics tokens are write-only (test-result uploads for a single suite), so exposure blast radius inside test containers is minimal.

Testing

python3 -c "import json; ..."step.json parses and the var is present in the docker plugin environment list; build_pipeline.py consumes this file as-is (deep-copies the base step), so no code change is needed.

AI assistance (Claude Code) was used; reviewed by the submitter.

🤖 Generated with Claude Code

Ecosystem CI test jobs run under the docker plugin with
propagate-environment: false and an explicit environment allowlist, so
pipeline-level env vars are dropped at the container boundary. Allowlist
BUILDKITE_ANALYTICS_TOKEN (name only; the value is set as pipeline-level
env in the Buildkite UI) so Test Engine collectors inside the test
suites can report results. The token matches the agent's *_TOKEN
redaction pattern, and analytics tokens are write-only (test-result
uploads for a single suite).

Signed-off-by: Ray CI Test <rayci@ray.io>

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates ecosystem_ci/step.json to include the BUILDKITE_ANALYTICS_TOKEN environment variable. There are no review comments, so I have no feedback to provide.

@elliot-barn
elliot-barn merged commit d168f49 into main Aug 19, 2026
2 checks passed
@elliot-barn
elliot-barn deleted the elliot-barn-ecosystem-analytics-token branch August 19, 2026 09:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant