[Bazel CI] ModuleNotFoundError: No module named 'requests'

[sgowroji]

CI: https://buildkite.com/bazel/bazel-at-head-plus-downstream/builds/4479#019517ab-16ba-4648-8903-0cd9a464460e

Platform: MacOS

Logs:

$ curl -sS https://raw.githubusercontent.com/bazelbuild/continuous-integration/master/buildkite/bazelci.py?1739851852 -o bazelci.py
python3 bazelci.py runner --task=macos_arm64 --file_config=.bazelci/postsubmit.yml --git_repository=https://github.com/bazelbuild/bazel-bench.git --git_commit=5efc0e1f0a00d8cb1a8da09bd91949c81940e053 --use_but
/Users/buildkite/builds/bk-macos-arm64-tcib/bazel/bazel-at-head-plus-downstream/bazelci.py:834: SyntaxWarning: invalid escape sequence '\$'
  return re.match("^\${{\s*(\w+)\s*}}$", s)
Traceback (most recent call last):
  File "/Users/buildkite/builds/bk-macos-arm64-tcib/bazel/bazel-at-head-plus-downstream/bazelci.py", line 34, in <module>
    import requests
ModuleNotFoundError: No module named 'requests'
🚨 Error: The command exited with status 1

We are seeing this failure for multiple CI pipelines.

CC Greenteam @mai93 @meteorcloudy

[luispadron]

+1 Seeing this in rules_apple as well: https://buildkite.com/bazel/rules-apple-darwin/builds/10077

[linzhp]

Seeing this in rules_go: https://buildkite.com/bazel/rules-go-golang/builds/7637#019533ad-b02b-4d77-9834-69048eaaeb3e/65-72

[meteorcloudy]

@fweikert We do have an internal bug tracking the cause of this, right?

[fweikert]

Yeah, but no progress so far. I wonder if this is just a consequence of the known stability issues, or a different issue altogether.