Update dependency rules_python to v1 #388
Open
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![renovate[bot]](https://avatars.githubusercontent.com/in/2740?s=60&v=4){kind=small}
github-actions
bot
added
dependencies
|
This PR would be awesome to get landed as it is stopping me from moving to the new rules_python. It looks like it is mostly working but possibly has an issue with some of the workspace rules. |
renovate
bot
force-pushed
the
renovate/rules_python-1.x
branch
from
e6952fb to
5d7c7fa
Compare
|
Just a note that I was actually able to do the upgrade without this being landed. I am not sure what changed but the initial error message was coming from this library and looked to be because of a difference with the rules_python module. I have lost the error messages at this point but just wanted to update. |
renovate
bot
force-pushed
the
renovate/rules_python-1.x
branch
from
5d7c7fa to
79ce52f
Compare
renovate
bot
force-pushed
the
renovate/rules_python-1.x
branch
from
79ce52f to
8c37148
Compare
renovate
bot
force-pushed
the
renovate/rules_python-1.x
branch
from
8c37148 to
a9fb279
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
0.37.2->1.4.0Release Notes
bazel-contrib/rules_python (rules_python)
v1.4.0Compare Source
{#1-4-0-changed}
Changed
execconfiguration toolchain now has the forwardedexec_interpreternow also forwards theToolchainInfoprovider. This isfor increased compatibility with the
RBEsetups where access to theexecconfiguration interpreter is needed.
xcrun xcodebuild --showsdksto find XCode root.3.8.20versions of the Python3.8interpreter who hasreached EOL. If users still need other versions of the
3.8interpreter, please supplythe URLs manually {bzl:obj}
python.toolchainor {bzl:obj}python_register_toolchainscalls.changed the semantics of
ignore_root_user_errorfrom "ignore" to "warning". This is nowflipped back to ignoring the issue, and will only emit a warning when the attribute is set
False.extension has been marked reproducible.
Fixes #2434.
manifest files are loaded when Gazelle is run over a set of non-python directories
PR #2746.
py_binary.srcsand {attr}py_test.srcsis no longer mandatory whenmain_moduleis specified (for--bootstrap_impl=script){#1-4-0-fixed}
Fixed
universal lock files with environment markers. Fixes #2690.
--bootstrap_impl=script) Follow symlinks when searching for runfiles.chmodwhen downloading non-windows hermetic toolchainrepositories on Windows. Fixes
#2660.
FAILvia theRULES_PYTHON_REPO_DEBUG_VERBOSITYenvironment variable.transitions transitioning on the
python_versionflag.Fixes #2685.
PYTHONPATH..pycand.pyofiles are also excluded from the interpreters repository files.PYTHONPATH.requires_fileis treated as if it were omitted, resulting in a validMETADATAfile.target_compatible_withto all targets they create.PR #2788.
METADATAentries whenpython_full_versionis used inthe environment marker.
Fixes #2319.
python_versionparameter and transition the requirementlocking to the right interpreter version when using
{obj}
compile_pip_requirementsrule.See #2819.
{#1-4-0-added}
Added
sha256values in therequirements.txtis no longermandatory when enabling {attr}
pip.parse.experimental_index_urlfeature.This means that
rules_pythonwill attempt to fetch metadata for allpackages through SimpleAPI unless they are pulled through direct URL
references. Fixes #2023.
In case you see issues with
rules_pythonbeing too eager to fetch the SimpleAPImetadata, you can use the newly added {attr}
pip.parse.experimental_skip_sourcesto skip metadata fetching for those packages.
lockrule that is the replacement for the{obj}
compile_pip_requirements. This may still have rough cornersso please report issues with it in the
#1975.
Main highlights - the locking can be done within a build action or outside
it, there is no more automatic
testtarget (but it can be added on the userside by using
native_test). For customizing theuvversion that is used,please check the {obj}
uv.configuretag class.PyInfo.site_packages_symlinksfield added toallow specifying links to create within the venv site packages (only
applicable with {obj}
--bootstrap_impl=script)(#2156).
equivalent to the standard toolchains. See [Local toolchains] docs for how to
configure them.
$(PYTHON2_ROOTPATH)and$(PYTHON3_ROOTPATH)which are runfileslocations equivalents of
$(PYTHON2)and `$(PYTHON3) respectively.{#1-4-0-removed}
Removed
{#v1-3-0}
v1.3.0Compare Source
{#v1-3-0-changed}
Changed
py_library.pyi_srcs(.pyifiles) in the wheel.py_library.pyi_srcs(.pyifiles) inpy_package.gazelle_python.yaml) will now include theYAML document start
---line. Implemented in#2656.
{#v1-3-0-fixed}
Fixed
ppc64leis now pointing to the right target in theplatformspackage.py_binarytargets during partial updates infilegeneration mode. Fixed in #2619.ignore_root_user_error=Trueis now the default. Note that running as root may still cause spurious
Bazel cache invalidation
(#1169).
Support spilling modules mapping args into a params file.
pythoninvocations in repository and module extensionevaluation contexts will invoke Python interpreter with
-Bto avoidcreating
.pycfiles.{#v1-3-0-added}
Added
python.defaultshas been added to allow users toset the default python version in the root module by reading the
default version number from a file or an environment variable.
//python/bin:python: convenience target for directly running aninterpreter. {obj}
--//python/bin:python_srccan be used to specify abinary whose interpreter to use.
bzlmodAPIs without theneed to patch
rules_python. The documentation has been added torules_pythondocs but usage of the extension may result in your setup breaking without any
notice. What is more, the URLs and SHA256 values will be retrieved from the
GitHub releases page metadata published by the
uvproject.LDFLAGSwhenbuilding wheels from
sdist.{obj}
experimental_index_url(bazel downloader).Partially fixes #2363.
and py_library rules
(#1647)
See {obj}
RULES_PYTHON_ADDITIONAL_INTERPRETER_ARGSenvironment variable.Only applicable for {obj}
--bootstrap_impl=script.interpreter_argsattribute topy_binaryandpy_test,which allows pass arguments to the interpreter before the regular args.
main_moduleattribute topy_binaryandpy_test,which allows specifying a module name to run (i.e.
python -m <module>).{#v1-3-0-removed}
Removed
{#v1-2-0}
v1.2.0Compare Source
{#v1-2-0-changed}
Changed
py_proto_libraryis deprecated in favour of theimplementation in https://github.com/protocolbuffers/protobuf. It will be
removed in the future release.
pip.overridewill now be ignored instead of raising an error,fixes #2550.
default for now and can be enabled with
RULES_PYTHON_DEPRECATION_WARNINGSenv var.
pipfrom24.3.2to24.0.0andpackagingfrom24.2to24.0.{#v1-2-0-fixed}
Fixed
python_zip_fileoutput with--bootstrap_impl=scriptworks again(#2596).
python_versionattribute for specifying python versions introduced inv1.1.0gazelle_python_manifestnow works correctly.fixes #2554.
as UTF-8 on all platforms.
--bootstrap_impl=scriptis fixed(#2572).
by reverting #2514.
The related issue is #908.
tag_classdoes not have a populateddocvalue.Fixes (#2579).
--bootstrap_impl=script: set{obj}
--venvs_use_declare_symlink=noto have it not create symlinks atbuild time (they will be created at runtime instead).
(Fixes #2489)
{#v1-2-0-added}
Added
{#v1-2-0-removed}
Removed
{#v1-1-0}
v1.1.0Compare Source
{#v1-1-0-changed}
Changed
version, per our Bazel support matrix. Earlier versions are not
tested by CI, so functionality cannot be guaranteed.
pip.parse) From now we will make fewer calls to indexes whenfetching the metadata from SimpleAPI. The calls will be done in parallel to
each index separately, so the extension evaluation time might slow down if
not using {bzl:obj}
pip.parse.experimental_index_url_overrides.pip.parse) Only query SimpleAPI for packages that havesha values in the
requirements.txtfile.the version-aware rules are now simply aliases for the base rules. The
python_versionattribute is still used to specify the Python version.pipto 24.3.1 andpackagingto 24.2.{#v1-1-0-deprecations}
Deprecations
//python/config_settings:transitions.bzland itspy_binaryandpy_testwrappers are deprecated. Use the regular rules instead.
{#v1-1-0-fixed}
Fixed
toolchains that search PATH to be used for the wheel builder tool.
whl_librarywill now not have envmarker information allowing
bazel queryto work in cases where thewhlisavailable for all of the platforms and the sdist can be built. This fix is
for both WORKSPACE and
bzlmodsetups.Fixes #2450.
Parameter Syntax. (#2396)
pip_parse.experimental_requirement_cyclesand{bzl:obj}
pip_parse.use_hub_alias_dependenciestogether now works whenusing WORKSPACE files.
are now printing more details and include the currently active flag
values. Fixes #2466.
PyPI packages used in {bzl:obj}
whl_libraryduring therepository_rulephasechange. Fixes #2468.
setup.pyfiles by default. To restorethis behavior, apply the
# gazelle:python_ignore_files setup.pydirective.whenever
PATHchanges. Fixes#2551.
{#v1-1-0-added}
Added
include_stub_packagesflag tomodules_mapping. When set toTrue, thisautomatically includes corresponding stub packages for third-party libraries
that are present and used (e.g.,
boto3→boto3-stubs), improvingtype-checking support.
{obj}
experimental_index_urlusage or the regularpip.parseusage.To select the free-threaded interpreter in the repo phase, please use
the documented env variables.
Fixes #2386.
.pyifiles) and type-checkingonly dependencies added. See {obj}
py_library.pyi_srcsandpy_library.pyi_deps(and the same named attributes forpy_binaryandpy_test).pyi_srcsto include*.pyifiles.PyInfohas new fields to aid static analysis tools:{obj}
direct_original_sources, {obj}direct_pyi_files,{obj}
transitive_original_sources, {obj}transitive_pyi_files.{#v1-1-0-removed}
Removed
find_requirementsin//python:defs.bzlhas been removed.{#v1-0-0}
v1.0.0Compare Source
{#v1-0-0-changed}
Changed
Breaking:
Please consider depending on the flags defined in
//python/config_setting/...and the@platformspackage instead.MACOS_NAMEand thearchattribute in the
PLATFORMSlist, please update your code to respect the newvalues. The values now correspond to the values available in the
@platforms//package constraint values.host_platformandinterpreterconstants are no longer createdin the
toolchaingenerated alias.bzlfiles. If you need to access thehost interpreter during the
repository_ruleevaluation, please use the@python_{version}_host//:pythontargets created by{bzl:obj}
python_register_toolchainsand{bzl:obj}
python_register_multi_toolchainsmacros or the {bzl:obj}pythonbzlmod extension.
pip.parse.parse_all_requirements_filesattribute has been removed.See notes in the previous versions about what to do.
Other changes:
strip_prefixfield forzstdarchives.pip_parse.extra_hub_aliasesnow works in WORKSPACE files.--bootstrap_impl=script, a binary-specific (butotherwise empty) virtual env is used to customize
sys.pathinitialization.{#v1-0-0-fixed}
Fixed
unameto get the value of the host platform.files which is useful when including different PyTorch builds (e.g. <pytorch+cpu> vs <pytorch+cu118> ) for different target platforms.
Fixes (2337).
uvbinary for aarch64-apple-darwin.Fixes (2411).
--bootstrap_impl=scipt) Usingsys.executablewilluse the same
sys.pathsetup as the calling binary.(2169).
hardcoded in Bazel, WORKSPACE mode.
compile_pip_requirementsno longer fails on Windows when--enable_runfilesis not enabled.compile_pip_requirementsnow correctly updates files in the source tree on Windows when--windows_enable_symlinksis not enabled.libpythontargetdefined by a repository template. This enables stable ABI builds of Python extensions
on Windows (by defining Py_LIMITED_API).
py_testandpy_binarytargets no longer incorrectly remove thefirst
sys.pathentry when using {obj}--bootstrap_impl=script{#v1-0-0-added}
Added
details can be logged by setting
RULES_PYTHON_GAZELLE_VERBOSE=1.they would like to use through
RULES_PYTHON_REPO_TOOLCHAIN_{VERSION}_{OS}_{ARCH}env variable setting. Forexample, this allows one to use
freethreadedpython interpreter in therepository_ruleto build a wheel fromsdist.muslclibc have been addedfor the latest toolchain versions for each minor Python version. You can control
the toolchain selection by using the
{bzl:obj}
//python/config_settings:py_linux_libcbuild flag.py_runtime_info.site_init_templateand{obj}
PyRuntimeInfo.site_init_templatefor specifying the template to use toinitialize the interpreter via venv startup hooks.
{#v1-0-0-removed}
Removed
pypi_install_dependenciesmacro that has been included in{bzl:obj}
py_repositoriesfor a long time.DEFAULT_PYTHON_VERSIONfrominterpreters.bzlfile. Ifyou need the version, please use it from the
versions.bzlfile instead.{#v0-40-0}
v0.40.0Compare Source
{#v0-40-changed}
Changed
{#v0-40-fixed}
Fixed
(2414).
{#v0-40-added}
Added
{#v0-40-removed}
Removed
requirements.txtfor thetwinedependencies.Please use
requirements_linux.txtinstead.zstdsupport and remove attributesfor customizing the
zstdbinary to be used forzstdarchives in the{bzl:obj}
python_repositoryrepository_rule. This affects the{bzl:obj}
python_register_toolchainsand{bzl:obj}
python_register_multi_toolchainscallers in theWORKSPACE.{#v0-39-0}
v0.39.0Compare Source
{#v0-39-0-changed}
Changed
bzlmodspoke repositories have changed asall of the given
requirements.txtfiles are now parsed bydefault, totemporarily restore the behavior, you can use
{bzl:obj}
pip.parse.extra_hub_aliases, which will be removed or made noop inthe future.
{#v0-39-0-fixed}
Fixed
@bazel_tools//tools/python:autodetecting_toolchainis being used(#2364).
{#v0-39-0-added}
Added
the config flag
//python/config_settings:py_freethreadedto toggle theselection of the free-threaded toolchains.
py_runtime.abi_flagsattribute and{obj}
PyRuntimeInfo.abi_flagsfield added.{#v0-39-0-removed}
Removed
{#v0-38-0}
v0.38.0Compare Source
{#v0-38-0-changed}
Changed
version used; this for Bazel 8+ support (previously version was rules_cc 0.0.9
and no protobuf version specified)
(2310).
for the
twinepublishing rule.--no-build-isolationto allow non-hermetic sdist buildsby default. Users wishing to keep this argument and to enforce more hermetic
builds can do so by passing the argument in
pip.parse#extra_pip_argspip.parse.whl_modificationsnow normalizes the given whl namesand now
pyyamlandPyYAMLwill both work.pip.parsespoke repository naming will be changed in an upcomingrelease in places where the users specify different package versions per
platform in the same hub repository. The naming of the spoke repos is
considered an implementation detail and we advise the users to use the
hubrepository directly and make use of {bzl:obj}
pip.parse.extra_hub_aliasesfeature added in this release.
{#v0-38-0-fixed}
Fixed
whl_librarys(617).
pip.parse.experimental_index_urlis set, we need to stillpass the
extra_pip_argsvalue when building ansdist.which fixes usage of the said wheels using standard package managers.
same lock file irrespective if
experimental_index_urlis set by any moduleor not. To opt into this behavior, set
pip.parse.parse_all_requirements_files, which will become thedefault in future releases leading up to
1.0.0. Fixes#2268. A known
issue is that it may break
bazel queryand in these use cases it isadvisable to use
cqueryor switch todownload_only = True{#v0-38-0-added}
Added
twinepublishing rules have beenupdated to have a new convention:
requirements_darwin.txt,requirements_linux.txt,requirements_windows.txtfor each respective OSand one extra file
requirements_universal.txtif you prefer a single file.The
requirements.txtfile may be removed in the future.//python/features.bzl#features.versionpip.parse.extra_hub_aliasescan now be used to expose extratargets created by annotations in whl repositories.
Fixes #2187.
pip.parsenow supportswhl-onlysetup usingdownload_only = Truewhere users can specify multiple requirements filesand use the
pipbackend to do the downloading. This was only available forusers setting {bzl:obj}
pip.parse.experimental_index_url, but now users havemore options whilst we continue to work on stabilizing the experimental feature.
{#v0-37-2}
View the repository job log