Skip to content

Doesn't work on python 3.14 #6

Description

@stephantul

Hello,

tokie pulls in an older version of pyo3, which does not support python 3.14. On a fresh uv python 3.14 environment, this happens. This breaks semble installs currently, see MinishLab/semble#80 and MinishLab/semble#81.

  × Failed to build `tokie==0.0.9`
  ├─▶ The build backend returned an error
  ╰─▶ Call to `maturin.build_wheel` failed (exit status: 1)

      [stdout]
      Running `maturin pep517 build-wheel -i /Users/a/.cache/uv/builds-v0/.tmpGnZHUZ/bin/python
      --compatibility off`

      [stderr]
          Updating crates.io index
       Downloading crates ...
        Downloaded anstyle v1.0.14
        Downloaded anyhow v1.0.102
        Downloaded anes v0.1.6
        Downloaded ahash v0.8.12
        Downloaded writeable v0.5.5
        Downloaded monostate-impl v0.1.18
        Downloaded fancy-regex v0.13.0
        Downloaded icu_properties v1.5.1
        Downloaded zerovec-derive v0.10.3
        Downloaded yoke-derive v0.7.5
        Downloaded wasm-bindgen-macro v0.2.115
        Downloaded libredox v0.1.15
        Downloaded wasm-bindgen-shared v0.2.115
        Downloaded icu_locid v1.5.0
        Downloaded webpki-roots v0.26.11
        Downloaded rustc-hash v1.1.0
        Downloaded oorandom v11.1.5
        Downloaded itoa v1.0.18
        Downloaded zmij v1.0.21
        Downloaded bit-set v0.5.3
        Downloaded write16 v1.0.0
        Downloaded yoke v0.7.5
        Downloaded memoffset v0.9.1
        Downloaded pyo3-macros v0.24.2
        Downloaded ciborium-ll v0.2.2
        Downloaded macro_rules_attribute-proc_macro v0.2.2
        Downloaded zerocopy-derive v0.8.48
        Downloaded utf16_iter v1.0.5
        Downloaded zerovec v0.10.4
        Downloaded plotters-svg v0.3.7
        Downloaded ident_case v1.0.1
        Downloaded rayon-cond v0.4.0
        Downloaded icu_provider_macros v1.5.0
        Downloaded clap_lex v1.1.0
        Downloaded plotters-backend v0.3.7
        Downloaded crunchy v0.2.4
        Downloaded unit-prefix v0.5.2
        Downloaded derive_builder_macro v0.20.2
        Downloaded ciborium-io v0.2.2
        Downloaded unindent v0.2.4
        Downloaded monostate v0.1.18
        Downloaded cast v0.3.0
        Downloaded zerocopy v0.8.48
        Downloaded castaway v0.2.4
        Downloaded quote v1.0.45
        Downloaded darling_macro v0.20.11
        Downloaded litemap v0.7.5
        Downloaded simd-adler32 v0.3.9
        Downloaded icu_locid_transform v1.5.0
        Downloaded criterion-plot v0.5.0
        Downloaded onig v6.5.1
        Downloaded icu_provider v1.5.0
        Downloaded ciborium v0.2.2
        Downloaded web-sys v0.3.92
        Downloaded tinystr v0.7.6
        Downloaded dary_heap v0.3.8
        Downloaded console v0.16.3
        Downloaded bit-vec v0.6.3
        Downloaded once_cell v1.21.4
        Downloaded pyo3-build-config v0.24.2
        Downloaded derive_builder v0.20.2
        Downloaded bitflags v2.11.0
        Downloaded icu_locid_transform_data v1.5.1
        Downloaded target-lexicon v0.13.5
        Downloaded tinytemplate v1.2.1
        Downloaded static_assertions v1.1.0
        Downloaded unicode-general-category v1.1.0
        Downloaded derive_builder_core v0.20.2
        Downloaded macro_rules_attribute v0.2.2
        Downloaded icu_normalizer v1.5.0
        Downloaded darling v0.20.11
        Downloaded hf-hub v0.4.3
        Downloaded clap v4.6.0
        Downloaded wasm-bindgen v0.2.115
        Downloaded base64 v0.13.1
        Downloaded ryu v1.0.23
        Downloaded wasm-bindgen-macro-support v0.2.115
        Downloaded unicode-ident v1.0.24
        Downloaded pretokie v0.0.4
        Downloaded pyo3-macros-backend v0.24.2
        Downloaded compact_str v0.9.0
        Downloaded half v2.7.1
        Downloaded icu_normalizer_data v1.5.1
        Downloaded darling_core v0.20.11
        Downloaded indicatif v0.18.4
        Downloaded pyo3-ffi v0.24.2
        Downloaded minimal-lexical v0.2.1
        Downloaded unicode_categories v0.1.1
        Downloaded icu_collections v1.5.0
        Downloaded unicode-normalization-alignments v0.1.12
        Downloaded cc v1.2.58
        Downloaded chunk v0.9.2
        Downloaded js-sys v0.3.92
        Downloaded unicode-segmentation v1.13.2
        Downloaded base64 v0.21.7
        Downloaded ureq v2.12.1
        Downloaded itertools v0.10.5
        Downloaded nom v7.1.3
        Downloaded criterion v0.5.1
        Downloaded bumpalo v3.20.2
        Downloaded plotters v0.3.7
        Downloaded daggrs v0.1.1
        Downloaded esaxx-rs v0.1.10
        Downloaded clap_builder v4.6.0
        Downloaded tokenizers v0.22.2
        Downloaded icu_properties_data v1.5.1
        Downloaded syn v2.0.117
        Downloaded regex-syntax v0.8.10
        Downloaded rustls v0.23.37
        Downloaded spm_precompiled v0.1.4
        Downloaded onig_sys v69.9.1
        Downloaded libc v0.2.183
        Downloaded pyo3 v0.24.2
        Downloaded tiktoken-rs v0.6.0
      🔗 Found pyo3 bindings
      🐍 Found CPython 3.14 at /Users/a/.cache/uv/builds-v0/.tmpGnZHUZ/bin/python
      📡 Using build options features from pyproject.toml
      💻 Using `MACOSX_DEPLOYMENT_TARGET=11.0` for aarch64-apple-darwin by default
         Compiling proc-macro2 v1.0.106
         Compiling quote v1.0.45
         Compiling unicode-ident v1.0.24
         Compiling stable_deref_trait v1.2.1
         Compiling libc v0.2.183
         Compiling target-lexicon v0.13.5
         Compiling cfg-if v1.0.4
         Compiling once_cell v1.21.4
         Compiling find-msvc-tools v0.1.9
         Compiling writeable v0.6.2
         Compiling litemap v0.8.1
         Compiling shlex v1.3.0
         Compiling icu_properties_data v2.1.2
         Compiling icu_normalizer_data v2.1.1
         Compiling memchr v2.8.0
         Compiling cc v1.2.58
         Compiling zeroize v1.8.2
         Compiling smallvec v1.15.1
         Compiling getrandom v0.3.4
         Compiling serde_core v1.0.228
         Compiling rustls-pki-types v1.14.0
         Compiling zerocopy v0.8.48
         Compiling writeable v0.5.5
         Compiling untrusted v0.9.0
         Compiling zmij v1.0.21
         Compiling crc32fast v1.5.0
         Compiling icu_locid_transform_data v1.5.1
         Compiling litemap v0.7.5
         Compiling utf8_iter v1.0.4
         Compiling portable-atomic v1.13.1
         Compiling simd-adler32 v0.3.9
         Compiling ring v0.17.14
         Compiling syn v2.0.117
         Compiling serde v1.0.228
         Compiling icu_properties_data v1.5.1
         Compiling pyo3-build-config v0.24.2
         Compiling getrandom v0.2.17
         Compiling adler2 v2.0.1
         Compiling serde_json v1.0.149
         Compiling rustls v0.23.37
         Compiling itoa v1.0.18
         Compiling percent-encoding v2.3.2
         Compiling rand_core v0.9.5
         Compiling form_urlencoded v1.2.2
         Compiling miniz_oxide v0.8.9
         Compiling webpki-roots v1.0.6
         Compiling option-ext v0.2.0
         Compiling icu_normalizer_data v1.5.1
         Compiling log v0.4.29
         Compiling unicode-general-category v1.1.0
         Compiling subtle v2.6.1
         Compiling autocfg v1.5.0
         Compiling byteorder v1.5.0
         Compiling thiserror v2.0.18
         Compiling unicode-width v0.2.2
         Compiling socks v0.3.4
         Compiling memoffset v0.9.1
         Compiling console v0.15.11
         Compiling dirs-sys v0.5.0
         Compiling webpki-roots v0.26.11
         Compiling flate2 v1.1.9
         Compiling aho-corasick v1.1.4
         Compiling synstructure v0.13.2
         Compiling regex-syntax v0.8.10
         Compiling pyo3-ffi v0.24.2
         Compiling pyo3-macros-backend v0.24.2
         Compiling number_prefix v0.4.0
         Compiling base64 v0.22.1
         Compiling bytes v1.11.1
         Compiling heck v0.5.0
      error: failed to run custom build command for `pyo3-ffi v0.24.2`

      Caused by:
        process didn't exit successfully:
      `/Users/a/.cache/uv/sdists-v9/pypi/tokie/0.0.9/hZ4nHwE7Cgp75raTq5U9v/src/target/release/build/pyo3-ffi-48c3ca277fda3013/build-script-build`
      (exit status: 1)
        --- stdout
        cargo:rustc-check-cfg=cfg(Py_LIMITED_API)
        cargo:rustc-check-cfg=cfg(Py_GIL_DISABLED)
        cargo:rustc-check-cfg=cfg(PyPy)
        cargo:rustc-check-cfg=cfg(GraalPy)
        cargo:rustc-check-cfg=cfg(py_sys_config, values("Py_DEBUG", "Py_REF_DEBUG", "Py_TRACE_REFS",
      "COUNT_ALLOCS"))
        cargo:rustc-check-cfg=cfg(pyo3_disable_reference_pool)
        cargo:rustc-check-cfg=cfg(pyo3_leak_on_drop_without_reference_pool)
        cargo:rustc-check-cfg=cfg(Py_3_7)
        cargo:rustc-check-cfg=cfg(Py_3_8)
        cargo:rustc-check-cfg=cfg(Py_3_9)
        cargo:rustc-check-cfg=cfg(Py_3_10)
        cargo:rustc-check-cfg=cfg(Py_3_11)
        cargo:rustc-check-cfg=cfg(Py_3_12)
        cargo:rustc-check-cfg=cfg(Py_3_13)
        cargo:rustc-check-cfg=cfg(Py_3_14)
        cargo:rerun-if-env-changed=PYO3_CROSS
        cargo:rerun-if-env-changed=PYO3_CROSS_LIB_DIR
        cargo:rerun-if-env-changed=PYO3_CROSS_PYTHON_VERSION
        cargo:rerun-if-env-changed=PYO3_CROSS_PYTHON_IMPLEMENTATION
        cargo:rerun-if-env-changed=PYO3_PRINT_CONFIG
        cargo:rerun-if-env-changed=PYO3_USE_ABI3_FORWARD_COMPATIBILITY

        --- stderr
        error: the configured Python interpreter version (3.14) is newer than PyO3's maximum supported version
      (3.13)
        = help: please check if an updated version of PyO3 is available. Current version: 0.24.2
        = help: set PYO3_USE_ABI3_FORWARD_COMPATIBILITY=1 to suppress this check and build anyway using the stable
      ABI
      warning: build failed, waiting for other jobs to finish...
      💥 maturin failed
        Caused by: Failed to build a native library through cargo
        Caused by: Cargo build finished with "exit status: 101": `env -u CARGO
      CARGO_ENCODED_RUSTFLAGS="-C\u{1f}link-arg=-undefined\u{1f}-C\u{1f}link-arg=dynamic_lookup"
      MACOSX_DEPLOYMENT_TARGET="11.0" PYO3_BUILD_EXTENSION_MODULE="1"
      PYO3_ENVIRONMENT_SIGNATURE="cpython-3.14-64bit"
      PYO3_PYTHON="/Users/a/.cache/uv/builds-v0/.tmpGnZHUZ/bin/python"
      PYTHON_SYS_EXECUTABLE="/Users/a/.cache/uv/builds-v0/.tmpGnZHUZ/bin/python"
      "cargo" "rustc" "--profile" "release" "--features" "pyo3/extension-module"
      "--message-format" "json-render-diagnostics" "--manifest-path"
      "/Users/a/.cache/uv/sdists-v9/pypi/tokie/0.0.9/hZ4nHwE7Cgp75raTq5U9v/src/crates/tokie-python/Cargo.toml"
      "--lib" "--" "-C" "link-args=-Wl,-install_name,@rpath/tokie.cpython-314-darwin.so"`
      Error: command ['maturin', 'pep517', 'build-wheel', '-i',
      '/Users/a/.cache/uv/builds-v0/.tmpGnZHUZ/bin/python', '--compatibility', 'off'] returned
      non-zero exit status 1

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions