Skip to content

Bump transformers and sentence-transformers #103

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 10 commits into from
Apr 23, 2025
Merged

Bump transformers and sentence-transformers #103

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
52fe9eb
Bump `transformers`, `diffusers`, `sentence-transformers` et al.
alvarobartt Mar 10, 2025
ec8d0c7
try just popping from inputs
ErikKaum Mar 10, 2025
9588098
Revert "try just popping from inputs"
ErikKaum Mar 10, 2025
8201938
maybe fix torch dtype issue
ErikKaum Mar 10, 2025
da5a587
maybe we hardcode bfloat16
ErikKaum Mar 10, 2025
f877fbd
try with lower diffusers patch
ErikKaum Mar 10, 2025
dfc1ed3
revers all versions execpt transformers
ErikKaum Mar 10, 2025
893de39
Merge branch 'main' into bump-versions-and-release
alvarobartt Apr 14, 2025
6d7bdb7
Drop Python 3.8 support
alvarobartt Apr 14, 2025
253555b
Bump `torch`, `transformers` et al.
alvarobartt Apr 14, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 7 additions & 8 deletions setup.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,8 +16,8 @@
# Due to an error affecting kenlm and cmake (see https://github.com/kpu/kenlm/pull/464)
# Also see the transformers patch for it https://github.com/huggingface/transformers/pull/37091
"kenlm@git+https://github.com/kpu/kenlm@ba83eafdce6553addd885ed3da461bb0d60f8df7",
"transformers[sklearn,sentencepiece,audio,vision]==4.48.0",
"huggingface_hub[hf_transfer]==0.27.1",
"transformers[sklearn,sentencepiece,audio,vision]==4.51.2",
"huggingface_hub[hf_transfer]==0.30.2",
# vision
"Pillow",
"librosa",
Expand All @@ -34,11 +34,11 @@

extras = {}

extras["st"] = ["sentence_transformers==3.3.1"]
extras["diffusers"] = ["diffusers==0.32.1", "accelerate==1.2.1"]
extras["st"] = ["sentence_transformers==4.0.2"]
extras["diffusers"] = ["diffusers==0.33.1", "accelerate==1.6.0"]
# Includes `peft` as PEFT requires `torch` so having `peft` as a core dependency
# means that `torch` will be installed even if the `torch` extra is not specified.
extras["torch"] = ["torch==2.3.1", "torchvision", "torchaudio", "peft==0.14.0"]
extras["torch"] = ["torch==2.5.1", "torchvision", "torchaudio", "peft==0.15.1"]
extras["test"] = [
"pytest==7.2.1",
"pytest-xdist",
Expand All @@ -60,13 +60,13 @@
version=VERSION,
author="Hugging Face",
description="Hugging Face Inference Toolkit is for serving 🤗 Transformers models in containers.",
url="",
url="https://github.com/huggingface/huggingface-inference-toolkit",
package_dir={"": "src"},
packages=find_packages(where="src"),
install_requires=install_requires,
extras_require=extras,
entry_points={"console_scripts": "serve=sagemaker_huggingface_inference_toolkit.serving:main"},
python_requires=">=3.8",
python_requires=">=3.9",
license="Apache License 2.0",
classifiers=[
"Development Status :: 5 - Production/Stable",
Expand All @@ -76,7 +76,6 @@
"License :: OSI Approved :: Apache Software License",
"Operating System :: OS Independent",
"Programming Language :: Python :: 3",
"Programming Language :: Python :: 3.8",
"Programming Language :: Python :: 3.9",
"Programming Language :: Python :: 3.10",
"Programming Language :: Python :: 3.11",
Expand Down
1 change: 1 addition & 0 deletions src/huggingface_inference_toolkit/diffusers_utils.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -74,6 +74,7 @@ def __call__(

# Call pipeline with parameters
out = self.pipeline(prompt, num_images_per_prompt=1, **kwargs)

return out.images[0]


Expand Down