Skip to content

Conversation

@michaelbenayoun
Copy link
Member

What does this PR do?

  • Updates the packages versions for SDK 2.26.1
  • Make uv usable: we can run uv sync without failing now

Copy link
Collaborator

@tengomucho tengomucho left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems nice! I think it would be better to add some documentation about how to use uv with optimum-neuron.

Copy link
Collaborator

@JingyaHuang JingyaHuang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for improving it! @michaelbenayoun

"wheel",
"torch-neuron==1.13.1.2.9.74.0",
"torch==1.13.1.*",
"neuron-cc[tensorflow]==1.22.0.0",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We shall remove the extra which is dedicated to inf1
cc. @dacorvo @tengomucho

"wheel",
"neuronx-cc==2.21.18209.0",
"torch-neuronx==2.8.0.2.10.13553",
"neuronx-cc==2.21.33363.0",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We already merged these changes last week 😉

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome, I still had that on my branch, my bad!

@michaelbenayoun
Copy link
Member Author

This seems nice! I think it would be better to add some documentation about how to use uv with optimum-neuron.

I'd say let's test it and use it for a while and change the whole docs once we validated the whole thing. But yes I agree!

Copy link
Collaborator

@dacorvo dacorvo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You need to fix the unconditional import of accelerate symbols when registering training automodels

@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@michaelbenayoun michaelbenayoun mentioned this pull request Dec 11, 2025
Copy link
Collaborator

@dacorvo dacorvo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I just tried the branch and uv sync reinstalls the torch CUDA version although I have the torch CPU version installed, while uv pip install behaves as expected and keeps the torch version.

Copy link
Collaborator

@dacorvo dacorvo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just one minor change 🙏

[[tool.uv.index]]
name = "pypi"
url = "https://pypi.org/simple"

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
[[tool.uv.index]]
name = "pytorch-cpu"
url = "https://download.pytorch.org/whl/cpu"
explicit = true
[tool.uv.sources]
torch = [
{ index = "pytorch-cpu" },
]
torchvision = [
{ index = "pytorch-cpu" },
]

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This will make sure we install the CPU version of pytorch

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!
Adding it.

pyproject.toml Outdated
default = true

[[tool.uv.index]]
name = "pypi"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I do not think you need the pypi index, being the default one.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove it then!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants