Problems Running Documentation Example

[Aatman09]

Hello,

I am facing multiple issues while following the Tunix documentation for learning Supervised Fine-Tuning (SFT).
path - "examples/qlora_llama3_gpu.ipynb"

1. tunix not found after installation

   When I install the dependencies (especially qwix), the program asks me to restart the session. After restarting, I run the Imports cell and get: ModuleNotFoundError: No module named 'tunix'

   I then run: !pip install tunix

   It shows Requirement already satisfied, but running the Imports cell again still shows tunix not found. This repeats in a loop.However, if I continue running the following cells, they execute successfully.

2. There is no Automodel in the tunix.models.automodel api

3. Use of old Hugging Face APIs

   It appears that Tunix may be using outdated Hugging Face APIs such as: huggingface_hub_v1.api Instead of the current: from huggingface_hub import whoami Could you please confirm whether the library has been updated to use the latest `huggingface_hub API ?

I have tried to run the notebook in google colab , kaggle as well locally on my laptop , this problem occurs in each case

I would appreciate guidance on resolving these issues. @abheesht17 @rajasekharporeddy

Thank you.

Environment

• OS: PRETTY_NAME="Ubuntu 22.04.5 LTS" NAME="Ubuntu" VERSION_ID="22.04"
• Project Version: [e.g., 0.0.1]

Checklist

• I have searched the existing issues for a similar bug report.
• I have provided all the required information in the "Environment" section.
• I have provided a minimal, reproducible example.

Would you like to help us fix it?

Yes , if someone could guide me

[Aatman09]

Would you like me to work on this ??

[rajasekharporeddy]

Hi @Aatman09

Thank you for reporting this issue. To resolve the errors you encountered, please follow the steps below.

1. To address the first two issues, you can install the latest version of Tunix directly from the GitHub repository along with its required dependencies by executing the following commands in your environment:

!pip install 'jax[cuda13]' flax optax transformers datasets qwix
!pip install git+https://github.com/google/tunix

2. Regarding the Hugging Face API error, yes you can import whoami with the following command:

from huggingface_hub import whoami

3. Use the following 2 commands to fix the Error: You must call wandb.init() before wandb.log() while running the Test inference section.

import wandb
wandb.init()

Please find the attached colab gist of the working notebook.

Please let me know if you encounter any further difficulties after applying these changes.

[Aatman09]

Thank you for such a fast response. I will check it out and let you know