Skip to content

docs(int4): replace legacy llama mirror in examples#338

Open
glennko wants to merge 1 commit intomainfrom
issue-287-legacy-llama-docs
Open

docs(int4): replace legacy llama mirror in examples#338
glennko wants to merge 1 commit intomainfrom
issue-287-legacy-llama-docs

Conversation

@glennko
Copy link
Member

@glennko glennko commented Mar 2, 2026

Summary:

  • Replaces the legacy aleksickx/llama-7b-hf example checkpoint with Qwen/Qwen2.5-0.5B in the INT4 notebook and advanced any-model docs.
  • Adds compatibility guidance that legacy mirrored checkpoints can fail on newer transformers versions.
  • Updates the INT4 README note to direct users to maintained checkpoints.

Validation:

  • python -m json.tool examples/features/int4_finetuning/LLaMA_lora_int4.ipynb >/dev/null
  • docs build was not run in this branch because docs dependencies are not installed in the ephemeral worktree environment.

Closes #287

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

RecursionError: maximum recursion depth exceeded while calling a Python object

1 participant