Skip to content

fix the predefined llama model name#8

Merged
dongwang218 merged 1 commit intomainfrom
dong/fix_model_name
Apr 17, 2025
Merged

fix the predefined llama model name#8
dongwang218 merged 1 commit intomainfrom
dong/fix_model_name

Conversation

@dongwang218
Copy link
Contributor

Why ?

wrong model name prevent deploy

How ?

somehow we are using "meta-llama/Meta-Llama-3.1-8B-Instruct", which is not recognized by huggingface.

Test plan

matrix deploy_applications --applications "[{'model_name': 'meta-llama/Llama-3.1-8B-Instruct', 'min_replica': 8}]"

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Apr 17, 2025
@dongwang218 dongwang218 requested a review from yangli5t April 17, 2025 02:21
@dongwang218 dongwang218 merged commit 3d5f62e into main Apr 17, 2025
5 checks passed
@dongwang218 dongwang218 deleted the dong/fix_model_name branch April 17, 2025 16:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants