Expose export_llama.py as a library or function able to be called and imported in Python #7695
Open
Description
🚀 The feature, motivation and pitch
It would be nice to be able to call the code in examples/models/llama/export_llama.py
as a function. That way, this can be fit into the workflow of a larger pipeline. For example, if one needs to fine tune llama using HuggingFace Transformers, merge adapters into the model, then convert hf .safetensors
to checkpoint.pth
, then finally export to .pte
, it would be convenient to be able to call this last part.
Alternatives
No response
Additional context
No response
RFC (Optional)
No response
Metadata
Assignees
Labels
Type
Projects
Status
To triage