Skip to content

Expose export_llama.py as a library or function able to be called and imported in Python #7695

Open
@ProjectProgramAMark

Description

🚀 The feature, motivation and pitch

It would be nice to be able to call the code in examples/models/llama/export_llama.py as a function. That way, this can be fit into the workflow of a larger pipeline. For example, if one needs to fine tune llama using HuggingFace Transformers, merge adapters into the model, then convert hf .safetensors to checkpoint.pth, then finally export to .pte, it would be convenient to be able to call this last part.

Alternatives

No response

Additional context

No response

RFC (Optional)

No response

Metadata

Assignees

Labels

enhancementNot as big of a feature, but technically not a bug. Should be easy to fixfeatureA request for a proper, new feature.module: user experienceIssues related to reducing friction for users

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions