Running finetuned models with moshi_mlx

[amritamaz]

Due diligence

• I have done my due diligence in trying to find the answer myself.

Topic

The MLX implementation

Question

Hi, I have trained some finetuned models (lora) and would like to run them using the moshi_mlx local web UI. Is there any way I can convert my lora checkpoints to something mlx-compatible?

[manukyutai]

If you trained with save_adaptes=False, you should get your merged checkpoint in the end and then you can make it mlx with this