Open
Description
See the relevant part of MLX LM: https://github.com/ml-explore/mlx-lm/blob/ba83487ed9ed78d60fa2a6e3dc5bd0d88d64fc33/mlx_lm/models/base.py#L45-L65
This might need an update to MLX Swift before we can use it, but it will help a lot with prompt processing for long prompts / training.
Metadata
Metadata
Assignees
Labels
No labels