Dynamic sparse attention #22
Description
Implement and benchmark blocked dynamic sparse attention modules and metal kernels, as well as a custom paged KV-cache
{{ message }}
Implement and benchmark blocked dynamic sparse attention modules and metal kernels, as well as a custom paged KV-cache