Open
Description
I'm running the code here: https://docs.flashinfer.ai/generated/flashinfer.prefill.single_prefill_with_kv_cache_return_lse.html
It complains this:
TypeError: single_prefill_with_kv_cache() got an unexpected keyword argument 'use_fp16_qk_reduction'
It seems the api has changed but the documentation hasn't.
Metadata
Assignees
Labels
No labels
Activity