SparseFA implementation code not found.

[yuqiha]

🚀 The feature, motivation and pitch

During the Triton Next technical conference, it was stated that TLE achieved over an 8× performance improvement on SparseFA by optimizing key operators. However, we could not find the TLE-optimized SparseFA code in the repository. Could you please let us know where this code can be found?

Alternatives

No response

Additional context

No response

[sgjzfzzf]

@sunnycase Could you please take a look at this?

[sunnycase]

Sorry for the delayed response. The operator is located here: https://github.com/flagos-ai/FlagTree/blob/triton_v3.2.x/python/tutorials/tle/01-sparse-flash-attn-tle.py