SME1 kernel support for AI workloads using ArmNN

[hpc-qti]

Hi @morgolock,

In continuation to the PR 1206
Need support for SME1 kernels in ComputeLibrary in arm_gemm

AI workloads using ArmNN library needs SME1 equivalent kernels in ComputeLibrary. This enables SME based acceleration for applications like Geekbench AI workloads - computer vision tests, NLP tests etc.

Below is the list of kernels identified that will be needed for the above use-case.

sme1_interleaved_nomerge_bf16fp32_mopa_1VLx4VL
sme1_interleaved_nomerge_bf16fp32_mopa_2VLx2VL
sme1_interleaved_nomerge_bf16fp32_mopa_4VLx1VL
sme1_interleaved_nomerge_fp16fp32_mopa_1VLx4VL
sme1_interleaved_nomerge_fp16fp32_mopa_2VLx2VL
sme1_interleaved_nomerge_fp16fp32_mopa_4VLx1VL
sme1_interleaved_nomerge_fp16fp32fp16_mopa_1VLx4VL
sme1_interleaved_nomerge_fp16fp32fp16_mopa_2VLx2VL
sme1_interleaved_nomerge_fp16fp32fp16_mopa_4VLx1VL
sme1_interleaved_nomerge_s8q_mopa_1VLx4VL
sme1_interleaved_nomerge_s8q_mopa_2VLx2VL
sme1_interleaved_nomerge_s8q_mopa_4VLx1VL
sme1_interleaved_nomerge_s8qfp32_mopa_1VLx4VL
sme1_interleaved_nomerge_s8qfp32_mopa_2VLx2VL
sme1_interleaved_nomerge_s8qfp32_mopa_4VLx1VL
sme1_interleaved_nomerge_s8s32_mopa_1VLx4VL
sme1_interleaved_nomerge_s8s32_mopa_2VLx2VL
sme1_interleaved_nomerge_s8s32_mopa_4VLx1VL
sme1_interleaved_nomerge_u8q_mopa_1VLx4VL
sme1_interleaved_nomerge_u8q_mopa_2VLx2VL
sme1_interleaved_nomerge_u8q_mopa_4VLx1VL

sme1_gemv_bf16fp32_dot_16VL
sme1_gemv_fp16_mla_16VL
sme1_gemv_fp16fp32fp16_dot_16VL
sme1_gemv_fp32_mla_16VL
sme1_gemv_fp32bf16fp32_dot_16VL
sme1_gemv_s8qa_dot_16VL
sme1_gemv_u8qa_dot_16VL

[morgolock]

Hi @hpc-qti

Thanks for raising this, I'll discuss it with the team.

[hpc-qti]

Hi @morgolock ,
Is there any update on this request?

[morgolock]

Hi @hpc-qti

When do you need these kernels?

I checked with the team, we're in the middle of a project reorganisation, so it’s hard to say when we’ll be able to deliver these kernels in ACL.

Hope this helps.

[hpc-qti]

Hi @morgolock ,

Thanks for the response. Since there is a tool to generate the kernels, can you help to provide the kernels by this month(Dec 2025)?

[morgolock]

HI @hpc-qti

Thanks, I'll discuss it with the team and see if we can land these kernels in December. As I explained previously, we are in the middle of project reorganization which means this could take longer than expected.

Thanks