Skip to content

Commit 9d84889

Browse files
author
root
committed
minor change
1 parent 5f369b2 commit 9d84889

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

csrc/xpu/gdn_attn/xe_2/chunk_gated_delta_rule_kernels_xe2.hpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1016,8 +1016,8 @@ CUTE_DEVICE void chunk_fwd_o_kernel(
10161016
float g_cumsum_value =
10171017
a[(chunk_offset + e) + v_head_id * total_virtual_seqlen];
10181018
g_slm_ptr[e] = g_cumsum_value;
1019-
g_multi_slm_ptr[e] = sycl::native::exp(g_last_value - g_cumsum_value);
10201019
g_exp_slm_ptr[e] = sycl::native::exp(g_cumsum_value);
1020+
g_multi_slm_ptr[e] = g_last_value_exp / g_exp_slm_ptr[e];
10211021
}
10221022

10231023
CUTE_UNROLL

0 commit comments

Comments
 (0)