Skip to content

Commit ccf8fdd

Browse files
[JSEP/WebGPU] Fixed error in softmax dispatch. (#23906)
### Description Fixed an error softmax dispatch ### Motivation and Context Produce expected results for LlaMA model
1 parent 54b2d64 commit ccf8fdd

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

js/web/lib/wasm/jsep/webgpu/ops/attention.ts

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -433,7 +433,7 @@ const createInPlaceSoftmaxProgramInfo = (
433433
getShaderSource,
434434
getRunData: () => ({
435435
outputs: [],
436-
dispatchGroup: { x: Math.ceil(totalSequenceLength / WG), y: sequenceLength, z: batchSize * numHeads },
436+
dispatchGroup: { x: 1, y: sequenceLength, z: batchSize * numHeads },
437437
programUniforms,
438438
}),
439439
};

0 commit comments

Comments
 (0)