Skip to content

Commit b76a7d3

Browse files
committed
Merge branch 'ko3n1g/fix/gelu' into 'main'
fix: GeLUFunction See merge request ADLR/megatron-lm!1993
2 parents 50b073c + f61d22c commit b76a7d3

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

megatron/core/fusions/fused_bias_gelu.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -49,7 +49,7 @@ def backward(ctx, grad_output):
4949
# This is required to make Sphinx happy :-(
5050
@classmethod
5151
def apply(cls, *args, **kwargs):
52-
super().apply(*args, **kwargs)
52+
return super().apply(*args, **kwargs)
5353

5454

5555
bias_gelu_impl = GeLUFunction.apply

0 commit comments

Comments
 (0)