Skip to content

Commit 85fe24b

Browse files
author
bjmsong
committed
minor
1 parent d6682c7 commit 85fe24b

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

python/sgl_jax/srt/multimodal/layers/visual_embedding.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -361,8 +361,8 @@ def __init__(
361361
kernel_axes=("tensor", None),
362362
)
363363
self.act_fn = act_fn
364-
if act_fn == "gelu_tanh":
365-
self.act_1 = modeling_flax_utils.ACT2FN["gelu_pytorch_tanh"]
364+
if act_fn == "silu":
365+
self.act_1 = modeling_flax_utils.ACT2FN["silu"]
366366
else:
367367
raise ValueError(f"Unknown activation function: {act_fn}")
368368

0 commit comments

Comments
 (0)