Skip to content

[Llama] Support attention_bias and mlp_bias config flags - #3494

Open
przemek-arch wants to merge 2 commits into
mlc-ai:mainfrom
przemek-arch:feature/llama-bias-support
Open

[Llama] Support attention_bias and mlp_bias config flags#3494
przemek-arch wants to merge 2 commits into
mlc-ai:mainfrom
przemek-arch:feature/llama-bias-support

Fix: row-parallel biases (o_proj, down_proj) for tensor parallelism

3356155
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs