logit_bias support for NEW_UNSHARDED_ATTN_KERNEL#24

Open

HahTK wants to merge 6 commits intolow_tpfrom

Commits on Nov 11, 2024

Upacst logits for accuracy metric computation to fp32
HahTK
committed

Commits on Nov 14, 2024

Generalize some model config parameters and update related scripts
HahTK
committed

Commits on Nov 25, 2024

Add logit bias to new unsharded_attention_kernel only. Legacy kernels do not have support for logit_bias
thiamha
committed

Commits on Nov 27, 2024

Merge branch 'low_tp' into low_tp_lr
HahTK
authored

Commits on Dec 4, 2024

Update logit bias support to match latest flash_attention kernel
thiamha
committed
Fixed typo in assert
thiamha
committed