Skip to content

Add scaled_masked_softmax_forward/backward for flagos backend#52

Merged
lxd-cumt merged 4 commits into
flagos-ai:mainfrom
lxd-cumt:scaled_attn_flagos
Mar 25, 2026
Merged

Add scaled_masked_softmax_forward/backward for flagos backend#52
lxd-cumt merged 4 commits into
flagos-ai:mainfrom
lxd-cumt:scaled_attn_flagos

Conversation

@lxd-cumt

Copy link
Copy Markdown
Collaborator

Add two functions for flagos backend, based on flaggems

  • scaled_masked_softmax_forward
  • scaled_masked_softmax_backend

scaled_attn_flagos

fix

debug print

fix device errors

debug print

debug print

fix device errors

fix

debug

fix

remove debug print

add scaled_masked_softmax backend func

debug print

fix

remove debug print

format

@heavyrain-lzy heavyrain-lzy left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@lxd-cumt lxd-cumt merged commit 7f788a3 into flagos-ai:main Mar 25, 2026
10 of 11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants