Skip to content

[sim_costmodel](feat) auto scope is working on solve_tril - #1764

Open
kaixin1976 wants to merge 4 commits into
triton-lang:feature/simd-simt-compile-modefrom
kaixin1976:feature/simd-simt-compile-mode
Open

[sim_costmodel](feat) auto scope is working on solve_tril #1764
kaixin1976 wants to merge 4 commits into
triton-lang:feature/simd-simt-compile-modefrom
kaixin1976:feature/simd-simt-compile-mode

Conversation

@kaixin1976

@kaixin1976 kaixin1976 commented Aug 25, 2026

Copy link
Copy Markdown
Collaborator
  1. auto scope is working on solve_tril and offer 12% perf improvement
  2. sove_tril , fbgemm, gather_dot_min all corrected evaluated .
  3. migrate auto blockify v1 from NPUIR to TA, so that cost model could evaluate cost based on blockified loops ,
    scope local super block is able to work based on the loops .
  4. add in row-coalescing mechanism as part of layout optimization , so that FBGEMM could reproduce historical best performance record .
  5. add 3 UT case to CI to guard the perforce of cost model and simd_simt mixed mode compiling .
  6. remove duplicated / Invalid code to make the code easier to read , now effective code lines of simt cost model is below 4997, physically is still 5885 lines , still need to be reduced .
  7. support delayed GSS
  8. support sublocks
  9. removed phase concept

New contributor declaration

  • I am not making a trivial change, such as fixing a typo in a comment.

  • I have written a PR description following these
    rules.

  • I have run pre-commit run --from-ref origin/main --to-ref HEAD.

  • Select one of the following.

    • I have added tests.
      • /test for lit tests
      • /unittest for C++ tests
      • /python/test for end-to-end tests
    • This PR does not need a test because FILL THIS IN.
  • Select one of the following.

    • I have not added any lit tests.
    • The lit tests I have added follow these best practices,
      including the "tests should be minimal" section. (Usually running Python code
      and using the instructions it generates is not minimal.)

@github-actions github-actions Bot added documentation Improvements or additions to documentation compiler Changes to C/C++ compiler backend (lib/, include/) python Changes to Python runtime or bindings ascend-backend Changes to the Ascend NPU backend labels Aug 25, 2026
@kaixin1976
kaixin1976 force-pushed the feature/simd-simt-compile-mode branch 2 times, most recently from 5e83a28 to 3345d9f Compare August 29, 2026 03:21
@kaixin1976 kaixin1976 changed the title [sim_costmodel](featyre) auto scope is working on solve_tril and offer 12% perf improvement [sim_costmodel](feature) auto scope is working on solve_tril and offer 12% perf improvement Aug 29, 2026
@kaixin1976 kaixin1976 changed the title [sim_costmodel](feature) auto scope is working on solve_tril and offer 12% perf improvement [sim_costmodel](feature) auto scope is working on solve_tril Aug 29, 2026
@kaixin1976 kaixin1976 changed the title [sim_costmodel](feature) auto scope is working on solve_tril [sim_costmodel](feat) auto scope is working on solve_tril Aug 29, 2026
@kaixin1976
kaixin1976 force-pushed the feature/simd-simt-compile-mode branch 2 times, most recently from bb2af3a to 53aef67 Compare August 29, 2026 06:16
@kaixin1976

Copy link
Copy Markdown
Collaborator Author

/retry

@kaixin1976
kaixin1976 force-pushed the feature/simd-simt-compile-mode branch 4 times, most recently from 50519ad to 8982333 Compare September 3, 2026 03:02
@kaixin1976
kaixin1976 force-pushed the feature/simd-simt-compile-mode branch from 8982333 to 9b9edc1 Compare September 3, 2026 03:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ascend-backend Changes to the Ascend NPU backend compiler Changes to C/C++ compiler backend (lib/, include/) documentation Improvements or additions to documentation python Changes to Python runtime or bindings

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant