Skip to content

Add Diode Inductor max-autotune benchmarks to gemm, addmm, bmm#758

Open
jananisriram wants to merge 1 commit intomainfrom
export-D89398916
Open

Add Diode Inductor max-autotune benchmarks to gemm, addmm, bmm#758
jananisriram wants to merge 1 commit intomainfrom
export-D89398916

Conversation

@jananisriram
Copy link
Copy Markdown
Contributor

Summary:
Add Inductor max-autotune benchmarking using Diode to TritonBench for the gemm, addmm, and bmm operators. This diff reduces friction in verifying Diode results against the base max-autotune results.

NOTE: The TritonBench benchmark currently includes the overhead of setting up and tearing down Diode within the benchmark, i.e. metrics like tflops and latency. Actual Diode benchmarking numbers should be slightly better than what TritonBench reports.

Differential Revision: D89398916

@meta-codesync
Copy link
Copy Markdown

meta-codesync Bot commented Dec 23, 2025

@jananisriram has exported this pull request. If you are a Meta employee, you can view the originating Diff in D89398916.

Summary:

Add Inductor max-autotune benchmarking using Diode to TritonBench for the `gemm`, `addmm`, and `bmm` operators. This diff reduces friction in verifying Diode results against the base max-autotune results.

NOTE: The TritonBench benchmark currently includes the overhead of setting up and tearing down Diode within the benchmark, i.e. metrics like tflops and latency. Actual Diode benchmarking numbers should be slightly better than what TritonBench reports.

Differential Revision: D89398916
@@ -0,0 +1,44 @@
"""Diode (ML model for pruning autotuning configs) utils for TritonBench operators."""

import diode.torch_diode.config as diode_config
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Might wanna try the with try_import("HAS_DIODE"): pattern here. https://github.com/meta-pytorch/tritonbench/blob/main/tritonbench/operators/gemm/operator.py#L34

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah second Nikhil here, diode will not always exist in OSS env and this will cause issues.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants