Split `iree-libs` into `iree-compiler` + `fusilli-libs` stages and add to Multi-Arch CI pipeline by AaronStGeorge · Pull Request #3611 · ROCm/TheRock

AaronStGeorge · 2026-02-25T18:30:15Z

Motivation

Closes: #3451

Adds IREE/fusilli related stages to the multi-arch CI pipeline and splits iree-compiler and fusilli-libs into separate build stages. iree-compiler requires an entire LLVM build, so there's a significant savings by overlapping with math-libs etc. stages.

Technical Details

Changes:

Split [build_stages.iree-libs] and [artifact_groups.iree-libs] into separate iree-compiler and fusilli-libs stages in BUILD_TOPOLOGY.toml
Added corresponding workflow jobs in multi_arch_build_portable_linux.yml

Test Plan

CI pipeline runs the new iree-compiler and fusilli-libs stages end-to-end
fusilliprovider test job fetches artifacts and runs test_fusilliprovider.py

Test Result

The fusilli build is currently OFF in TheRock, but by temporarily turning it ON we can see a successful build/test here.

Submission Checklist

Look over the contributing guidelines at https://github.com/ROCm/ROCm/blob/develop/CONTRIBUTING.md#pull-requests.

…ch CI The iree-compiler stage (~3hr LLVM build) runs parallel to math-libs, then fusilli-libs runs after both complete. This avoids blocking the IREE compiler build on math-libs while still satisfying fusilliprovider's hipdnn dependency. Changes: - BUILD_TOPOLOGY.toml: Split iree-libs stage/group into iree-compiler and fusilli-libs, with feature_group="IREE_LIBS" to preserve single toggle - multi_arch_build_portable_linux.yml: Add iree-compiler and fusilli-libs jobs - CMakeLists.txt: Remove resolved TODO, fix quoting, enable by default Resolves: #3451 Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

The fusilliprovider artifact was missing TARGET_NEUTRAL, causing it to be named with a target-specific suffix (e.g. _gfx94X-dcgpu) instead of _generic. This made the multi-arch CI artifact push fail with "No matching artifacts found" since BUILD_TOPOLOGY.toml already declared it as target-neutral. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

marbre

Not much in addition to what Scott already raised before.

Squashed roll-up of ROCm#3611 with follow-up fixes (bumps, comments, TARGET_NEUTRAL). Splits the iree-libs build stage into iree-compiler and fusilli-libs for multi-arch CI. The iree-compiler stage (potential 1hr LLVM build) runs parallel to math-libs, then fusilli-libs runs after both complete. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

marbre · 2026-03-09T23:36:43Z

 artifact_group_deps = ["hip-runtime"]
-source_sets = ["iree-libs"]
+# TODO: rocm-systems included for projects/hip/VERSION (see CMakeLists.txt)
+source_sets = ["iree-libs", "rocm-systems"]


Does IREE compiler really need projects/hip/VERSION? Furthermore, with the renaming iree-libs now only is a source set. Is there a better name for this?

It doesn't, this is a workaround for a pre-existing issue. Currently, without "rocm-systems" configure crashes during an unconditional read of projects/hip/VERSION in TheRock 's main CMakeLists.txt (before we would even get to IREE):

TheRock/CMakeLists.txt

Lines 179 to 182 in c6bc478

set(VERSION_PATH "${THEROCK_ROCM_SYSTEMS_SOURCE_DIR}/projects/hip/VERSION")

if(NOT EXISTS "${VERSION_PATH}")

message(FATAL_ERROR "Could not find HIP VERSION file: ${VERSION_PATH}")

endif()

The same pattern is included in every other base artifact group at the moment:

TheRock/BUILD_TOPOLOGY.toml

Lines 260 to 261 in c6bc478

# TODO: rocm-systems included for projects/hip/VERSION (see CMakeLists.txt)

source_sets = ["rocm-libraries", "rocm-systems", "math-libs"]

TheRock/BUILD_TOPOLOGY.toml

Lines 273 to 274 in c6bc478

# TODO: rocm-systems included for projects/hip/VERSION (see CMakeLists.txt)

source_sets = ["comm-libs", "rocm-systems"]

TheRock/BUILD_TOPOLOGY.toml

Lines 286 to 287 in c6bc478

# TODO: rocm-systems included for projects/hip/VERSION (see CMakeLists.txt)

source_sets = ["base", "rocm-systems"] # RDC uses amdsmi from core-amdsmi

It seems to me that the underlying issue + all the other stages should definitely be fixed, but it's out of scope for this PR.

Ohh... missed that.

marbre · 2026-03-09T23:37:19Z

+type = "generic"
+artifact_group_deps = ["hip-runtime", "iree-compiler"]
+# TODO: rocm-systems included for projects/hip/VERSION (see CMakeLists.txt)
+source_sets = ["iree-libs", "rocm-systems"]


As above, does this really need rocm-systems?

marbre

LGTM

github-project-automation Bot added this to TheRock Triage Feb 25, 2026

github-project-automation Bot moved this to TODO in TheRock Triage Feb 25, 2026

AaronStGeorge force-pushed the multi_arch/p025-fusilli-multi-arch-build branch 3 times, most recently from 41bc9a3 to 4303664 Compare February 26, 2026 03:44

AaronStGeorge and others added 3 commits February 27, 2026 01:10

Bump fusilli and IREE for c2y-extensions fix

cffd2ac

AaronStGeorge force-pushed the multi_arch/p025-fusilli-multi-arch-build branch from f5ddebc to b23c53b Compare February 28, 2026 01:04

AaronStGeorge commented Feb 28, 2026

View reviewed changes

Comment thread CMakeLists.txt Outdated

AaronStGeorge commented Feb 28, 2026

View reviewed changes

Comment thread build_tools/github_actions/fetch_test_configurations.py Outdated

bump

d96da8d

AaronStGeorge force-pushed the multi_arch/p025-fusilli-multi-arch-build branch from b23c53b to d96da8d Compare February 28, 2026 04:10

AaronStGeorge changed the title ~~[CI TEST] Split iree-libs into iree-compiler + fusilli-libs stages for multi-arch CI~~ Split iree-libs into iree-compiler + fusilli-libs stages and add to multi-arch CI pipeline Feb 28, 2026

AaronStGeorge changed the title ~~Split iree-libs into iree-compiler + fusilli-libs stages and add to multi-arch CI pipeline~~ Split iree-libs into iree-compiler + fusilli-libs stages and add to Multi-Crch CI pipeline Feb 28, 2026

AaronStGeorge changed the title ~~Split iree-libs into iree-compiler + fusilli-libs stages and add to Multi-Crch CI pipeline~~ Split iree-libs into iree-compiler + fusilli-libs stages and add to Multi-Arch CI pipeline Feb 28, 2026

AaronStGeorge marked this pull request as ready for review February 28, 2026 04:52

AaronStGeorge requested review from ScottTodd and marbre March 2, 2026 17:20

ScottTodd reviewed Mar 2, 2026

View reviewed changes

Comment thread .github/workflows/multi_arch_build_portable_linux.yml

Comment thread build_tools/github_actions/fetch_test_configurations.py Outdated

Comment thread iree-libs/CMakeLists.txt

Comment thread .github/workflows/multi_arch_build_portable_linux.yml Outdated

marbre reviewed Mar 3, 2026

View reviewed changes

AaronStGeorge added 3 commits March 3, 2026 20:20

re-word comment

06ea45e

add comment

736a715

Remove temporary changes

1fe5df5

AaronStGeorge force-pushed the multi_arch/p025-fusilli-multi-arch-build branch from cab9a1c to 1fe5df5 Compare March 4, 2026 13:32

AaronStGeorge requested review from ScottTodd and marbre March 4, 2026 14:23

This was referenced Mar 5, 2026

[CI Test] Build fusilli-provider from rocm-libraries #3790

Closed

Use fusilli-provider defined in rocm-libraries #3791

Merged

AaronStGeorge commented Mar 5, 2026

View reviewed changes

Comment thread .github/workflows/multi_arch_build_portable_linux.yml

marbre reviewed Mar 9, 2026

View reviewed changes

amd-shiraz self-requested a review March 10, 2026 00:44

AaronStGeorge requested a review from marbre March 10, 2026 16:04

marbre approved these changes Mar 10, 2026

View reviewed changes

AaronStGeorge merged commit 0b0813f into main Mar 10, 2026
205 of 214 checks passed

AaronStGeorge deleted the multi_arch/p025-fusilli-multi-arch-build branch March 10, 2026 22:44

github-project-automation Bot moved this from TODO to Done in TheRock Triage Mar 10, 2026

AaronStGeorge mentioned this pull request Mar 11, 2026

[Plugin] Enable fusilli plugin build in TheRock iree-org/fusilli#57

Closed

ScottTodd mentioned this pull request Mar 13, 2026

Adding OSS rocprof trace decoder #3723

Merged

1 task

	set(VERSION_PATH "${THEROCK_ROCM_SYSTEMS_SOURCE_DIR}/projects/hip/VERSION")
	if(NOT EXISTS "${VERSION_PATH}")
	message(FATAL_ERROR "Could not find HIP VERSION file: ${VERSION_PATH}")
	endif()

	# TODO: rocm-systems included for projects/hip/VERSION (see CMakeLists.txt)
	source_sets = ["rocm-libraries", "rocm-systems", "math-libs"]

	# TODO: rocm-systems included for projects/hip/VERSION (see CMakeLists.txt)
	source_sets = ["comm-libs", "rocm-systems"]

	# TODO: rocm-systems included for projects/hip/VERSION (see CMakeLists.txt)
	source_sets = ["base", "rocm-systems"] # RDC uses amdsmi from core-amdsmi

Conversation

AaronStGeorge commented Feb 25, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Motivation

Technical Details

Test Plan

Test Result

Submission Checklist

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

marbre left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

marbre Mar 9, 2026

Choose a reason for hiding this comment

Uh oh!

AaronStGeorge Mar 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

marbre Mar 10, 2026

Choose a reason for hiding this comment

Uh oh!

marbre Mar 9, 2026

Choose a reason for hiding this comment

Uh oh!

AaronStGeorge Mar 10, 2026

Choose a reason for hiding this comment

Uh oh!

marbre left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

AaronStGeorge commented Feb 25, 2026 •

edited

Loading

AaronStGeorge Mar 10, 2026 •

edited

Loading