[Infra][Tracking] Compiler Tooling & Autonomous Optimization Roadmap

[copparihollmann]

Context

To accelerate development, we are building a "Golden Path" tooling suite that manages our complex build matrix (Host/ASAN/RISC-V) and enables autonomous optimization. We are moving beyond manual tuning by integrating agentic workflows for heuristic discovery (Magellan), micro-kernel synthesis (Autocomp), and root-cause analysis (RLM).

Objective

Establish a unified framework that automates:

1. Core Infra: Build configuration, boilerplate generation, and standardized Agent interfaces (MCP).
2. Debugging: Structural crash isolation and RLM-based explanation.
3. Knowledge: Mining historical compiler fixes ("Recipes") to teach the agent.
4. Autonomous Research: Evolutionary search for heuristics and beam search for micro-kernels.

Tracking List

Phase 1: Core Tooling & Infrastructure

• [Infra][Build] Unified Multi-Target Build Manager #6
• [Tools][Dialect] MLIR Dialect & Transform Generator #11
• [Tools][Debug] MLIR Provenance Tracer & RLM analysis #10
• [Infra][HIL] Hardware-in-the-Loop Profiling Rig #9

Phase 2: Autonomous Optimization (Research)

• [Research][Magellan] Autonomous Heuristic Discovery Engine #7
• [Research][Autocomp] Automated Ukernel Synthesis Agent #8

Phase 3: Agent Integration & Memory

• [Infra][Knowledge] Compiler Recipe Mining & Cookbook Pipeline #13