-The accuracy phase launches `pytest tests/pytest -m <operator marker> --mode quick|normal --record json --output <op>/accuracy_result.json` and uses synthetic CUDA data. The performance phase launches the configured `tests/test_*.py` benchmark command for each operator; MatrixMarket-backed commands receive `--benchmark-input` (default `tests/data`, or pass `matrix` for the local matrix directory), and the CSV output is also normalized into a FlagGems-style `<op>/performance_result.json`. Results are written under `pytest_results_<timestamp>/` unless `--results-dir` is provided. Each operator directory contains `accuracy_stdout.log`, `accuracy_stderr.log`, `accuracy_result.json`, `accuracy_detail.json`, `performance_stdout.log`, `performance_stderr.log`, `performance.csv`, `performance_result.json`, and `performance_detail.json` when those phases run. The root `summary.json` uses the FlagGems `timestamp` / `env` / `result` structure. FlagSparse-only fields such as GPU id, commands, logs, totals, parsed pytest cases, and normalized benchmark records are kept in `summary_flat.json` and the per-operator `*_detail.json` files. `summary.csv` and optional `summary.xlsx` provide table-friendly views, and `result.html` is generated automatically for browser inspection.
0 commit comments