For some testing we do with DFTK it would be really useful to be able to insert and digest data from TimerOutputs into the results from benchmarks. Ideally this should work in combination with judge also to compare between different commits.
The main motivation is that to analyse and understand performance regressions it is often very useful to us, to get access to some statistics on important internal function calls (number of times called, average time and memory etc.), which we currently trace by default using TimerOutputs.
For some testing we do with DFTK it would be really useful to be able to insert and digest data from TimerOutputs into the results from benchmarks. Ideally this should work in combination with judge also to compare between different commits.
The main motivation is that to analyse and understand performance regressions it is often very useful to us, to get access to some statistics on important internal function calls (number of times called, average time and memory etc.), which we currently trace by default using TimerOutputs.