Open
Description
When we add new benchmarks, we typically don't run them on old artifacts, but we could (at least to a certain point in history). While this might not bring a ton of insight when adding regression focused benchmarks (e.g., stress tests), it would likely be very useful when adding new "real world" crates.