Now that we have CI configured and automated submodule updates via Dependabot, it'd be interesting to hack together some kind of basic regression testing for our implemented workers. Something like this:
- We run the mishegos for a few hours to generate a decently sized corpus
- We run that corpus through our analysis passes to filter out true positives and negatives
- We save the filtered corpus somewhere (cloud storage?)
- On each Dependabot PR, we perform additional CI jobs to see if any of our results have changed
Now that we have CI configured and automated submodule updates via Dependabot, it'd be interesting to hack together some kind of basic regression testing for our implemented workers. Something like this: