Running multiple Locust scenarios from a CSV & comparing reports visually

[dev-vaayen]

I’ve been using Locust for a while but I kept hitting a bit of a productivity wall. Whenever I needed to test multiple scenarios with different parameters (users, spawn rates, durations), I found myself stuck in a tedious loop:

Change config --> Run --> Wait --> Repeat --> Pray I didn't lose track of which report is which. 

On top of that, comparing generated reports across different load scenarios felt like a bit of a chore. I figured there had to be a better way to orchestrate this, so I've been working on a small CLI tool to handle this stuff.

What it does right now:

• Batch Execution: Runs multiple Locust tests directly from a CSV in headless mode
• Automatic Storage: Generates and organises HTML reports with proper timestamps
• Native Compatibility: It runs Locust under the hood, so the usual flags and configs still work perfectly

How To:

Just define the load scenarios in a plan.csv:

users,spawn_rate,duration
100,10,2m
500,50,5m
200,20,3m

And just run:

locust-orchestrator --plan plan.csv --host <url>

Next Plan

Adding a simple dashboard (likely using Streamlit) to compare multiple test runs and their graphical reports, more easily.

I would also look into storing the test results in a DB (likely SQLite) for history maintenance.

Please consider sharing your feedback and views on this and if you have any concerns regarding this.

[cyberw]

Cool stuff! You could integrate this more tightly into Locust, using this approach https://docs.locust.io/en/stable/use-as-lib.html (not sure if it is worth the work though)