Although Apache Hop already persists execution data, the current experience focuses on static logs, not performance analysis. When optimizing a pipeline, the developer needs to manually check previous executions, note the metrics, and mentally compare them to the current execution. There is no integrated way to visualize the evolution or real gains achieved after an adjustment.
I propose transforming the "Execution Information" tab into a Performance Benchmarking tool within the interface:
Side-by-Side Comparison: The ability to select two executions and immediately see the difference (Δ) in duration and throughput for each transformation.
Trend Visualization: A simple dashboard or graph integrated into the tab, showing the performance trend of the last 10 to 20 executions.
Optimization Feedback: A clear indicator (e.g., Green/Red) showing whether a recent change has actually improved the specific bottleneck being addressed.
The goal is to move beyond simply "storing data" and start "providing insights," allowing developers to validate their optimizations directly within the Hop interface.
Although Apache Hop already persists execution data, the current experience focuses on static logs, not performance analysis. When optimizing a pipeline, the developer needs to manually check previous executions, note the metrics, and mentally compare them to the current execution. There is no integrated way to visualize the evolution or real gains achieved after an adjustment.
I propose transforming the "Execution Information" tab into a Performance Benchmarking tool within the interface:
Side-by-Side Comparison: The ability to select two executions and immediately see the difference (Δ) in duration and throughput for each transformation.
Trend Visualization: A simple dashboard or graph integrated into the tab, showing the performance trend of the last 10 to 20 executions.
Optimization Feedback: A clear indicator (e.g., Green/Red) showing whether a recent change has actually improved the specific bottleneck being addressed.
The goal is to move beyond simply "storing data" and start "providing insights," allowing developers to validate their optimizations directly within the Hop interface.