File tree 3 files changed +64
-0
lines changed
3 files changed +64
-0
lines changed Original file line number Diff line number Diff line change
1
+ # Tests for the expected workflow log messages
2
+
3
+ Feature : Log messages
4
+
5
+ As a researcher,
6
+ I want to be able to see the log messages of my workflow execution,
7
+ So that I can verify that the workflow ran correctly.
8
+
9
+ Scenario : The compilation step has produced the expected messages
10
+ When the workflow is finished
11
+ Then the engine logs should contain
12
+ """
13
+ Publishing step:0, cmd: g++ -v -O3 -o dimuonSpectrum dimuonSpectrum.C `root-config --cflags --libs`
14
+ """
15
+
16
+ Scenario : The data analysis step has produced the expected messages
17
+ When the workflow is finished
18
+ Then the job logs for the "run" step should contain
19
+ """
20
+ Events with exactly two muons: pass=31104343 all=61540413 -- eff=50.54 % cumulative eff=50.54 %
21
+ Muons with opposite charge: pass=24067843 all=31104343 -- eff=77.38 % cumulative eff=39.11 %
22
+ """
23
+ And the job logs for the "run" step should contain
24
+ """
25
+ Info in <TCanvas::Print>: pdf file dimuonSpectrum.pdf has been created
26
+ """
27
+ And the engine logs should contain "Publishing step:1, cmd: ./dimuonSpectrum"
Original file line number Diff line number Diff line change
1
+ # Tests for the workflow execution duration time
2
+
3
+ Feature : Run duration
4
+
5
+ As a researcher,
6
+ I want to verify that my workflow finishes in a reasonable amount of time,
7
+ so that I can stay assured that there are no unusual problems with computing resources.
8
+
9
+ Scenario : The workflow terminates in a reasonable amount of time
10
+ When the workflow execution completes
11
+ Then the workflow run duration should be less than 5 minutes
12
+
13
+ Scenario : The compilation step takes a reasonable amount of time
14
+ When the workflow is finished
15
+ Then the duration of the step "compile" should be less than 3 minutes
16
+
17
+ Scenario : The step in which the analysis is run takes a reasonable amount of time
18
+ When the workflow is finished
19
+ Then the duration of the step "run" should be less than 3 minutes
Original file line number Diff line number Diff line change
1
+ # Tests for the presence of files in the workspace
2
+
3
+ Feature : Workspace files
4
+
5
+ As a researcher,
6
+ I want to make sure that my workflow produces expected files,
7
+ and that all the necessary input files are present in the workspace,
8
+ so that I can be sure that the workflow outputs are correct.
9
+
10
+ Scenario : The workspace contains all the relevant input files
11
+ When the workflow execution completes
12
+ Then the workspace should include "dimuonSpectrum.C"
13
+
14
+ Scenario : The analysis produces the expected output file
15
+ When the workflow is finished
16
+ Then the workspace should include "dimuonSpectrum.pdf"
17
+ And the size of the file "dimuonSpectrum.pdf" should be between "180 KiB" and "190 KiB"
18
+ And all the outputs should be included in the workspace
You can’t perform that action at this time.
0 commit comments