You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: benchmarking/README.md
+16-3Lines changed: 16 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -39,13 +39,26 @@ a server on
39
39
1. Make sure that you have dataset folders as configured in the evobench config file (`evobench-run.ron`); see [Offer dataset versioning #32](https://github.com/GenSpectrum/evobench/issues/32) for the required folder structure. Each versioned dataset folder needs these files (or symlinks to them):
40
40
41
41
database_config.yaml
42
-
good-api-query-log.csv
43
-
ignore_queries_for_checksum_regex.txt
44
42
input_file.ndjson.zst
45
43
possibly: lineage_definitions.yaml
46
44
preprocessing_config.yaml
45
+
queries/ignore_queries_for_checksum_regex.txt
46
+
queries/queries.ndjson
47
47
reference_genomes.json
48
-
silo_queries.ndjson
48
+
49
+
Note that a file `queries/good-api-query-log.csv` is automatically
50
+
stored upon the first benchmarking run; it is assumed to contain
51
+
the proper checksums. Later runs compare against that file and
52
+
flag differences that are not ignored via the regex in
53
+
`ignore_queries_for_checksum_regex.txt` (leave empty to not ignore
54
+
anything) as errors. If that happens, you are to check which
55
+
version is legit, or ignore those queries via the regex. The regex
56
+
syntax is the one supported by [Rust's regex
57
+
crate](https://docs.rs/regex/1.12.2/regex/).
58
+
59
+
If you use the `QUERIES` evobench custom variable (i.e. env
60
+
variable), which names a subfolder, you need to provide a
61
+
corresponding alternative folder to the `queries/` folder.
49
62
50
63
1. Run an instance of a daemon, `evobench-run --verbose run daemon`
51
64
(the `--verbose` allows you to see what's going on, feel free to
0 commit comments