Skip to content

Add benchmark and --stats - #451

Merged
joverlee521 merged 4 commits into
masterfrom
benchmarks-stats
Jun 18, 2024
Merged

Add benchmark and --stats #451
joverlee521 merged 4 commits into
masterfrom
benchmarks-stats

Conversation

@joverlee521

Copy link
Copy Markdown
Contributor

Description of proposed changes

Add benchmark for all Snakemake rules and use --stats to get more data for #446.

I plan on merging tomorrow morning before the automated workflow runs at ~11am PT.

Related issue(s)

Resolves #240
Gathering stats for #446

Checklist

  • Checks pass

Adding as part of #240 to help collect more data for tackling #446.

One unexpected behavior that I ran into when testing the `--stats`
option is that Snakemake doesn't generate the stats file if the
workflow exits with an error at any step.

Note that the Snakemake `--stats` option is not available starting with
Snakemake v8, so this will need to be removed when we eventually
upgrade Snakemake in our runtimes.
Adding as part of #240 to help collect more data for tackling #446.
The use of `shellquote` was removed in 2dab1f9.
Per Nextstrain's Snakemake style guide, using the `message` directive
overrides the default Snakemake outputs which includes other critical
details.

<https://docs.nextstrain.org/en/latest/reference/snakemake-style-guide.html#avoid-the-message-rule-attribute>
@joverlee521
joverlee521 requested a review from a team June 17, 2024 23:20
@joverlee521
joverlee521 merged commit f5f238b into master Jun 18, 2024
@joverlee521
joverlee521 deleted the benchmarks-stats branch June 18, 2024 16:37

@huddlej huddlej left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I love benchmarks! +1 for their inclusion in our Snakemake style guide, @joverlee521.

@joverlee521

Copy link
Copy Markdown
Contributor Author

I love benchmarks! +1 for their inclusion in our Snakemake style guide, @joverlee521.

I merged nextstrain/docs.nextstrain.org#210 yesterday, but it's not available in our latest docs yet because RTD build is currently failing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Profile ncov-ingest

2 participants