Skip to content

Commit dec66ea

Browse files
nvnieuwkmvheetve
andauthored
v0.1.0 pipeline release (#80)
* Birth of a pipeline (#2) * cleaned up the code and docs before starting * cleaned up the github actions * cleaned some more code * removed unused pipeline code * added an easily adjustable input checker * removed some CI * added the variant callers * linting * tests update * ci update * linting * linting * linting * turned off actions * added read counts + delly updates * added scatter count to delly call * added versions and multiqc * updated the manta workflow * updated the whamg workflow * added versions to whamg * added some additional test data * updated the test data * updated the test data * updated the test data * updated the test data * overal updates and improvements * small updates * small updates * metrics part 1 * metrics part 2 * Module evidence qc (#3) * make bincov matrix part 1 * added ploidy and parts of calcmedcov * added WGD * removed delly and added a reheader to MANTA * added all code to the module (some parts are still broken) * small updates * small ploidy matrix fix * small updates to evidenceQC + re-added delly * Module gather batch evidence (#4) * added groundwork for the module * added groundwork for the module * more work done * removed commented lines * Continue module gather batch evidence (#19) * printsvevidence update (not done yet) * restructured the pipeline to match nf-core v2.6 * updated module paths * some small "improvements" * Template update for nf-core/tools version 2.6 * additional fixes to the template * removed wrong file * Added clarifying comments to GSE * updated some of the modules to 4.3.0.0 * fixed some issues caused by gatk4.3.0.0 * latest additions * Refactoring (#20) * refactored gather sample evidence * refactor the rest * New series of fixes and features (#21) * update whamg * update local tests * updated whamg officially * updated whamg + fixed svtk standardize * small work on scramble (still no correct data for this tool) * updated schema * improved whamg bed file integration * added a merge vcfs subworkflow * small fix * update test config * added the samplesheet validation and conversion script * hotfix dev test (#22) * Add smoove & tests (#23) * Template update for nf-core/tools version 2.6 * hotfix dev test * fixed a lot of issues * added smoove * updated the schema * fix samplesheet and schema * add better outdir folders * add tests * tests fix * fix secrets * fix typo * add more tests * add template yml * Template update for nf-core/tools version 2.7.2 * fixes after template merge * linting * more linting * even more linting * black * Refactor the pipeline to prepare for subworkflow export to nf-core (#24) * refactored the pipeline * remove unused modules * removed unused workflows * Add gridss (#25) * refactored the pipeline * remove unused modules * removed unused workflows * add gridss * add stub to local modules * fix stubs * fully add gridss * add tests * copy fix? * add gridss test to ci * exclude gridss vcfs from metrics (not supported) * update min nextflow version to fix caching issue * update gridss * remove TODOs [no ci] * Add genotyping (#26) * update scattering * update delly * bump commit * add --output_callers parameter * small fix to --output_callers * fix schema and test config * removed reheadering from manta * update bcftools/sort * update bcftools/sort * update headers after jasmine merge * small fix * finished genotyping * fix for paragraph/multigrmpy * updated the samplesheet conversion * removed some unused modules * add merging of samples from the same family * removed scattering from whamg * Updated jasmine (added support for bgzip to the module) * fix prettier * fix tests * fix tests again and remove black CI * add linting ci to nf-core.yml * Adopted SVINSSEQ as uniform ins sequence info key * disabled whamg for now * add missing format header * add patch for delly * fix header typo * remove local test profile * updated test profiles and added big tests * add delly args * add new args to schema and config * Add annotation + viola + join checks + cleanup (#29) * add join checks * fix delly mismatches * Added viola * fix header issues in single caller runs * header fix? * appease eclint * add stub to reverse_bed * fix for gridss? * appease eclint again! * typo * fix permissions * fix shebang * fix shebang again * disable gridss * fix tests * remove old code from gatk-sv * Add VEP to the pipeline * add some QOL parameters * update tests * QOL changes (variables and joins) * disable scattering for delly * remove unused gatk modules * update modules * made BED files optional * add metro map and update readme * forgot to save svg * fix linting * fix vep test * free up CI space? * use another cache for vep * edit PosCon3 samplesheet_big.csv (#30) * Add bcftools sort (#31) * add join checks * fix delly mismatches * Added viola * fix header issues in single caller runs * header fix? * appease eclint * add stub to reverse_bed * fix for gridss? * appease eclint again! * typo * fix permissions * fix shebang * fix shebang again * disable gridss * fix tests * remove old code from gatk-sv * Add VEP to the pipeline * add some QOL parameters * update tests * QOL changes (variables and joins) * disable scattering for delly * remove unused gatk modules * update modules * made BED files optional * add metro map and update readme * forgot to save svg * fix linting * fix vep test * free up CI space? * use another cache for vep * add bcftools sort * fix smoove output (#33) * fix smoove output * update according to other modules * Fully implement annotation (#35) * Template update for nf-core/tools version 2.6 * Template update for nf-core/tools version 2.7.2 * first steps * fully implement the annotation * update test * offer a lamb to the linting gods * bug fix * offer a virgin to the linting gods (hope this is enough) * Add dynamic VCFanno config creation * go on a pilgrimage to the mountain of the linting gods and make a blood sacrifice * fix and update annotate test to stub * update vep container on stub runs * add postannotations support to the configs * simplified the vcfanno config code and made it smarter * added new fields from the annotsv vcf to the default configs * added a param for the default annotsv file name * fix small bug with param * fix small bug with param * Add all default configs * sacrificing my firstborn child to the linting gods * Moved the unused configs to a separate folder * update configs * update vep config * add option to annotate on small variants with AnnotSV (real test files should still be added) * Remove unused VEP parameters * fix issues * add tests for small variants vcfs * add an option to also output the annotsv outputs * Merge wrongly placed commits (#40) * fixes for big tests * metro map update * Template update for nf-core/tools version 2.8 * black linting * update modules * update modules * fix local modules * bump * eclint * update genome in docs * update vcfanno configs retina and rpe * fix rpe bed file in config * Cnv support (#50) * Template update for nf-core/tools version 2.6 * Template update for nf-core/tools version 2.7.2 * first steps * fully implement the annotation * update test * offer a lamb to the linting gods * bug fix * offer a virgin to the linting gods (hope this is enough) * Add dynamic VCFanno config creation * go on a pilgrimage to the mountain of the linting gods and make a blood sacrifice * fix and update annotate test to stub * update vep container on stub runs * add postannotations support to the configs * simplified the vcfanno config code and made it smarter * added new fields from the annotsv vcf to the default configs * added a param for the default annotsv file name * fix small bug with param * fix small bug with param * Add all default configs * sacrificing my firstborn child to the linting gods * Moved the unused configs to a separate folder * update configs * update vep config * add option to annotate on small variants with AnnotSV (real test files should still be added) * Remove unused VEP parameters * fix issues * add tests for small variants vcfs * add an option to also output the annotsv outputs * Merge wrongly placed commits (#40) * fixes for big tests * metro map update * Template update for nf-core/tools version 2.8 * black linting * update modules * update modules * fix local modules * bump * eclint * update genome in docs * update vcfanno configs retina and rpe * fix rpe bed file in config * adjust test to new data * remove unused data from workflows * remove simple event annotation * update modules config * remove unused modules * fix compile error * another compile error * remove comments in config * guess what! another compile error * small fixes to annotsv * update viola * circumvent a annotsv bug * add gridss genotyping * filter out variants with 0/0 genotype from gridss * move ref variants filtering to before annotsv * update tests * fix linting and add meta to references * black * install expansionhunter * fix merge conflict issues * fix linting * fix config * fix stub * add expansionhunter * some concurrency debugging * add nf-validation support * revert to using linkedhashmap for now * fix jasmine issue * update tests * fix typos * fix linting * there you go editorconfig * let's make it pretty * update nf-test config * fix even more tests * add concat output and fix tests * fix schema * now be nice please * i'm pretty again * update big test samplesheet [no ci] * fix max_time pattern [no ci] * add bcftools sort to single runs * only apply viola on gridss VCFs and change prefixes * remove unused comment [no ci] * fix input pattern * improve the efficiency of viola * black * added a sort step to gridss * updated the gridss label * patch gridss module * remove estimate_read_length * remove unused code * small typo * add -ends to vcfanno * add full test config * fix full test description * update samplesheet * add exists tags to the samplesheet schema * specify advised resources for gridss * possible fix for gridss OOM? * remove code duplication * remove an unused parameter * added a check for callers support being higher than the amount of sv callers * update metro map * increase gridss memory * try to optimize gridss part 2 * try to optimize gridss part 3 * oops * oops 2 * oops 3 * update to advised amounts * increase viola time * discourage the use of gridss for now * typo * linting fix * rename SV subworkflow * fix expansionhunter catalog and add qdnaseq ref * add qdnaseq * add a check for the qdnaseq reference * fixed some issues with qdnaseq * add cram merging and index creation * update resources for qdnaseq * update resources for qdnaseq * update resources for qdnaseq * fix resources qdnaseq * add wisecondorx * updated the metro map * fix background of metro map * update resolution * update resolution * remove old samplesheet conversion script * moved available callers to a groovy script * removed the manual check for file exists (now fully uses nf-validation) * fix a bug with concat when a cnv caller has been supplied * added some comments for the last fix * update optional input handling * fix small issue with annotsv annotations * fix a no process matching selector warning * revert last changes * temp fix for warning * improve vep cache handling + update modules * typo * fix container declaration * fix for manta issue? * undo last commit * version bump expansionhunter * added support for manta configs * made qdnaseq references gender specific * update manta resources * add contig input to manta * moved the contigs file creation to the manta subwf * fix vep params in schema * fix linting with no template update * fix nf-test tests * fix eclint * fix eclint * change gender to sex * typo * added the sex arg to expansionhunter * fix nf-test config for v0.8.0 * revert nf-test to 0.7.3 * prettier * set default sex to female instead of male * fix tests samplesheet * Fix vep container issue (#52) * add dynamic container fetching for vep * linting fix * moved the function to the process itself * fix conda issue * eclint * fix params schema * fix linting * fix for vep issue? * fix for missing singularity container * Add filtering on annotations + fix linting (#55) * Add filtering on annotations * fix linting * begone trailing whitespace * add annotation filter to test * CNV VCFs (#58) * add vcf creation to wisecondorx * add qdnaseq vcfs * update tests * add a simple qdnaseq filter * small fix in the wisecondorx config * small naming fix * add jasmine * fix for config? * fix tests * prettier * fix tests again * fix output logic * fix jasmine + add annotation * eclint * more output logic fixes * eclint (again) * more output logic fixes * fix cnv outputs * remove obsolete if statement * fix issue with meta joining * Family merging (#61) * add vcf creation to wisecondorx * add qdnaseq vcfs * update tests * add a simple qdnaseq filter * small fix in the wisecondorx config * small naming fix * add jasmine * fix for config? * fix tests * prettier * fix tests again * fix output logic * fix jasmine + add annotation * eclint * more output logic fixes * eclint (again) * more output logic fixes * fix cnv outputs * remove obsolete if statement * fix issue with meta joining * add family name to the samplesheet and meta * changes to jasmine subwf + add family merging subwf * add correct reheadering * add family merging (does not work rn) * some more work * fix repeat VCF error * add z-score to VCF header * small fixes to sex defining * Add proper testing + fix some issues found (#64) * add vcf creation to wisecondorx * add qdnaseq vcfs * update tests * add a simple qdnaseq filter * small fix in the wisecondorx config * small naming fix * add jasmine * fix for config? * fix tests * prettier * fix tests again * fix output logic * fix jasmine + add annotation * eclint * more output logic fixes * eclint (again) * more output logic fixes * fix cnv outputs * remove obsolete if statement * fix issue with meta joining * add family name to the samplesheet and meta * changes to jasmine subwf + add family merging subwf * add correct reheadering * add family merging (does not work rn) * some more work * fix repeat VCF error * first commit * add z-score to VCF header * small fixes to sex defining * add test for bam_cnv_calling * test bam_prepare_samtools * test bam_repeat_estimation_expansionhunter * test bam_sv_calling * test bam_variant_calling_delly * test bam_variant_calling_gridss * test bam_variant_calling_manta * test bam_variant_calling_qdnaseq * test bam_variant_calling_smoove * test bam_variant_calling_wisecondorx * uniformize config * test vcf_annotate_vep_annotsv_vcfanno * test vcf_concat_bcftools * test vcf_merge_callers_jasmine * fix header * update vep annotations * oops * add gnomad to vep * revert vep container changes * add sift * fix merge crams with families * fix join duplication for replicates * fully test jasmine family merge * uniformize tests * fix duplication glitch * add pipeline tests for callers * add families tests * add duplicates tests * remove old tests and add new tests to ci * fix linting * use nf-core dev for linting * update minimum nextflow version * revert nf-core version to latest * upload artifacts * fix artifacts * only upload nf-test folder * fix artifact again? * fix artifact again? * fix artifact again? * prettier * only get artifacts on failure * only get artifacts on failure * only get artifacts on failure * fix qdnaseq test * set nf-test to v0.8.1 * try to fix permission errors * update family jasmine tests * small clarification in the header * Fix annotsv TCL error (#69) * add vcf creation to wisecondorx * add qdnaseq vcfs * update tests * add a simple qdnaseq filter * small fix in the wisecondorx config * small naming fix * add jasmine * fix for config? * fix tests * prettier * fix tests again * fix output logic * fix jasmine + add annotation * eclint * more output logic fixes * eclint (again) * more output logic fixes * fix cnv outputs * remove obsolete if statement * fix issue with meta joining * add family name to the samplesheet and meta * changes to jasmine subwf + add family merging subwf * add correct reheadering * add family merging (does not work rn) * some more work * fix repeat VCF error * first commit * add z-score to VCF header * small fixes to sex defining * add test for bam_cnv_calling * test bam_prepare_samtools * test bam_repeat_estimation_expansionhunter * test bam_sv_calling * test bam_variant_calling_delly * test bam_variant_calling_gridss * test bam_variant_calling_manta * test bam_variant_calling_qdnaseq * test bam_variant_calling_smoove * test bam_variant_calling_wisecondorx * uniformize config * test vcf_annotate_vep_annotsv_vcfanno * test vcf_concat_bcftools * test vcf_merge_callers_jasmine * fix header * update vep annotations * oops * add gnomad to vep * revert vep container changes * add sift * fix merge crams with families * fix join duplication for replicates * fully test jasmine family merge * uniformize tests * fix duplication glitch * add pipeline tests for callers * add families tests * add duplicates tests * remove old tests and add new tests to ci * fix linting * use nf-core dev for linting * update minimum nextflow version * revert nf-core version to latest * upload artifacts * fix artifacts * only upload nf-test folder * fix artifact again? * fix artifact again? * fix artifact again? * prettier * only get artifacts on failure * only get artifacts on failure * only get artifacts on failure * fix qdnaseq test * set nf-test to v0.8.1 * try to fix permission errors * update family jasmine tests * split annotsv input files by svtype and merge them back * small clarification in the header * fix bcftools concat issue * fix linting * don't lint .prettierignore * Add Svync standardization + other fixes (#72) * add vcf creation to wisecondorx * add qdnaseq vcfs * update tests * add a simple qdnaseq filter * small fix in the wisecondorx config * small naming fix * add jasmine * fix for config? * fix tests * prettier * fix tests again * fix output logic * fix jasmine + add annotation * eclint * more output logic fixes * eclint (again) * more output logic fixes * fix cnv outputs * remove obsolete if statement * fix issue with meta joining * add family name to the samplesheet and meta * changes to jasmine subwf + add family merging subwf * add correct reheadering * add family merging (does not work rn) * some more work * fix repeat VCF error * first commit * add z-score to VCF header * small fixes to sex defining * add test for bam_cnv_calling * test bam_prepare_samtools * test bam_repeat_estimation_expansionhunter * test bam_sv_calling * test bam_variant_calling_delly * test bam_variant_calling_gridss * test bam_variant_calling_manta * test bam_variant_calling_qdnaseq * test bam_variant_calling_smoove * test bam_variant_calling_wisecondorx * uniformize config * test vcf_annotate_vep_annotsv_vcfanno * test vcf_concat_bcftools * test vcf_merge_callers_jasmine * fix header * update vep annotations * oops * add gnomad to vep * revert vep container changes * add sift * fix merge crams with families * fix join duplication for replicates * fully test jasmine family merge * uniformize tests * fix duplication glitch * add pipeline tests for callers * add families tests * add duplicates tests * remove old tests and add new tests to ci * fix linting * use nf-core dev for linting * update minimum nextflow version * revert nf-core version to latest * upload artifacts * fix artifacts * only upload nf-test folder * fix artifact again? * fix artifact again? * fix artifact again? * prettier * only get artifacts on failure * only get artifacts on failure * only get artifacts on failure * fix qdnaseq test * set nf-test to v0.8.1 * try to fix permission errors * update family jasmine tests * split annotsv input files by svtype and merge them back * small clarification in the header * fix bcftools concat issue * fix linting * don't lint .prettierignore * deprecate gridss for now * implement delly svync * implement manta svync * implement smoove svync * add better headering to merge callers * small fix to bcftools annotate * fix headers for family merging * remove unused assets * fix some stability issues * simplify expansionhunter handling * reheader with bcftools/reheader again * fix the headering once and for all * add a quick view statement * change view to dump * rename dump tag * extra dump * fix join issue * fix header issues with annotsv * add missing header line for annotsv * fix callers info field * remove some views * add views for hpc debugging * a workaround for double variants in annotsv * a workaround for double variants in annotsv try 2 * remove view statements * fix join error? * fix some linting issues * don't test gridss * drop pinned nf-test version * disable gridss tests for real * fix some tests * update subwf tests * update pipeline tests * fix annotate tests? * fix annotate tests again? * add views to annotation test * fix join error + fix test jasmine * revert join error changes? * another try to fix weird join error * join error fix try 3 * join error fix try 4 * join error fix try 5 * join error fix try 6 * join error fix try 7 * Template v2.13.1 sync + update all modules (#73) * Template update for nf-core/tools version 2.6 * Template update for nf-core/tools version 2.7.2 * update pipeline name * update test-data repo name * update test data config name * update pipeline name * update pipeline name * update nf-core yaml * Template update for nf-core/tools version 2.13.1 * Merge branch 'TEMPLATE' into template-v2.13.1-sync * fix some linting issues * update all modules * fix subwf in modules json * remove unused code * remove unused code * fix jasminesv * fix eclint * prettier * have nf-test in the CI * fix samtools convert stub * prettier * fix tabix outputs + tests * update test snapshots * remove views * rearrange joins * revert last commit * another try 🤞 * another try 2 🤞 * try adding by * fix wrong versions yml * patch bcftools concat * fix bcftools concat versions * fix delly svync config * use midnighter's approach of joining channels * fix linting * fix test * Create beautiful docs with mkdocs (#74) * create beautiful docs * some small fixes * set dev version to beta version * Docs 0.1.0dev (#75) * update docs * fix linting * update description of pipeline * docs-output (#76) * docs * parameters.md adapted * relative links * comments for docs-output PR * parameters.md correction * Last fixes before v0.1.0 release (#77) * fix tests * some esthetic fixes * move the logo in the metro map * made the metro map logo a bit smaller * update parameter docs * bump to version 0.1.0 --------- Co-authored-by: mvheetve <[email protected]>
1 parent 707f6f1 commit dec66ea

File tree

364 files changed

+20688
-2302
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

364 files changed

+20688
-2302
lines changed

.devcontainer/devcontainer.json

+20
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,20 @@
1+
{
2+
"name": "nfcore",
3+
"image": "nfcore/gitpod:latest",
4+
"remoteUser": "gitpod",
5+
"runArgs": ["--privileged"],
6+
7+
// Configure tool-specific properties.
8+
"customizations": {
9+
// Configure properties specific to VS Code.
10+
"vscode": {
11+
// Set *default* container specific settings.json values on container create.
12+
"settings": {
13+
"python.defaultInterpreterPath": "/opt/conda/bin/python"
14+
},
15+
16+
// Add the IDs of extensions you want installed when the container is created.
17+
"extensions": ["ms-python.python", "ms-python.vscode-pylance", "nf-core.nf-core-extensionpack"]
18+
}
19+
}
20+
}

.editorconfig

+15-2
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ trim_trailing_whitespace = true
88
indent_size = 4
99
indent_style = space
1010

11-
[*.{md,yml,yaml,html,css,scss,js,cff}]
11+
[*.{md,yml,yaml,html,css,scss,js}]
1212
indent_size = 2
1313

1414
# These files are edited and tested upstream in nf-core/modules
@@ -18,7 +18,20 @@ end_of_line = unset
1818
insert_final_newline = unset
1919
trim_trailing_whitespace = unset
2020
indent_style = unset
21-
indent_size = unset
21+
[/subworkflows/nf-core/**]
22+
charset = unset
23+
end_of_line = unset
24+
insert_final_newline = unset
25+
trim_trailing_whitespace = unset
26+
indent_style = unset
2227

2328
[/assets/email*]
2429
indent_size = unset
30+
31+
# ignore Readme
32+
[README.md]
33+
indent_style = unset
34+
35+
# ignore python
36+
[*.{py,md}]
37+
indent_style = unset

.gitattributes

+1
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,4 @@
11
*.config linguist-language=nextflow
2+
*.nf.test linguist-language=nextflow
23
modules/nf-core/** linguist-generated
34
subworkflows/nf-core/** linguist-generated

.github/CONTRIBUTING.md

+33-8
Original file line numberDiff line numberDiff line change
@@ -1,20 +1,20 @@
1-
# y/nfcmggstructural: Contributing Guidelines
1+
# nf-cmgg/structural: Contributing Guidelines
22

33
Hi there!
4-
Many thanks for taking an interest in improving y/nfcmggstructural.
4+
Many thanks for taking an interest in improving nf-cmgg/structural.
55

6-
We try to manage the required tasks for y/nfcmggstructural using GitHub issues, you probably came to this page when creating one.
6+
We try to manage the required tasks for nf-cmgg/structural using GitHub issues, you probably came to this page when creating one.
77
Please use the pre-filled template to save time.
88

99
However, don't be put off by this template - other more general issues and suggestions are welcome!
1010
Contributions to the code are even more welcome ;)
1111

1212
## Contribution workflow
1313

14-
If you'd like to write some code for y/nfcmggstructural, the standard workflow is as follows:
14+
If you'd like to write some code for nf-cmgg/structural, the standard workflow is as follows:
1515

16-
1. Check that there isn't already an issue about your idea in the [y/nfcmggstructural issues](https://github.com/y/nfcmggstructural/issues) to avoid duplicating work. If there isn't one already, please create one so that others know you're working on this
17-
2. [Fork](https://help.github.com/en/github/getting-started-with-github/fork-a-repo) the [y/nfcmggstructural repository](https://github.com/y/nfcmggstructural) to your GitHub account
16+
1. Check that there isn't already an issue about your idea in the [nf-cmgg/structural issues](https://github.com/nf-cmgg/structural/issues) to avoid duplicating work. If there isn't one already, please create one so that others know you're working on this
17+
2. [Fork](https://help.github.com/en/github/getting-started-with-github/fork-a-repo) the [nf-cmgg/structural repository](https://github.com/nf-cmgg/structural) to your GitHub account
1818
3. Make the necessary changes / additions within your forked repository following [Pipeline conventions](#pipeline-contribution-conventions)
1919
4. Use `nf-core schema build` and add any new parameters to the pipeline JSON schema (requires [nf-core tools](https://github.com/nf-core/tools) >= 1.10).
2020
5. Submit a Pull Request against the `dev` branch and wait for the code to be reviewed and merged
@@ -23,6 +23,12 @@ If you're not used to this workflow with git, you can start with some [docs from
2323

2424
## Tests
2525

26+
You have the option to test your changes locally by running the pipeline. For receiving warnings about process selectors and other `debug` information, it is recommended to use the debug profile. Execute all the tests with the following command:
27+
28+
```bash
29+
nf-test test --profile debug,test,docker --verbose
30+
```
31+
2632
When you create a pull request with changes, [GitHub Actions](https://github.com/features/actions) will run automatic tests.
2733
Typically, pull-requests are only fully reviewed when these tests are passing, though of course we can help out before then.
2834

@@ -50,9 +56,13 @@ These tests are run both with the latest available version of `Nextflow` and als
5056
- Fix the bug, and bump version (X.Y.Z+1).
5157
- A PR should be made on `master` from patch to directly this particular bug.
5258

59+
## Getting help
60+
61+
For further information/help, please consult the [nf-core/structural documentation](https://nf-co.re/structural/usage) and don't hesitate to get in touch on the nf-core Slack [#structural](https://nfcore.slack.com/channels/structural) channel ([join our Slack here](https://nf-co.re/join/slack)).
62+
5363
## Pipeline contribution conventions
5464

55-
To make the y/nfcmggstructural code and processing logic more understandable for new contributors and to ensure quality, we semi-standardise the way the code and other contributions are written.
65+
To make the nf-cmgg/structural code and processing logic more understandable for new contributors and to ensure quality, we semi-standardise the way the code and other contributions are written.
5666

5767
### Adding a new step
5868

@@ -79,7 +89,7 @@ Once there, use `nf-core schema build` to add to `nextflow_schema.json`.
7989

8090
Sensible defaults for process resource requirements (CPUs / memory / time) for a process should be defined in `conf/base.config`. These should generally be specified generic with `withLabel:` selectors so they can be shared across multiple processes/steps of the pipeline. A nf-core standard set of labels that should be followed where possible can be seen in the [nf-core pipeline template](https://github.com/nf-core/tools/blob/master/nf_core/pipeline-template/conf/base.config), which has the default process as a single core-process, and then different levels of multi-core configurations for increasingly large memory requirements defined with standardised labels.
8191

82-
The process resources can be passed on to the tool dynamically within the process with the `${task.cpu}` and `${task.memory}` variables in the `script:` block.
92+
The process resources can be passed on to the tool dynamically within the process with the `${task.cpus}` and `${task.memory}` variables in the `script:` block.
8393

8494
### Naming schemes
8595

@@ -95,3 +105,18 @@ If you are using a new feature from core Nextflow, you may bump the minimum requ
95105
### Images and figures
96106

97107
For overview images and other documents we follow the nf-core [style guidelines and examples](https://nf-co.re/developers/design_guidelines).
108+
109+
## GitHub Codespaces
110+
111+
This repo includes a devcontainer configuration which will create a GitHub Codespaces for Nextflow development! This is an online developer environment that runs in your browser, complete with VSCode and a terminal.
112+
113+
To get started:
114+
115+
- Open the repo in [Codespaces](https://github.com/nf-cmgg/structural/codespaces)
116+
- Tools installed
117+
- nf-core
118+
- Nextflow
119+
120+
Devcontainer specs:
121+
122+
- [DevContainer config](.devcontainer/devcontainer.json)

.github/ISSUE_TEMPLATE/bug_report.yml

+20-17
Original file line numberDiff line numberDiff line change
@@ -1,53 +1,56 @@
11
name: Bug report
22
description: Report something that is broken or incorrect
3-
labels: bug
3+
labels: [bug]
44
body:
5+
- type: markdown
6+
attributes:
7+
value: |
8+
Before you post this issue, please check the documentation:
9+
10+
- [nf-core website: troubleshooting](https://nf-co.re/usage/troubleshooting)
11+
- [nf-core/structural pipeline documentation](https://nf-co.re/structural/usage)
12+
513
- type: textarea
614
id: description
715
attributes:
816
label: Description of the bug
917
description: A clear and concise description of what the bug is.
1018
validations:
1119
required: true
20+
1221
- type: textarea
1322
id: command_used
1423
attributes:
1524
label: Command used and terminal output
16-
description: Steps to reproduce the behaviour. Please paste the command you used
17-
to launch the pipeline and the output from your terminal.
25+
description: Steps to reproduce the behaviour. Please paste the command you used to launch the pipeline and the output from your terminal.
1826
render: console
19-
placeholder: "$ nextflow run ...
20-
27+
placeholder: |
28+
$ nextflow run ...
2129
2230
Some output where something broke
2331
24-
"
2532
- type: textarea
2633
id: files
2734
attributes:
2835
label: Relevant files
29-
description: "Please drag and drop the relevant files here. Create a `.zip` archive
30-
if the extension is not allowed.
31-
32-
Your verbose log file `.nextflow.log` is often useful _(this is a hidden file
33-
in the directory where you launched the pipeline)_ as well as custom Nextflow
34-
configuration files.
36+
description: |
37+
Please drag and drop the relevant files here. Create a `.zip` archive if the extension is not allowed.
38+
Your verbose log file `.nextflow.log` is often useful _(this is a hidden file in the directory where you launched the pipeline)_ as well as custom Nextflow configuration files.
3539
36-
"
3740
- type: textarea
3841
id: system
3942
attributes:
4043
label: System information
41-
description: "* Nextflow version _(eg. 21.10.3)_
44+
description: "* Nextflow version _(eg. 23.10.0)_
4245
4346
* Hardware _(eg. HPC, Desktop, Cloud)_
44-
4547
* Executor _(eg. slurm, local, awsbatch)_
4648
47-
* Container engine: _(e.g. Docker, Singularity, Conda, Podman, Shifter or Charliecloud)_
49+
* Container engine: _(e.g. Docker, Singularity, Conda, Podman, Shifter, Charliecloud,
50+
or Apptainer)_
4851
4952
* OS _(eg. CentOS Linux, macOS, Linux Mint)_
5053
51-
* Version of y/nfcmggstructural _(eg. 1.1, 1.5, 1.8.2)_
54+
* Version of nf-cmgg/structural _(eg. 1.1, 1.5, 1.8.2)_
5255
5356
"

.github/ISSUE_TEMPLATE/config.yml

+7
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
contact_links:
2+
- name: Join nf-core
3+
url: https://nf-co.re/join
4+
about: Please join the nf-core community here
5+
- name: "Slack #structural channel"
6+
url: https://nfcore.slack.com/channels/structural
7+
about: Discussion about the nf-core/structural pipeline

.github/ISSUE_TEMPLATE/feature_request.yml

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
name: Feature request
2-
description: Suggest an idea for the y/nfcmggstructural pipeline
2+
description: Suggest an idea for the nf-cmgg/structural pipeline
33
labels: enhancement
44
body:
55
- type: textarea

.github/PULL_REQUEST_TEMPLATE.md

+7-5
Original file line numberDiff line numberDiff line change
@@ -1,24 +1,26 @@
11
<!--
2-
# y/nfcmggstructural pull request
2+
# nf-cmgg/structural pull request
33
4-
Many thanks for contributing to y/nfcmggstructural!
4+
Many thanks for contributing to nf-cmgg/structural!
55
66
Please fill in the appropriate checklist below (delete whatever is not relevant).
77
These are the most common things requested on pull requests (PRs).
88
99
Remember that PRs should be made against the dev branch, unless you're preparing a pipeline release.
1010
11-
Learn more about contributing: [CONTRIBUTING.md](https://github.com/y/nfcmggstructural/tree/master/.github/CONTRIBUTING.md)
11+
Learn more about contributing: [CONTRIBUTING.md](https://github.com/nf-cmgg/structural/tree/master/.github/CONTRIBUTING.md)
1212
-->
1313

1414
## PR checklist
1515

1616
- [ ] This comment contains a description of changes (with reason).
1717
- [ ] If you've fixed a bug or added code that should be tested, add tests!
18-
- [ ] If you've added a new tool - have you followed the pipeline conventions in the [contribution docs](https://github.com/y/nfcmggstructural/tree/master/.github/CONTRIBUTING.md)
18+
- [ ] If you've added a new tool - have you followed the pipeline conventions in the [contribution docs](https://github.com/nf-cmgg/structural/tree/master/.github/CONTRIBUTING.md)
1919
- [ ] Make sure your code lints (`nf-core lint`).
20-
- [ ] Ensure the test suite passes (`nextflow run . -profile test,docker --outdir <OUTDIR>`).
20+
- [ ] Ensure the test suite passes (`nf-test test`).
21+
- [ ] Check for unexpected warnings in debug mode (`nextflow run . -profile debug,test,docker --outdir <OUTDIR>`).
2122
- [ ] Usage Documentation in `docs/usage.md` is updated.
2223
- [ ] Output Documentation in `docs/output.md` is updated.
24+
- [ ] Parameters Documentation is updated with `nf-core schema docs --format markdown --output docs/parameters.md --force`
2325
- [ ] `CHANGELOG.md` is updated.
2426
- [ ] `README.md` is updated (including new tool citations and authors/contributors).

.github/workflows/branch.yml

+3-3
Original file line numberDiff line numberDiff line change
@@ -11,15 +11,15 @@ jobs:
1111
steps:
1212
# PRs to the nf-core repo master branch are only ok if coming from the nf-core repo `dev` or any `patch` branches
1313
- name: Check PRs
14-
if: github.repository == 'y/nfcmggstructural'
14+
if: github.repository == 'nf-cmgg/structural'
1515
run: |
16-
{ [[ ${{github.event.pull_request.head.repo.full_name }} == y/nfcmggstructural ]] && [[ $GITHUB_HEAD_REF = "dev" ]]; } || [[ $GITHUB_HEAD_REF == "patch" ]]
16+
{ [[ ${{github.event.pull_request.head.repo.full_name }} == nf-cmgg/structural ]] && [[ $GITHUB_HEAD_REF == "dev" ]]; } || [[ $GITHUB_HEAD_REF == "patch" ]]
1717
1818
# If the above check failed, post a comment on the PR explaining the failure
1919
# NOTE - this doesn't currently work if the PR is coming from a fork, due to limitations in GitHub actions secrets
2020
- name: Post PR comment
2121
if: failure()
22-
uses: mshick/add-pr-comment@v1
22+
uses: mshick/add-pr-comment@b8f338c590a895d50bcbfa6c5859251edc8952fc # v2
2323
with:
2424
message: |
2525
## This PR is against the `master` branch :x:

.github/workflows/build-docs.yml

+38
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,38 @@
1+
name: build docs
2+
on:
3+
push:
4+
branches:
5+
- master
6+
- main
7+
- dev
8+
permissions:
9+
contents: write
10+
jobs:
11+
deploy:
12+
runs-on: ubuntu-latest
13+
steps:
14+
- uses: actions/checkout@v3
15+
with:
16+
fetch-depth: 0 # fetch all commits/branches
17+
- uses: actions/setup-python@v4
18+
with:
19+
python-version: 3.x
20+
- run: echo "cache_id=$(date --utc '+%V')" >> $GITHUB_ENV
21+
- name: Obtain version from MANIFEST.MF
22+
run: echo "pipeline_version=$(grep "version" nextflow.config | tail -1 | sed -e s'/[^=]*= //' | cut -d "'" -f 2)" >> $GITHUB_ENV
23+
- name: Setup git user
24+
run: |
25+
git config --global user.name "${{github.actor}}"
26+
git config --global user.email "${{github.actor}}@users.noreply.github.com"
27+
- uses: actions/cache@v3
28+
with:
29+
key: mkdocs-material-${{ env.cache_id }}
30+
path: .cache
31+
restore-keys: |
32+
mkdocs-material-
33+
- name: Install dependencies
34+
run: pip install mkdocs-material pymdown-extensions pillow cairosvg mike
35+
- name: Build docs
36+
run: mike deploy --push --update-aliases ${{ env.pipeline_version }} latest
37+
- name: Set default docs
38+
run: mike set-default --push latest

0 commit comments

Comments
 (0)