You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: appendices/editor-in-chief-checks.md
+4-3Lines changed: 4 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,12 +9,12 @@ to work on them before the review process begins.
9
9
Please check our [Python packaging guide](https://www.pyopensci.org/python-package-guide) for more information on the elements
10
10
below.
11
11
12
-
- [ ] **Installation** The package can be installed from a community repository such as PyPI (preferred), and/or a community channel on conda (e.g., conda-forge, bioconda).
12
+
- [ ] **Installation** The package can be installed from a community repository such as PyPI (preferred), and/or a community channel on conda (for example, conda-forge, bioconda).
13
13
- [ ] The package imports properly into a standard Python environment `import package`.
14
14
- [ ] **Fit** The package meets criteria for [fit](https://www.pyopensci.org/software-peer-review/about/package-scope.html#what-types-of-packages-does-pyopensci-review) and [overlap](https://www.pyopensci.org/software-peer-review/about/package-scope.html#package-overlap).
15
15
- [ ] **Documentation** The package has sufficient online documentation to allow us to evaluate the package's function and scope *without installing the package*. This includes:
16
16
- [ ] User-facing documentation that overviews how to install and start using the package.
17
-
- [ ] Short quickstart tutorials that help a user understand how to use the package and what it can do for them.
17
+
- [ ] Short, quickstart tutorials that help a user understand how to use the package and what it can do for them.
18
18
- [ ] API documentation (documentation for your code's functions, classes, methods, and attributes): this includes clearly written docstrings with variables defined using a standard docstring format.
19
19
- [ ] Core GitHub repository Files
20
20
- [ ] **README** The package has a `README.md` file with a clear explanation of what the package does, instructions on how to install it, and a link to development instructions.
@@ -28,13 +28,14 @@ NOTE: We prefer that you have development instructions in your documentation too
28
28
- [ ] **Package overlap** The package doesn't entirely overlap with the functionality of other packages that have already been submitted to pyOpenSci.
29
29
- [ ] **Archive** (JOSS only, may be post-review): The repository DOI resolves correctly.
30
30
- [ ] **Version** (JOSS only, may be post-review): Does the release version given match the GitHub release (v1.0.0)?
31
+
- [ ] The package authors have disclosed the use of Generative AI tools in the development and/or maintenance of their package.
31
32
32
33
**Optional:** Let projects know that it's a great idea for projects to have a .github repository for the project organization where they can host a commonly used LICENSE, Code of Conduct, and even a YAML file with label definitions. These items will then be automatically applied to every repository in the organization to ensure consistency (but can be customized within repos too). The [SunPy project](https://github.com/sunpy/.github/) has a great example of this.
33
34
34
35
---
35
36
- [ ] [Initial onboarding survey was filled out ](https://forms.gle/F9mou7S3jhe8DMJ16)
36
37
We appreciate each maintainer of the package filling out this survey individually. :raised_hands:
37
-
Thank you, authors, in advance for setting aside five to ten minutes to do this. It truly helps our organization. :raised_hands:
38
+
A big thank you in advance to authors for setting aside five to ten minutes to do this. It truly helps our organization! :raised_hands:
- [ ] Generative AI was used to produce some of the material in this submission.
3
+
- [ ] If generative AI was used in this project, the authors affirm that all generated material has been reviewed and edited for clarity, correctness, and completeness. The authors are responsible for the content of their work and affirm that it is in a state where reviewers will not be responsible for primary editing and review of machine-generated material.
4
+
5
+
If you checked the first box above, please describe how generative AI was used, including:
6
+
7
+
- **Which parts** of the submission were generated (e.g., documentation, tests, code). In addition to a general description, please specifically indicate any substantial portions of code (classes, modules, subpackages) that were wholly or primarily generated by AI.
8
+
- **The approximate scale** of the generated portions (e.g., "all of the tests were generated and then checked by a human," "small routines were generated and copied into the code").
9
+
- **How the generative AI was used** (e.g., line completion, help with translation, queried separately and integrated, agentic workflow).
10
+
11
+
If you have a policy around generative AI use in your project, please provide a link to it below:
12
+
13
+
- _Your link here (remove this line if you don't have a link)_
Copy file name to clipboardExpand all lines: how-to/author-guide.md
+16-10Lines changed: 16 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -66,7 +66,7 @@ Curious about the general timeline for pyOpenSci reviews?
66
66
:link-type: doc
67
67
:class-card: left-aligned
68
68
69
-
Read about our peer review policies.
69
+
Read through our peer review policies before submitting a package to us.
70
70
:::
71
71
::::
72
72
@@ -87,9 +87,10 @@ Before you begin this process, [please be sure to read the review process guidel
87
87
88
88
1. Please be sure that you have time to devote to making changes to your
89
89
package. During review, you will receive feedback from an editor and two reviewers. Changes could
90
-
take time. Please consider this before submitting to us. You can read more about the timeline to make changes in our [peer review policies page](../our-process/policies).
90
+
take time. Please consider this before submitting. You can read more about the timeline for making changes on our [peer review policies page](../our-process/policies).
91
91
2. A diverse group of volunteer editors and reviewers leads peer review.
92
92
Please be considerate when engaging with everyone online.
93
+
3. All participants in our peer review process need to follow the [pyOpenSci Code of Conduct](https://www.pyopensci.org/handbook/CODE_OF_CONDUCT.html). Please review it before submitting to us.
93
94
```
94
95
95
96
## 1. Do you plan to continue to maintain your package?
@@ -138,7 +139,7 @@ emphasis on long-term software maintenance and focuses more on
138
139
publication quality and citation/credit.
139
140
```
140
141
141
-
## 2. Does Your Package Meet Packaging Requirements?
142
+
## 2. Does your package meet packaging requirements?
142
143
143
144
Before submitting your project for review with pyOpenSci, make sure that
144
145
your package meets all of the requirements listed in the editor checks (see below).
@@ -157,6 +158,11 @@ for Python packaging, including discussions of:
157
158
158
159
```
159
160
161
+
:::{important}
162
+
Given the increased use of Generative AI tools (LLMs), we have developed a disclosure policy for all packages submitted to pyOpenSci (generative-ai-policy). Please review this before submitting to us.
163
+
:::
164
+
165
+
160
166
```{hint}
161
167
**Do you have questions about Python packaging or our peer review process?**
162
168
@@ -179,7 +185,7 @@ that you can use to create a high-quality
Next, check to see if your package falls within the topical and technical scope of pyOpenSci. If you aren't
185
191
sure about whether your package fits within pyOpenSci's scope (below), submit
@@ -197,13 +203,13 @@ Our current categories for determining package scope are below:
197
203
Click here to view our technical and domain scope requirements.
198
204
```
199
205
200
-
## 4. Submit Your Package for Peer Review
206
+
## 4. Submit your package for peer review
201
207
202
208
To submit your package for peer review, you can
203
209
open an issue in our [pyopensci/software-review repo](https://github.com/pyOpenSci/software-review/issues/new/choose/)
204
210
repository and fill out the [Submit Software for Review](https://github.com/pyOpenSci/software-submission/issues/new?template=submit-software-for-review.md) issue template.
205
211
206
-
## 5. Editor-in-Chief Reviews Package for Scope and Minimal Infrastructure Criteria
212
+
## 5. Editor-in-Chief reviews package for scope and minimal infrastructure criteria
207
213
208
214
Once the issue is opened, our editor-in-chief and an editor from our editorial board will review your submission within
209
215
**2 weeks** and respond with next steps. The editor may request that you make updates
@@ -216,7 +222,7 @@ package if it does not fall within our scope.
216
222
Click here to view the editor checks that will be used to evaluate your package.
217
223
```
218
224
219
-
## 6. The Review Begins
225
+
## 6. The review begins
220
226
221
227
If your package meets the minimal criteria for being
222
228
reviewed, it may then be given to an editor with appropriate domain experience
@@ -226,7 +232,7 @@ issue within **3 weeks**. Reviewers can also open issues in your package reposit
226
232
We prefer issues that link back to the review as they document changes made to your
227
233
package that were triggered by our review process.
228
234
229
-
## 7. Response to Reviews
235
+
## 7. Response to reviews
230
236
231
237
You should respond to reviewers’ comments within **2 weeks** of the
232
238
last-submitted review. You can make updates to your package at any time. We
@@ -240,7 +246,7 @@ Once the reviewers are happy with the changes that you've made to the package, t
240
246
editor will review everything and accept your package into the pyOpenSci ecosystem.
241
247
Congratulations! You are almost done!
242
248
243
-
## My Package is Approved, Now What?
249
+
## My package is approved, now what?
244
250
245
251
Congratulations on being accepted into the pyOpenSci community of maintainers!
246
252
Once your package is approved, a few things will happen:
@@ -255,7 +261,7 @@ Once your package is approved, a few things will happen:
255
261
256
262
If you'd like to submit your package to JOSS, you can do so now. Remember that JOSS will accept our review as theirs, so **you DO NOT need to go through another review**. Read more below.
257
263
258
-
### Journal of Open Source Software (JOSS) Submission
264
+
### Journal of Open Source Software (JOSS) submission
259
265
260
266
pyOpenSci has a [partnership with JOSS](JOSS), where our review is accepted by JOSS by
Copy file name to clipboardExpand all lines: our-process/policies.md
+52-18Lines changed: 52 additions & 18 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -3,15 +3,15 @@
3
3
## Review process guidelines
4
4
5
5
pyOpenSci packages are reviewed for quality, fit, scope, documentation, and
6
-
usability. The review process is similar to a manuscript review, however, it
6
+
usability. The review process is similar to a manuscript review; however, it
7
7
has a stronger focus on Python packaging best practices.
8
8
9
9
Unlike a manuscript review, our peer review process is an ongoing conversation.
10
-
Once all major issues and questions are addressed, the review editor will make
11
-
a decision to accept, hold, or reject the package.
10
+
Once all major issues and questions are addressed, the review editor will decide
11
+
to accept, hold, or reject the package.
12
12
13
13
Rejections are usually done early in the process, before the review process
14
-
begins. In rare cases, a package may also not be on-boarded into the pyOpenSci
14
+
begins. In rare cases, a package may also not be onboarded into the pyOpenSci
15
15
ecosystem after review & revision.
16
16
17
17
It is ultimately the editor’s decision on whether or not to reject the package
@@ -20,11 +20,12 @@ based on how the reviews are addressed.
20
20
## Review communication approach
21
21
22
22
Communication between authors, reviewers, and editors takes
23
-
place on GitHub. You can, however choose to contact the editor by email if
23
+
place on GitHub. However, you may contact the editor by email if
24
24
needed.
25
25
26
26
When submitting a package, please make sure that your GitHub notification
27
-
settings are setup to notify you when you receive feedback on the review issue.
27
+
settings are turned on for the software-submission repository to notify you
28
+
when you receive feedback on a review issue.
28
29
29
30
(submission-volume)=
30
31
@@ -64,15 +65,15 @@ of the submission.
64
65
We recommend submitting your package for review with pyOpenSci before
65
66
submitting a software paper describing the package to a journal.
66
67
67
-
Review feedback may result in major improvements and updates to your package,
68
-
including changes that could be break package functionality.
68
+
Review feedback may result in significant improvements and updates to your package,
69
+
including changes that could break package functionality.
69
70
70
71
Applying reviewer or editor recommendations to your package can improve your
71
-
users' experience with future versions of your package even if your package is
72
+
users' experience with future versions of your package, even if your package is
72
73
already published on `PyPI` or `conda-forge`.
73
74
74
75
> Please do not submit your package for review while it or an associated
75
-
> manuscript is also under review at another venue, as this may result on
76
+
> manuscript is also under review at another venue, as this may result in
76
77
> conflicting requests for changes from two sets of reviewers.
77
78
78
79
### Publication with Journal of Open Source Software (JOSS)
@@ -138,6 +139,37 @@ a conflict of interest if:
138
139
In the case where none of the associate editors can serve as editor, an
139
140
external guest editor will be recruited to lead the package review.
140
141
142
+
(generative-ai-policy)=
143
+
144
+
## Policy for use of generative AI / LLMs
145
+
146
+
:::{admonition} How this policy was developed
147
+
:class: important
148
+
149
+
The policy below was co-developed by the pyOpenSci community. Its goals are:
150
+
151
+
- Acknowledgment of and transparency around the widespread use of Generative AI tools, with a focus on Large Language Models (LLMs) in Open Source development.
152
+
- Ensure an equitable balance of effort in the peer review process: Authors acknowledge that a human has carefully reviewed parts of the package that are AI-generated. Generated material should be in a state that minimizes review time. Our reviewers are not responsible for correcting errors in machine-generated content.
153
+
- Disclosure allows reviewers and editors to make informed decisions around the types of packages that they wish to review code for.
154
+
- Raise awareness of challenges that Generative AI tools present to the scientific (and broader) open source community.
155
+
156
+
[Please see this GitHub issue for a discussion of the topic.](https://github.com/pyOpenSci/software-peer-review/issues/331)
157
+
:::
158
+
159
+
### Disclosure of generative AI use in pyOpenSci reviewed packages
160
+
161
+
- When you submit a package to pyOpenSci, please disclose any use of LLMs (Large Language Models) in your package's development by checking the appropriate box and describing your use of generative AI in its development and/or maintenance on our software submission form. Disclosure should include what parts of your package were developed using Generative AI tools.
162
+
- Please also disclose this use of Generative AI tools in your package's `README.md` file and in any modules where generative AI contributions have been implemented.
163
+
- We require that all aspects of your package have been reviewed carefully by a human on your maintainer team. Please ensure all text and code have been carefully checked for bugs and issues before submitting to pyOpenSci.
164
+
- Your acknowledgment of using Generative AI will not prejudice the success of your submission. However, a reviewer can and will ask you to revisit your package's content if it appears that sections have been copied and pasted from other sources without human review.
165
+
- If the review team (comprised of the editor and reviewers) determines that the code and text in the package are too challenging to review, they can decide to pause and/or discontinue the review following this policy’s guidelines.
166
+
167
+
Below is the checklist that you will need to respond to in our submission form:
168
+
169
+
```{include} ../appendices/gen-ai-checklist.md
170
+
171
+
```
172
+
141
173
## Review timelines and on-hold reviews
142
174
143
175
At any time, an author can choose to have their submission put on hold
@@ -176,9 +208,9 @@ including issues, pull requests, and dates of the last release and last commit
176
208
to the package repository. Activity is defined as a repository commit, pull
177
209
request, or release.
178
210
179
-
We will flag packages that haven't been updated within a 1year/ 12 month time
211
+
We will flag packages that haven't been updated within a 1-year/12-month time
180
212
period based on activity. Packages with no activity after 12 months will be
181
-
flagged. At that time, pyOpenSci editorial team member will contact the package
213
+
flagged. At that time, a pyOpenSci editorial team member will contact the package
182
214
maintainers to evaluate the maintenance status of their package.
183
215
184
216
(archive-process)=
@@ -193,15 +225,15 @@ ecosystem.
193
225
In cases where the community heavily uses a package, we may
194
226
collaborate with the community to identify reasonable next steps, such as
195
227
assisting in finding a new maintainer. If a solution for the ongoing package
196
-
maintenance is not found, the package will be archived within the pyOpenSci
197
-
ecosystem.
228
+
maintenance of your package is not found, the package will be archived within
229
+
the pyOpenSci ecosystem.[See section on archiving below.](package-archive)
198
230
199
231
If a sub-community decides to fork and maintain the package, we are open to
200
232
working with the new maintainers to register the newly forked package within
201
233
our ecosystem. The original package will be archived with a link to the new
202
234
fork.
203
235
204
-
We will also add a note to any blogs written that highlight your tool that
236
+
We will also add a note to any blogs written that highlight your tool, that
205
237
the package is no longer maintained.
206
238
207
239
### Quality commitment
@@ -219,19 +251,21 @@ in touch with us if they do need to step down from maintaining a tool.
219
251
### Requesting Package Removal from the pyOpenSci Ecosystem
220
252
221
253
In the unlikely scenario that a contributor of a package requests removal of
222
-
their package from our ecosystem, we retain the right offer the last / most
254
+
their package from our ecosystem, we retain the right to offer the last/most
223
255
recently released version of that package in our ecosystem for archival
224
256
purposes only.
225
257
258
+
(package-archive)=
259
+
226
260
### Archiving a package
227
261
228
262
If a package appears to be no longer maintained, we will mark it as
0 commit comments