Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
85 commits
Select commit Hold shift + click to select a range
367b408
add theory documentation
sallen12 Dec 24, 2024
af0a183
Merge branch 'main' into docu
frazane Dec 24, 2024
f05bc95
add readthedocs config
frazane Jan 16, 2025
d39db2b
add readthedocs files
frazane Jan 16, 2025
84d4c0f
delete obsolete files
frazane Jan 16, 2025
e409203
update gitignore
frazane Jan 16, 2025
c5179af
update docs requirements
frazane Jan 16, 2025
18b8859
use docs requirements file
frazane Jan 16, 2025
d47f514
update docs requirements
frazane Jan 16, 2025
b1eaf7a
update docs requirements
frazane Jan 16, 2025
af0ec14
misc fixes and test cross-references
frazane Jan 17, 2025
74d0c90
remove old file from index
frazane Jan 17, 2025
71bc671
install the local package code for the build
frazane Jan 17, 2025
141da57
expand API reference documentation
frazane Jan 17, 2025
0a61e5f
delete mkdocs config file
frazane Jan 18, 2025
6b33a4b
wip on crps docstrings
frazane Feb 1, 2025
f248be4
more wip on crps docstrings
frazane Feb 1, 2025
ca58cea
pass doctest for examples in _crps.py
frazane Feb 1, 2025
b7740f2
more work on docstrings - math blocks, args, formatting, etc.
frazane Feb 1, 2025
66563af
add examples and pass doctest for variogram scores
frazane Feb 1, 2025
80fd35d
Merge branch 'main' into docu
frazane Mar 26, 2025
2c1b2f6
comment out latex math hook
sallen12 Apr 4, 2025
e6b0cf9
update theory docs
sallen12 Apr 4, 2025
516ff25
add documentation page for ensemble forecasts
sallen12 Apr 4, 2025
6f6a08d
add documentation page for ensemble forecasts
sallen12 Apr 4, 2025
cf5f95e
add documentation page for weighted scoring rules
sallen12 Apr 4, 2025
5eb6656
update docu index
sallen12 Apr 4, 2025
b922b16
Merge branch 'docu' of https://github.com/frazane/scoringrules into docu
sallen12 Apr 4, 2025
7f4603f
update axis naming args (#95)
nicholasloveday Apr 7, 2025
2e37351
fix m_axis bug
sallen12 Apr 14, 2025
40fad39
change test_kernels to use m_axis argument
sallen12 Apr 14, 2025
a79024f
fix m_axis bug in logs_ensemble
sallen12 Apr 14, 2025
c181cf3
increase N in crps ensemble tests
sallen12 Apr 14, 2025
ade193e
add exception in crps ensemble tests for akr approximations
sallen12 Apr 14, 2025
1db9052
change energy score function name
sallen12 Apr 14, 2025
e919a36
change variogram score function name
sallen12 Apr 14, 2025
fb905e9
add default threshold arguments to twcrps_ensemble
sallen12 Apr 14, 2025
c05fe6b
add default threshold arguments to owcrps_ensemble
sallen12 Apr 14, 2025
39f8eb0
add default threshold arguments to vrcrps_ensemble
sallen12 Apr 14, 2025
5b9b1cf
reduce tolerance on owgksuv_ensemble test
sallen12 Apr 14, 2025
e7b161e
add default threshold argument to weighted gksuv scores
sallen12 Apr 14, 2025
1ed244a
update default w_func in vrcrps_ensemble
sallen12 Apr 14, 2025
8442fc8
update test_wcrps
sallen12 Apr 14, 2025
9d8efef
reduce tolerance of owgks tests
sallen12 Apr 15, 2025
0c209f9
reduce tolerance of owgks tests
sallen12 Apr 15, 2025
fdf78ea
add argsort method to backends
sallen12 Apr 15, 2025
9312992
add weight function in ensemble crps for non-numba backends
sallen12 Apr 16, 2025
8ba346f
add weight function in ensemble crps for non-numba backends
sallen12 Apr 16, 2025
7003da9
add weight function in ensemble crps for non-numba backends
sallen12 Apr 16, 2025
9e49e10
add akr estimators for crps_ensemble for non-numba backends
sallen12 Apr 16, 2025
f50211a
add ensemble weights to weighted ensemble_crps functions
sallen12 Apr 16, 2025
4be8135
fix bugs when using ensemble weights in crps_ensemble
sallen12 Apr 16, 2025
e44ce58
add check_pars argument and parameter checks for crps distributions
sallen12 Apr 17, 2025
b00c5f1
add default parameter arguments to crps and log scores for parametric…
sallen12 Apr 17, 2025
fbfa090
fix bug in crps for beta distribution
sallen12 Apr 17, 2025
ca483b5
update documentation link and prepare release tag
frazane May 29, 2025
4d91ec2
add deprecated aliases
frazane May 29, 2025
8db42c4
more minor fixes
frazane May 30, 2025
6e5069f
Merge branch 'docu' of https://github.com/frazane/scoringrules into docu
sallen12 Jul 9, 2025
8aba4e1
Merge branch 'main' into docu
sallen12 Jul 9, 2025
fa4edce
minor bug fixes
sallen12 Jul 9, 2025
0f98025
minor jax tolerance bug fix
sallen12 Jul 9, 2025
6dfbd8b
minor jax tolerance bug fix
sallen12 Jul 9, 2025
41d71b9
minor jax tolerance bug fix
sallen12 Jul 9, 2025
49da2f3
add weight function argument to energy score
sallen12 Jul 9, 2025
517c4fa
add ensemble weight argument to weighted energy scores
sallen12 Jul 10, 2025
73dcb6d
add ensemble weights for the variogram score
sallen12 Jul 10, 2025
f034542
add ensemble weights to weighted variogram scores
sallen12 Jul 10, 2025
f164f62
add ensemble weights to weighted variogram scores
sallen12 Jul 10, 2025
d226627
add dimension weights to variogram scores
sallen12 Jul 10, 2025
b7fa375
fix tolerance bug in vres tests
sallen12 Jul 10, 2025
5cdd2e4
fix tolerance in crps jax tests
sallen12 Jul 10, 2025
c7f4b57
add ensemble weight arguments to gaussian kernel scores
sallen12 Jul 24, 2025
792a8b6
reduce tol of vrgksuv tests
sallen12 Jul 24, 2025
a50a5ba
skip torch tests for vrgksuv"
sallen12 Jul 24, 2025
ccb5784
update brier score doc strings
sallen12 Aug 4, 2025
ffb248b
fix typo in crps closed docstrings
sallen12 Aug 4, 2025
362a546
remove parametric crps gufuncs
sallen12 Aug 5, 2025
06478ad
add separate crps functions for weighted ensembles
sallen12 Aug 5, 2025
fa5f4f9
add separate weighted crps functions for weighted ensembles
sallen12 Aug 5, 2025
5a50e9c
add separate energy score functions for weighted ensembles
sallen12 Aug 5, 2025
bc4d2a6
add separate variogram functions for weighted ensemble members
sallen12 Aug 5, 2025
6c8ed6f
add separate kernel score functions for when ensemble weights are given
sallen12 Aug 15, 2025
ec96ea2
Merge branch 'main' into docu
sallen12 Aug 15, 2025
03c470d
fix bugs in weighted gufuncs
sallen12 Aug 15, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
48 changes: 0 additions & 48 deletions docs/contributing.md

This file was deleted.

19 changes: 9 additions & 10 deletions docs/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,35 +17,34 @@ The scoring rules available in `scoringrules` include, but are not limited to, t
- Logarithmic Score
- (Discrete) Ranked Probability Score
- Continuous Ranked Probability Score (CRPS)
- Dawid-Sebastiani Score
- Energy Score
- Variogram Score
- Gaussian Kernel Score
- Threshold-Weighted CRPS
- Threshold-Weighted Energy Score
- Quantile Score
- Interval Score
- Weighted Interval Score



Functionality is available for forecasts in the form of samples (i.e. ensemble forecasts) as well as popular univariate parametric distributions.

```{toctree}
:hidden:
:caption: Background

theory.md
forecast_dists.md
crps_estimators.md
weighted_scores.md
background/theory.md
background/forecast_dists.md
background/crps_estimators.md
background/weighted_scores.md
```

```{toctree}
:hidden:
:caption: Library

user_guide.md
contributing.md
reference.md
library/user_guide.md
library/contributing.md
library/reference.md
```


Expand Down
49 changes: 49 additions & 0 deletions docs/library/contributing.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,49 @@
# Contributing

We welcome contributions! You can help improve the library in many ways. For example, by:

- Reporting issues or proposing enhancements via the [GitHub issue tracker](https://github.com/frazane/scoringrules/issues)
- Improving or extending the codebase
- Improving or extending the documentation

## Getting started

To make changes to the library, fork the repository on GitHub and clone it to your computer:

```
git clone https://github.com/<your-username>/scoringrules.git
```

We use [uv](https://docs.astral.sh/uv/) for project management and packaging. Install it by running

```
curl -LsSf https://astral.sh/uv/install.sh | sh
```

You should then be able to install the library and all dependencies (including development dependencies), and install the pre-commit hooks:

```
uv install
uv run pre-commit install
```

From here, you can work on your changes. Once you're satisfied with your changes, and have followed the additional instructions below, push everything to your repository and open a pull request on GitHub.


### Contributing to the codebase

Don't forget to include new tests if necessary. Make sure that all tests are passing with

```
uv run pytest tests/
```

### Contributing to the documentation

You can work on the documentation by modifying files in `docs/`. The most convenient way to do this is to run

```
uvx --with-requirements docs/requirements.txt sphinx-autobuild docs/ docs/_build/
```

and open the locally hosted documentation on your browser. It will be updated automatically every time you make changes and save. If you edit or add pieces of LaTeX math, please make sure they are rendered correctly.
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.brier_score.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.brier\_score
=========================

.. currentmodule:: scoringrules

.. autofunction:: brier_score
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.clogs_ensemble.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.clogs\_ensemble
============================

.. currentmodule:: scoringrules

.. autofunction:: clogs_ensemble
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_2pexponential.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_2pexponential
================================

.. currentmodule:: scoringrules

.. autofunction:: crps_2pexponential
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_2pnormal.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_2pnormal
===========================

.. currentmodule:: scoringrules

.. autofunction:: crps_2pnormal
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_beta.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_beta
=======================

.. currentmodule:: scoringrules

.. autofunction:: crps_beta
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_binomial.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_binomial
===========================

.. currentmodule:: scoringrules

.. autofunction:: crps_binomial
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_clogistic.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_clogistic
============================

.. currentmodule:: scoringrules

.. autofunction:: crps_clogistic
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_cnormal.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_cnormal
==========================

.. currentmodule:: scoringrules

.. autofunction:: crps_cnormal
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_ct.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_ct
=====================

.. currentmodule:: scoringrules

.. autofunction:: crps_ct
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_ensemble.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_ensemble
===========================

.. currentmodule:: scoringrules

.. autofunction:: crps_ensemble
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_exponential.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_exponential
==============================

.. currentmodule:: scoringrules

.. autofunction:: crps_exponential
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_exponentialM.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_exponentialM
===============================

.. currentmodule:: scoringrules

.. autofunction:: crps_exponentialM
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_gamma.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_gamma
========================

.. currentmodule:: scoringrules

.. autofunction:: crps_gamma
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_gev.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_gev
======================

.. currentmodule:: scoringrules

.. autofunction:: crps_gev
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_gpd.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_gpd
======================

.. currentmodule:: scoringrules

.. autofunction:: crps_gpd
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_gtclogistic.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_gtclogistic
==============================

.. currentmodule:: scoringrules

.. autofunction:: crps_gtclogistic
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_gtcnormal.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_gtcnormal
============================

.. currentmodule:: scoringrules

.. autofunction:: crps_gtcnormal
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_gtct.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_gtct
=======================

.. currentmodule:: scoringrules

.. autofunction:: crps_gtct
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_hypergeometric.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_hypergeometric
=================================

.. currentmodule:: scoringrules

.. autofunction:: crps_hypergeometric
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_laplace.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_laplace
==========================

.. currentmodule:: scoringrules

.. autofunction:: crps_laplace
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_logistic.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_logistic
===========================

.. currentmodule:: scoringrules

.. autofunction:: crps_logistic
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_loglaplace.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_loglaplace
=============================

.. currentmodule:: scoringrules

.. autofunction:: crps_loglaplace
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_loglogistic.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_loglogistic
==============================

.. currentmodule:: scoringrules

.. autofunction:: crps_loglogistic
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_lognormal.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_lognormal
============================

.. currentmodule:: scoringrules

.. autofunction:: crps_lognormal
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_mixnorm.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_mixnorm
==========================

.. currentmodule:: scoringrules

.. autofunction:: crps_mixnorm
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_negbinom.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_negbinom
===========================

.. currentmodule:: scoringrules

.. autofunction:: crps_negbinom
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_normal.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_normal
=========================

.. currentmodule:: scoringrules

.. autofunction:: crps_normal
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_poisson.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_poisson
==========================

.. currentmodule:: scoringrules

.. autofunction:: crps_poisson
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_quantile.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_quantile
===========================

.. currentmodule:: scoringrules

.. autofunction:: crps_quantile
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_t.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_t
====================

.. currentmodule:: scoringrules

.. autofunction:: crps_t
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_tlogistic.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_tlogistic
============================

.. currentmodule:: scoringrules

.. autofunction:: crps_tlogistic
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_tnormal.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_tnormal
==========================

.. currentmodule:: scoringrules

.. autofunction:: crps_tnormal
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_tt.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_tt
=====================

.. currentmodule:: scoringrules

.. autofunction:: crps_tt
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.crps_uniform.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.crps\_uniform
==========================

.. currentmodule:: scoringrules

.. autofunction:: crps_uniform
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.es_ensemble.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.es\_ensemble
=========================

.. currentmodule:: scoringrules

.. autofunction:: es_ensemble
6 changes: 6 additions & 0 deletions docs/library/generated/scoringrules.gksmv_ensemble.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
scoringrules.gksmv\_ensemble
============================

.. currentmodule:: scoringrules

.. autofunction:: gksmv_ensemble
Loading
Loading