Skip to content

Commit 1c3e8a5

Browse files
committed
✏️ resolve issue #87
1 parent 15768bd commit 1c3e8a5

2 files changed

Lines changed: 42 additions & 2 deletions

File tree

paper/paper.bib

Lines changed: 40 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,14 @@ @inproceedings{sommer2025mile
55
year={2025},
66
}
77

8+
@inproceedings{sommer2026smile,
9+
title = {{Can Microcanonical Langevin Dynamics Leverage Mini-Batch Gradient Noise?}},
10+
author = {Emanuel Sommer and Kangning Diao and Jakob Robnik and Uroš Seljak and David R{\"u}gamer},
11+
booktitle={Forty-third International Conference on Machine Learning},
12+
year={2026},
13+
publisher={PMLR},
14+
}
15+
816
@inproceedings{sommer2024connecting,
917
title={Connecting the Dots: Is Mode-Connectedness the Key to Feasible Sample-Based Inference in Bayesian Neural Networks?},
1018
author={Sommer, Emanuel and Wimmer, Lisa and Papamarkou, Theodore and Bothmann, Ludwig and Bischl, Bernd and R{\"u}gamer, David},
@@ -21,6 +29,38 @@ @InProceedings{papamarkou2024position
2129
publisher = {PMLR}
2230
}
2331

32+
@article{pymc2023,
33+
title = {{PyMC}: A Modern and Comprehensive Probabilistic Programming Framework in {P}ython},
34+
author = {Oriol Abril-Pla and Virgile Andreani and Colin Carroll and Larry Dong and Christopher J. Fonnesbeck and Maxim Kochurov and Ravin Kumar and Junpeng Lao and Christian C. Luhmann and Osvaldo A. Martin and Michael Osthege and Ricardo Vieira and Thomas Wiecki and Robert Zinkov },
35+
journal = {{PeerJ} Computer Science},
36+
volume = {9},
37+
number = {e1516},
38+
doi = {10.7717/peerj-cs.1516},
39+
year = {2023}
40+
}
41+
42+
@article{phan2019numpyro,
43+
title={Composable Effects for Flexible and Accelerated Probabilistic Programming in NumPyro},
44+
author={Phan, Du and Pradhan, Neeraj and Jankowiak, Martin},
45+
journal={arXiv preprint arXiv:1912.11554},
46+
year={2019}
47+
}
48+
@inproceedings{daxberger2021laplace,
49+
title = {Laplace {{Redux}} {\textendash} {{Effortless Bayesian Deep Learning}}},
50+
booktitle = {35th {{Conference}} on {{Neural Information Processing Systems}} ({{NeurIPS}} 2021)},
51+
author = {Daxberger, Erik and Kristiadi, Agustinus and Immer, Alexander and Eschenhagen, Runa and Bauer, Matthias and Hennig, Philipp},
52+
year = {2021},
53+
keywords = {approximate\_inference,bnn,gaussian\_posterior,laplace,last\_layer,uncertainty\_quantification}
54+
}
55+
56+
@inproceedings{
57+
duffield2025scalable,
58+
title={Scalable Bayesian Learning with posteriors},
59+
author={Samuel Duffield and Kaelan Donatella and Johnathan Chiu and Phoebe Klett and Daniel Simpson},
60+
booktitle={The Thirteenth International Conference on Learning Representations},
61+
year={2025}
62+
}
63+
2464
@misc{cabezas2024blackjax,
2565
title={{BlackJAX: Composable Bayesian inference in JAX}},
2666
author={Alberto Cabezas and Adrien Corenflos and Junpeng Lao and Rémi Louf},
@@ -92,4 +132,3 @@ @misc{misc_bike_sharing_dataset_275
92132
year = {2013},
93133
howpublished = {UCI Machine Learning Repository}
94134
}
95-

paper/paper.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -47,10 +47,11 @@ The workflow of `bde` implements the two-stage BDE inference process of MILE. Fi
4747
# Software design
4848

4949
Because optimization and sampling across ensemble members are independent, `bde` exploits JAX’s parallelization and just-in-time compilation to scale efficiently across CPUs, GPUs, and TPUs. Given new test data, the package approximates the posterior predictive, enabling point predictions, credible intervals, coverage estimates, and other uncertainty metrics through a unified interface.
50+
Further, this work currently targets the well-studied and empirically validated full-batch, fully connected-network setting for tabular data also studied in MILE [@sommer2025mile]. This makes it particularly suitable for the chosen scikit-learn framework. Stochastic-gradient variants such as SMILE [@sommer2026smile] require different algorithmic and software design choices, yet will be considered for future extensions.
5051

5152
# State of the field
5253

53-
Reliable uncertainty quantification (UQ) is increasingly viewed as a critical component of modern machine learning systems, and BDL provides a principled framework for achieving it [@papamarkou2024position]. While several libraries support optimization-based approaches such as variational inference or classical Bayesian modeling, accessible tools for sampling-based inference in Bayesian neural networks remain scarce. Existing probabilistic programming frameworks offer MCMC but require substantial manual configuration to achieve competitive performance on neural network models.
54+
Reliable uncertainty quantification (UQ) is increasingly viewed as a critical component of modern machine learning systems, and BDL provides a principled framework for achieving it [@papamarkou2024position]. While several libraries support optimization-based approaches such as variational inference [@duffield2025scalable], Laplace approximations [@daxberger2021laplace], or classical Bayesian modeling [@pymc2023], accessible tools for sampling-based inference in Bayesian neural networks remain scarce. Existing probabilistic programming and inference frameworks such as NumPyro [@phan2019numpyro] and `blackjax` [@cabezas2024blackjax] offer MCMC building blocks but require substantial manual configuration to achieve competitive Bayesian neural-network workflows.
5455

5556
# Statement of need
5657

0 commit comments

Comments
 (0)