Skip to content

Pandera PoC#145

Draft
patricktnast wants to merge 13 commits intomainfrom
pnast/feature/mic-6332/pandera-poc
Draft

Pandera PoC#145
patricktnast wants to merge 13 commits intomainfrom
pnast/feature/mic-6332/pandera-poc

Conversation

@patricktnast
Copy link
Contributor

Pandera PoC

Description

Changes and notes

use pandera decorator to check risk factor data pull in-line
unfortunately, there are some problematic situations where column types are 'object' that we cannot easily make tighter at the moment. that will probably require some changes upstream. a good argument for also doing pandera checks in vivarium_gbd_access.

Testing

stuck a problematic non-unique rei_id in the df, found that it failed validation.

patricktnast and others added 12 commits July 30, 2025 11:11
* Update covariate mapping for GBD 2023

* change age restriction bins

* run build mapping

* Revert "Update covariate mapping for GBD 2023"

This reverts commit 0f95afa.

* add to gitignore

* re-run generator
* Update etiology mapping for GBD 2023

* replace spp. with spp

* remove trailing periods

* revert change to etiology name field
* new risk factors

* handle NaN inv_exp

* add a few new rfs

* run risk factors without PAF Computation rei set.

* try reverting change to inv_exp after new data pulls

* lint

* revert, but take out tmred if tmred_dist is NaN for ensemble

* revert change

* revert again

* add include_all_metadata

* defer to minimal change
@patricktnast patricktnast changed the base branch from main to epic/gbd_2023_migration August 28, 2025 17:47
@patricktnast patricktnast force-pushed the epic/gbd_2023_migration branch 3 times, most recently from 5477344 to 31b7fcb Compare October 2, 2025 20:55
Base automatically changed from epic/gbd_2023_migration to main October 2, 2025 21:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

Comments