Integrate RUS-EIA crosswalk

[e-belfer]

Overview

What is the problem we're solving? For very simple items, this can be encapsulated in the success criteria.

Our collaborators Matt Grimley and Gabe Chan at the University of Minnesota Hubert H. Humphrey School of Public Affairs shared with us a hand-compiled crosswalk of RUS-EIA entities (thank you!). This in fact contains three nested crosswalks:

• Relationships between RUS power suppliers (form 12 respondents) and RUS distributors (form 7 respondents)
• RUS power suppliers to EIA utility IDs
• RUS distributors to EIA utility IDs

This crosswalk will be very useful in connecting the RUS and EIA datasets, as well as describing relationships between respondents from both RUS forms.

Success Criteria

How will we know that we're done?

• The original crosswalk CSV is read into PUDL as 3 tables, one for each applicable crosswalk above
• Metadata is written explaining the provenance and intended usage of the data
• We create FK relationships to verify that all IDs provided actually exist in the reported data
• Address Handle cooperative mergers in RUS data #5152 with respect to these IDs, and update any new matches

Next steps

• Check crosswalk into glue's package data: [WIP] Add draft of RUS-EIA crosswalk #5167
• ETL crosswalk into PUDL assn tables
• Validate and verify data
• Handle new matches and mergers