Research Task - Annual NTD: Replace RTPA crosswalk with dim_organizations

[csuyat-dot]

Research Task

Current scripts for the Annual NTD ridership report uses a custom crosswalk ntd_id_rtpa_crosswalk_all_reporter_types.parquet to map ntd_ids to RTPA name.

dim_organizations now has a column for rtpa_name and was decided to move forward with refactoring any analyses that used the initial crosswalk to be replaced with dim_organizations.rtpa_name

• Relevant PR (if applicable):

• compare ntd_id_to_rtpa_crosswalk to dim_organization.rtpa_name #1494

• Question or Goal:

• Data Required:

  • Currently have:
  • Need:

• Research Required:

• Metrics:

• Expected Outputs / Findings:
  Refactored scripts and a rebuilt/redeployed portfolio site

[csuyat-dot]

Need to get last_report_year from another table in order to remove agencies that have not reported since 2018.

[csuyat-dot]

See PR #1529 and #1530. Completed replacement of crosswalk with new ntd_id_to_rtpa_crosswalk function to get rtpa name out of dim_organizations. Also updated the deploy yaml script and main notebook to break out the SCAG agencies into individual CTCs.