Skip to content

Update ntd to rtpa crosswalk for NTD monthly Report #1533

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
csuyat-dot merged 8 commits into from
Jun 20, 2025
Merged

Update ntd to rtpa crosswalk for NTD monthly Report #1533

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
d75bce6
started to apply and update functions for monthly report
csuyat-dot Jun 19, 2025
5d41912
refactor big report function to get last report year post-2018 and rtpa
csuyat-dot Jun 19, 2025
620c7f4
almost done with big report function
csuyat-dot Jun 19, 2025
48af6b7
testing updated function and importing from module
csuyat-dot Jun 20, 2025
6c1f9fb
deprecated old functions in monthly script. moved functions to new mo…
csuyat-dot Jun 20, 2025
9cf297e
updated column names to work with new report data
csuyat-dot Jun 20, 2025
7daa7b5
clearned main NB. checked SLOCOG data in explore notebook
csuyat-dot Jun 20, 2025
1ffb36c
full script run successful
csuyat-dot Jun 20, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
474 changes: 474 additions & 0 deletions ntd/_01_ntd_ridership_utils.py
View file
Open in desktop

Large diffs are not rendered by default.

3 changes: 2 additions & 1 deletion ntd/annual_ridership_report/annual_ridership_module.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
import os
import shutil
import sys
import annual_ridership_module
# import annual_ridership_module
sys.path.append("../") # up one level

import pandas as pd
Expand Down Expand Up @@ -102,6 +102,7 @@ def ntd_id_to_rtpa_crosswalk(split_scag:bool) -> pd.DataFrame:
"San Bernardino": "San Bernardino County Transportation Authority",
"Riverside": "Riverside County Transportation Commission",
"Orange": "Orange County Transportation Authority",
"Imperial": "Imperial County Transportation Commission"
}

# Get agencies and RTPA name
Expand Down
11 changes: 6 additions & 5 deletions ntd/deploy_portfolio_yaml.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,19 +13,20 @@

from shared_utils import portfolio_utils
from update_vars import GCS_FILE_PATH
from _01_ntd_ridership_utils import ntd_id_to_rtpa_crosswalk # getting rtpa_name from dim_organizations now

PORTFOLIO_SITE_YAML = Path("../portfolio/sites/ntd_monthly_ridership.yml")

if __name__ == "__main__":

df = pd.read_parquet(
f"{GCS_FILE_PATH}ntd_id_rtpa_crosswalk.parquet",
columns = ["RTPA"]
).drop_duplicates().sort_values("RTPA").reset_index(drop=True)
df = ntd_id_to_rtpa_crosswalk(split_scag=True)["rtpa_name"].drop_duplicates().to_frame()
# add row for LADPW
ladpw= pd.DataFrame({"rtpa_name":["Los Angeles County Department of Public Works"]})
df = pd.concat([df, ladpw], ignore_index=True).sort_values(by="rtpa_name")

portfolio_utils.create_portfolio_yaml_chapters_no_sections(
PORTFOLIO_SITE_YAML,
chapter_name = "rtpa",
chapter_values =list(df.RTPA)
chapter_values =list(df.rtpa_name)
)

Loading
Loading