Repositories list

• warn-github-flow

  Public
  GitHub Action workflow for automating a WARN Act notice ETL pipeline

  pythonnewslabor+ 4

  pythonnewslaboractionsjournalismdata-journalismgit-scraper

  Makefile

  •

  Other

  •00 forks•77 stars•88 issues•00 pull requests•Updated May 12, 2026May 12, 2026

• warn-transformer

  Public
  Consolidate, enrich and republish the data gathered by warn-scraper

  pythonnewsetl+ 4

  pythonnewsetllaborjournalismdata-journalismwarn

  Python

  •

  Other

  •33 forks•66 stars•2121 issues•11 pull request•Updated May 12, 2026May 12, 2026

• warn-scraper

  Public
  Command-line interface for downloading WARN Act notices of qualified plant closings and mass layoffs from state government websites

  pythonclinews+ 7

  pythonclinewsetllaborjournalismopen-dataeconomicsdata-journalismwarn

  Python

  •

  Other

  •1818 forks•4141 stars•5656 issues•1010 pull requests•Updated May 11, 2026May 11, 2026

• usc-crime-reports-scraper

  Public
  A GitHub Action workflow for automating the collection of crime and fire logs posted by the University of Southern California's Department of Public Safety.

  pythonnewsactions+ 5

  pythonnewsactionsjournalismweb-scrapercrimedata-journalismpdfs

  Jupyter Notebook

  •

  MIT License

  •11 fork•11 star•11 issue•00 pull requests•Updated May 11, 2026May 11, 2026

• bln-python-client

  Public
  Python client for the biglocalnews.org API

  pythonapigraphql-client+ 6

  pythonapigraphql-clientgraphqldatanewsjournalismapi-clientdata-journalism

  Python

  •

  Apache License 2.0

  •55 forks•77 stars•1111 issues•33 pull requests•Updated May 11, 2026May 11, 2026

• civic-scraper

  Public
  Tools for downloading agendas, minutes and other documents produced by local government

  pythonscrapernews+ 4

  pythonscrapernewsjournalismdata-journalismcity-council-dataagendawatch

  Python

  •

  Other

  •2323 forks•6767 stars•3939 issues•99 pull requests•Updated May 6, 2026May 6, 2026

• sync-fed-contracts

  Public
  Download U.S. government contract cancelations for convenience from FPDS; sync with Big Local News

  Jupyter Notebook

  •

  Other

  •00 forks•88 stars•1010 issues•00 pull requests•Updated Apr 19, 2026Apr 19, 2026

• clean-scraper

  Public
  Scraper library and CLI tool to harvest police bodycam footage and other files as part of the Community Law Enforcement Accountability Project (CLEAN)

  scraperclean

  scraperclean

  Python

  •

  Apache License 2.0

  •1010 forks•1010 stars•2222 issues•55 pull requests•Updated Mar 26, 2026Mar 26, 2026

• ice-data

  Public
  Big Local News deportation data project sharing site

  Lua

  •00 forks•11 star•00 issues•00 pull requests•Updated Mar 17, 2026Mar 17, 2026

• upload-files

  Public
  Upload comma-delimited files to biglocalnews.org in your GitHub Action

  datanewscsv+ 6

  datanewscsvarchivingactionsjournalismdata-journalismactiongithub-actions

  Python

  •

  Apache License 2.0

  •11 fork•33 stars•00 issues•00 pull requests•Updated Jan 12, 2026Jan 12, 2026

• sync-doge-scrape

  Public
  Sync Github archives of m-nolan/doge-scrape , a DOGE claim scraper, and put records into Big Local News' platform

  Python

  •22 forks•00 stars•11 issue•00 pull requests•Updated Nov 6, 2025Nov 6, 2025

• zips-to-counties

  Public
  Drop in county-level identifiers like FIPS codes from data that just had a ZIP code

  Jupyter Notebook

  •

  Other

  •00 forks•22 stars•00 issues•00 pull requests•Updated Jun 11, 2025Jun 11, 2025

• local-gov-research-agent

  Public
  LLM-backed agent to harvest metadata about local governments.

  pythonjournalismdata-journalism+ 2

  pythonjournalismdata-journalismcivic-techagendawatch

  Apache License 2.0

  •11 fork•11 star•1111 issues•11 pull request•Updated Apr 18, 2025Apr 18, 2025

• sync-non-core-properties

  Public
  Download U.S. General Services Administration (GSA) "non-core" web page of property to be "disposed"; convert to CSV; upload to BLN

  Jupyter Notebook

  •00 forks•00 stars•00 issues•00 pull requests•Updated Mar 28, 2025Mar 28, 2025

• .github

  Public
  Data, tools and collaborations that empower journalists to better cover their community. A project at Stanford University.

  pythonnewsjournalism+ 3

  pythonnewsjournalismdata-journalismprofile-readmegit-scraper

  00 forks•00 stars•00 issues•00 pull requests•Updated Feb 26, 2025Feb 26, 2025

• sync-gsa-properties

  Public
  Demonstration of syncing General Services Administration lease & property data with Big Local News API

  Jupyter Notebook

  •00 forks•66 stars•22 issues•00 pull requests•Updated Feb 19, 2025Feb 19, 2025

• bln-web-scraping-tutorial

  Public
  Jupyter Notebook

  •00 forks•22 stars•00 issues•00 pull requests•Updated Nov 28, 2023Nov 28, 2023

• datasette.biglocalnews.org

  Public
  A Datasette instance that allows users to explore public and private files hosted by biglocalnews.org

  sqlitedata-journalismdatasette

  sqlitedata-journalismdatasette

  Makefile

  •

  MIT License

  •00 forks•00 stars•11 issue•00 pull requests•Updated Apr 13, 2023Apr 13, 2023

• usps

  Public
  US Addresses Sampler

  Svelte

  •

  MIT License

  •00 forks•1212 stars•99 issues•00 pull requests•Updated Apr 11, 2023Apr 11, 2023

• reporting-tool

  Public
  TypeScript

  •00 forks•11 star•00 issues•11 pull request•Updated Mar 29, 2023Mar 29, 2023

• datasette

  Public
  An open source multi-tool for exploring and publishing data

  Python

  •

  Apache License 2.0

  •830830 forks•00 stars•00 issues•00 pull requests•Updated Feb 12, 2023Feb 12, 2023

• tile-tools

  Public
  Tools for working with Mapbox (and similar) tiles.

  Python

  •

  MIT License

  •00 forks•11 star•00 issues•00 pull requests•Updated Jan 31, 2023Jan 31, 2023

• court-scraper

  Public
  Scrapers for U.S. county court sites.

  pythonscrapernews+ 4

  pythonscrapernewsjournalismcourtsdata-journalismlaw-enforcement

  Python

  •

  ISC License

  •2121 forks•8080 stars•4848 issues•11 pull request•Updated Dec 13, 2022Dec 13, 2022

• bylines

  Public
  Stories, guides and other articles by the Big Local News team and its partners

  newscsvjournalism+ 1

  newscsvjournalismdata-journalism

  Apache License 2.0

  •00 forks•00 stars•00 issues•00 pull requests•Updated Dec 8, 2022Dec 8, 2022

• legistar-scraper-demo

  Public
  Quick-and-dirty demo of a non-Selenium approach to scraping Legistar.

  Python

  •22 forks•00 stars•00 issues•11 pull request•Updated Dec 8, 2022Dec 8, 2022

• local-election-results-etl

  Public
  Extract, transform and load election results posted online by local U.S. election officials

  pythonnewsetl+ 5

  pythonnewsetls3journalismdata-journalismelectionselections-data

  Jupyter Notebook

  •

  MIT License

  •22 forks•22 stars•00 issues•00 pull requests•Updated Dec 7, 2022Dec 7, 2022

• scraping-workshop

  Public
  Tutorial on web scraping with Python and PDFs

  Jupyter Notebook

  •00 forks•11 star•00 issues•00 pull requests•Updated Jul 26, 2022Jul 26, 2022

• gcp-storage-emulator

  Public
  Local emulator for Google Cloud Storage

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •4747 forks•00 stars•00 issues•00 pull requests•Updated Jul 6, 2022Jul 6, 2022

• squarelet

  Public
  MuckRock User Service

  Python

  •

  GNU Affero General Public License v3.0

  •1414 forks•00 stars•00 issues•00 pull requests•Updated Jun 2, 2022Jun 2, 2022

• prefect-flow-template

  Public template
  A template repository with all the fundamentals needed to develop and deploy a Python data-processing routine for Prefect pipelines.

  pythonpipelineetl+ 4

  pythonpipelineetldata-journalismtask-runneretl-pipelineprefect

  Python

  •

  Apache License 2.0

  •00 forks•1919 stars•11 issue•00 pull requests•Updated Mar 29, 2022Mar 29, 2022