Skip to content

@history-lab History Lab

Change the repository type filter

All

    Repositories list

    43 repositories

    • foiarchive-search

      Public
      Streamlit for FOIArchive search GUI
      Python
      •
      MIT License
      •3•2•0•0•Updated Nov 20, 2025Nov 20, 2025

    • chat-agent-historylab

      Public
      specific chat agent for history lab
      TypeScript
      •
      MIT License
      •0•1•7•0•Updated Oct 15, 2025Oct 15, 2025

    • chunk-finder

      Public
      Searches vectorize for similar chunks. Exports a worker entrypoint for chat agent
      TypeScript
      •0•0•0•0•Updated Aug 30, 2025Aug 30, 2025

    • foiarchive-api

      Public archive
      This API was officially retired in August 2025.
      Python
      •0•3•10•3•Updated Aug 19, 2025Aug 19, 2025

    • HLSTM

      Public
      R
      •
      Other
      •0•0•0•0•Updated Jul 16, 2025Jul 16, 2025

    • login-auth

      Public
      Handles registration/login and form submission
      TypeScript
      •0•0•0•0•Updated Jun 2, 2025Jun 2, 2025

    • histlabapi

      Public
      R interface with History Lab's API
      R
      •1•0•0•0•Updated Apr 28, 2025Apr 28, 2025

    • hlapiStata

      Public
      Stata package to access History Lab API
      Stata
      •1•0•0•0•Updated Apr 28, 2025Apr 28, 2025

    • foiarchive-postgres

      Public
      Scripts, configuration and examples for the PostgREST proof of concept
      PLpgSQL
      •0•1•0•0•Updated Apr 21, 2025Apr 21, 2025

    • convo-analytics

      Public
      TypeScript
      •0•0•0•0•Updated Apr 15, 2025Apr 15, 2025

    • create_collection

      Public
      workers for creating a collection on the Ramus Network
      TypeScript
      •0•0•0•0•Updated Apr 12, 2025Apr 12, 2025

    • upload_file

      Public
      Workers that handle bulk file uploads
      TypeScript
      •0•0•1•0•Updated Apr 10, 2025Apr 10, 2025

    • embedding-generator

      Public
      Generates embeddings and stores them in vectorize. RPCed by chunker
      TypeScript
      •0•0•0•0•Updated Apr 10, 2025Apr 10, 2025

    • chunker

      Public
      gets triggered by R2 upload + add to queue, chunks up text and RPCs the embedder
      TypeScript
      •0•0•0•0•Updated Mar 31, 2025Mar 31, 2025

    • historylab-docviewer

      Public
      TypeScript
      •0•0•1•0•Updated Mar 21, 2025Mar 21, 2025

    • covid19-search

      Public
      Search dashboard of History Lab's unified COVID-19 collection
      Python
      •
      MIT License
      •0•0•0•0•Updated Feb 5, 2025Feb 5, 2025

    • foiarchive2json

      Public
      Utility that takes a FOIArchive database SQL query as input and produces the result set in a JSON file.
      Python
      •0•0•0•0•Updated Jan 9, 2025Jan 9, 2025

    • covid19-streamlit

      Public
      History Lab COVID-19 Archive Prototype
      Python
      •
      MIT License
      •0•0•0•0•Updated Nov 20, 2024Nov 20, 2024

    • pplc

      Public
      pandemic program link checker
      Python
      •
      MIT License
      •0•0•0•0•Updated Oct 31, 2024Oct 31, 2024

    • mosaic-llm-db

      Public
      Database views and scripts that support the Mosaic LLM project
      Shell
      •0•0•0•0•Updated Oct 31, 2024Oct 31, 2024

    • un-archives-db-schema

      Public
      Corpus-specific schema objects for UN Archives metadata and text
      0•0•0•0•Updated Oct 31, 2024Oct 31, 2024

    • archiving-digital-records

      Public
      Course materials from the 2023 & 2024 Archiving Digital Records track of the Archives as Data Summer Institute.
      1•3•0•0•Updated Oct 30, 2024Oct 30, 2024

    • topic-model-updates

      Public
      Scripts for updating corpus-specific topic models in the FOIArchive database.
      Shell
      •
      MIT License
      •0•0•0•0•Updated Oct 21, 2024Oct 21, 2024

    • foiarchive2csv

      Public
      SQL scripts for dumping FOIArchive data to CSV
      0•0•0•0•Updated Sep 27, 2024Sep 27, 2024

    • HL-Spring-24

      Public
      Jupyter Notebook
      •1•0•0•0•Updated May 20, 2024May 20, 2024

    • foiarchive-api-python-example

      Public
      Example of querying the FOIArchive REST API via a Python program
      Jupyter Notebook
      •
      MIT License
      •0•0•0•0•Updated Feb 27, 2024Feb 27, 2024

    • HL-Fall-23

      Public
      Research project investigating OCR evaluation mechanisms at Columbia's History Lab.
      Python
      •1•0•0•0•Updated Feb 13, 2024Feb 13, 2024

    • foiarchive-pdfloader

      Public
      Downloads PDFs and stores the text in the FOIArchive database and a copy in an s3 bucket
      Python
      •
      MIT License
      •0•0•0•0•Updated Jan 28, 2024Jan 28, 2024

    • covid19-muckrock

      Public
      Scripts for preprocessing and loading of metadata and text for the History Lab-Muckrock COVID-19 Collection
      Python
      •
      MIT License
      •0•0•0•0•Updated Oct 16, 2023Oct 16, 2023

    • piir-eval

      Public
      Framework for PII redaction evaluation
      PLpgSQL
      •0•1•0•0•Updated Apr 28, 2023Apr 28, 2023