Repositories list

• pywb

  Public archive
  Core Python Web Archiving Toolkit for replay and recording of web archives

  JavaScript

  •

  GNU General Public License v3.0

  •239•0•0•0•Updated Jan 5, 2026Jan 5, 2026

• webarchive-discovery

  Public
  Please note that the warc-indexer tool & code is now supported by NetArchiveSuite. The 'warc-indexer' directory and code that exists in this repo is now only for reference. For support and issues of 'warc-indexer', please communicate with NetArchiveSuite.

  Java

  •26•132•90•3•Updated Nov 21, 2025Nov 21, 2025

• ukwa-pywb

  Public
  JavaScript

  •

  GNU General Public License v3.0

  •4•11•24•0•Updated Nov 21, 2025Nov 21, 2025

• ukwa-heritrix

  Public archive
  The UKWA Heritrix3 custom modules and Docker builder.

  Java

  •7•11•45•1•Updated Dec 2, 2024Dec 2, 2024

• w3act

  Public
  w3act is an annotation and curation tool for building web archive collections

  Java

  •

  Apache License 2.0

  •6•21•65•0•Updated Jan 30, 2024Jan 30, 2024

• py-wacz

  Public archive
  Python

  •

  MIT License

  •13•0•0•0•Updated Sep 14, 2023Sep 14, 2023

• hapy

  Public archive
  A Python wrapper around the Heritrix API.

  Python

  •

  Apache License 2.0

  •4•4•0•0•Updated Aug 29, 2023Aug 29, 2023

• heritrix3

  Public archive
  Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.

  Java

  •

  Other

  •780•0•0•0•Updated Jul 28, 2022Jul 28, 2022

• siegfried

  Public archive
  signature-based file format identification

  Go

  •

  Apache License 2.0

  •31•0•0•0•Updated May 14, 2022May 14, 2022

• browsertrix-cloud

  Public archive
  TypeScript

  •

  GNU Affero General Public License v3.0

  •62•0•0•0•Updated May 13, 2022May 13, 2022

• solrwayback

  Public archive
  A search interface and wayback machine for the UKWA Solr based warc-indexer framework.

  Java

  •

  Apache License 2.0

  •27•0•0•0•Updated May 4, 2022May 4, 2022

• mrjob

  Public archive
  Run MapReduce jobs on Hadoop or Amazon Web Services

  Python

  •

  Other

  •586•0•0•0•Updated Mar 23, 2022Mar 23, 2022

• mementoweb-client-java

  Public archive
  Core Java libraries for Memento clients.

  Java

  •

  Apache License 2.0

  •2•1•2•0•Updated Jan 5, 2022Jan 5, 2022

• rclone

  Public archive
  "rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Yandex Files

  Go

  •

  MIT License

  •4.8k•0•0•0•Updated Nov 12, 2021Nov 12, 2021

• puppeteer

  Public archive
  Headless Chrome Node.js API

  TypeScript

  •

  Apache License 2.0

  •9.4k•0•0•0•Updated Oct 13, 2021Oct 13, 2021

• browsertrix-crawler

  Public archive
  Run a high-fidelity browser-based crawler in a single Docker container

  JavaScript

  •

  GNU Affero General Public License v3.0

  •125•1•0•0•Updated Sep 24, 2021Sep 24, 2021

• banana

  Public archive
  Banana for Solr - A Port of Kibana

  JavaScript

  •

  Other

  •234•0•0•0•Updated Dec 17, 2020Dec 17, 2020

• outbackcdx

  Public archive
  A Wayback RemoteResourceIndex server using RocksDB

  Java

  •

  Apache License 2.0

  •21•0•0•0•Updated Oct 9, 2020Oct 9, 2020

• shine

  Public archive
  Prototype SOLR-powered web archive exploration UI.

  JavaScript

  •

  Apache License 2.0

  •7•43•50•0•Updated Jun 3, 2020Jun 3, 2020

• web-archives

  Public archive
  Jupyter Notebook

  •8•0•0•0•Updated May 14, 2020May 14, 2020

• webarchive-commons

  Public archive
  Java

  •

  Apache License 2.0

  •74•2•0•1•Updated Feb 17, 2020Feb 17, 2020

• openwayback

  Public archive
  The OpenWayback Development Project

  Java

  •

  Apache License 2.0

  •302•0•0•0•Updated Feb 17, 2020Feb 17, 2020

• webarchiving-notebooks

  Public archive
  A collection of Jupyter notebooks for working with web archive data, tools and APIs

  Jupyter Notebook

  •

  GNU General Public License v3.0

  •2•7•0•0•Updated Nov 18, 2019Nov 18, 2019

• opendata

  Public
  Repository of documentation about the open datasets published by the UK Web Archive.

  HTML

  •6•15•1•0•Updated Jun 21, 2019Jun 21, 2019

• iipc_workshop_warclight

  Public archive
  A 'vanilla' Warclight instance for workshops and demonstration.

  Ruby

  •1•0•0•0•Updated Apr 17, 2019Apr 17, 2019

• python-heritrix

  Public archive
  simple python wrapper around heritrix v3.x api

  Python

  •

  MIT License

  •5•4•0•1•Updated Apr 16, 2019Apr 16, 2019

• awesome-web-archiving

  Public archive
  An Awesome List for getting started with web archiving

  176•9•0•0•Updated Mar 7, 2019Mar 7, 2019

• warcprox

  Public archive
  WARC writing MITM HTTP/S proxy

  Python

  •65•0•0•0•Updated Mar 4, 2019Mar 4, 2019

• omeka-s-docker

  Public archive
  Dockerfile

  •31•0•0•0•Updated Jan 22, 2019Jan 22, 2019

• jupyterhub-deploy-docker

  Public archive
  Reference deployment of JupyterHub with docker

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •388•0•0•0•Updated Jan 18, 2019Jan 18, 2019