Repositories list

• pywb-arquivo

  Public
  Arquivo.pt's branding customizations for our instance of pywb.

  CSS

  •

  GNU General Public License v3.0

  •3•2•0•4•Updated Mar 25, 2026Mar 25, 2026

• arquivo-webapp-eros

  Public
  Arquivo.pt home page web application

  CSS

  •

  GNU General Public License v3.0

  •0•0•0•3•Updated Mar 24, 2026Mar 24, 2026

• arquivo-solr-tools

  Public
  Repo that collects all scripts to be used to setup SolrCloud for images and text.

  Python

  •

  GNU General Public License v3.0

  •0•0•0•0•Updated Mar 17, 2026Mar 17, 2026

• image-and-page-search-indexing

  Public
  Image Search Indexing over web archived images using Apache Solr indexes.

  Java

  •

  GNU General Public License v3.0

  •3•2•0•5•Updated Mar 17, 2026Mar 17, 2026

• memorial

  Public
  Redirects to arquivo.pt a couple of vhosts. We call this the memorial service.

  Python

  •

  GNU General Public License v3.0

  •1•0•0•1•Updated Mar 9, 2026Mar 9, 2026

• datatrove-slurm-docker-cluster

  Public
  A Slurm cluster using docker-compose to run datatrove pipelines

  Python

  •

  MIT License

  •256•0•0•0•Updated Feb 20, 2026Feb 20, 2026

• TestCollection

  Public
  The PWA9609 test collection was created to support research on web archive information retrieval (WAIR).

  Python

  •

  GNU General Public License v3.0

  •0•0•0•0•Updated Feb 18, 2026Feb 18, 2026

• site-map-exporter

  Public
  A sitemap utility script that exports a sitemap from an URL

  Python

  •

  GNU General Public License v3.0

  •1•0•0•0•Updated Feb 16, 2026Feb 16, 2026

• crawl-seeds

  Public
  Shell

  •

  GNU General Public License v3.0

  •1•1•1•0•Updated Feb 4, 2026Feb 4, 2026

• replay-cdxj-indexing-tools

  Public
  Python tools for processing web archive CDXJ indexes at scale with parallel indexing, efficient filtering, and ZipNum conversion for pywb wayback.

  Python

  •

  GNU General Public License v3.0

  •0•0•0•0•Updated Jan 15, 2026Jan 15, 2026

• APISeedsGetter

  Public
  The repository consists of a set of scipts used to extract data from APIs. For example, RCAAP API or CienciaVitae API

  Python

  •

  Apache License 2.0

  •0•0•0•0•Updated Dec 16, 2025Dec 16, 2025

• viagens-no-tempo

  Public
  Viagens no tempo repository have some demos using a timeline presentation about some institutions.

  HTML

  •

  GNU General Public License v3.0

  •1•0•0•0•Updated Dec 11, 2025Dec 11, 2025

• functional-tests

  Public
  Functional tests developed with selenium framework for Arquivo.pt

  Java

  •

  Apache License 2.0

  •4•0•0•3•Updated Dec 2, 2025Dec 2, 2025

• cdxj-incremental-indexing

  Public
  A wrap of the pywb cdxj-indexer command line tool that offers incremental and parallel indexing of a collection.

  Python

  •

  Apache License 2.0

  •0•0•0•1•Updated Nov 18, 2025Nov 18, 2025

• screenshot-puppeteer

  Public
  Web Service that generates Web Page Screenshots

  nodejsscreenshotexpressjs+ 1

  nodejsscreenshotexpressjspuppeteer

  JavaScript

  •

  GNU General Public License v3.0

  •0•0•0•7•Updated Nov 17, 2025Nov 17, 2025

• pwa-technologies

  Public
  Arquivo.pt main goal is the preservation and access of web contents that are no longer available online. During the developing of the PWA IR (information retri…

  GNU General Public License v3.0

  •7•52•135•0•Updated Nov 6, 2025Nov 6, 2025

• wikipedia-externallinks-fast-extraction

  Public
  Fast extraction of all external links from wikipedia

  Rust

  •

  MIT License

  •3•0•0•0•Updated Oct 14, 2025Oct 14, 2025

• TestCollectionTools

  Public
  HTML

  •

  GNU General Public License v3.0

  •0•0•0•0•Updated Oct 7, 2025Oct 7, 2025

• real-time-analytics

  Public
  It will be a repository containing the code to provide real time analytics of Arquivo.pt Data

  Python

  •

  Apache License 2.0

  •0•0•0•0•Updated Sep 26, 2025Sep 26, 2025

• LogAnalyzer

  Public
  This repository will have tools/scripts/datasets to analyze the logs from Arquivo.pt

  Python

  •

  Apache License 2.0

  •0•0•0•0•Updated Sep 25, 2025Sep 25, 2025

• cdxj-explorer

  Public
  An application to explore CDXJ files

  Python

  •

  GNU General Public License v3.0

  •0•0•0•0•Updated Jul 15, 2025Jul 15, 2025

• page-search

  Public
  Arquivo.pt Page Search System

  Java

  •

  GNU General Public License v3.0

  •1•1•0•4•Updated Jun 18, 2025Jun 18, 2025

• browsertrix

  Public
  Browsertrix is the hosted, high-fidelity, browser-based crawling service from Webrecorder designed to make web archiving easier and more accessible for all!

  TypeScript

  •

  GNU Affero General Public License v3.0

  •64•0•0•0•Updated Mar 4, 2025Mar 4, 2025

• replayweb.page

  Public
  Serverless replay of web archives directly in the browser

  TypeScript

  •

  GNU Affero General Public License v3.0

  •89•0•0•0•Updated Mar 4, 2025Mar 4, 2025

• browsertrix-crawler

  Public
  Run a high-fidelity browser-based web archiving crawler in a single Docker container

  TypeScript

  •

  GNU Affero General Public License v3.0

  •134•0•0•0•Updated Mar 4, 2025Mar 4, 2025

• wombat

  Public
  Wombat.js client-side rewriting library

  JavaScript

  •

  GNU Affero General Public License v3.0

  •38•0•0•0•Updated Feb 11, 2025Feb 11, 2025

• image-search-api

  Public
  SOLR imagesearch API repository

  Java

  •

  GNU General Public License v3.0

  •2•2•3•2•Updated Jan 22, 2025Jan 22, 2025

• archiveweb.page

  Public
  A High-Fidelity Web Archiving Extension for Chrome and Chromium based browsers!

  TypeScript

  •

  GNU Affero General Public License v3.0

  •102•0•0•0•Updated Jan 10, 2025Jan 10, 2025

• cdxj-indexer

  Public
  CDXJ Indexing of WARC/ARCs

  Python

  •

  Apache License 2.0

  •15•0•0•0•Updated Dec 10, 2024Dec 10, 2024

• warcio

  Public
  Streaming WARC/ARC library for fast web archive IO

  Python

  •

  Apache License 2.0

  •68•0•0•0•Updated Dec 10, 2024Dec 10, 2024