classic-graphics-provisioning

Command line utility (run.py) for managing the ADS graphics database and the pipeline that populates it with figures extracted from published articles and arXiv preprints.

Usage

python run.py <command> [options]

Commands

updatedb

Update the graphics database by fetching identifiers for a publisher set, journal, year (range), or a specific identifier/bibcode, and processing their graphics.

• --identifier, -i — comma-separated bibcodes or arXiv IDs to process
• --year, -y — year or year range (e.g. 2023-2024)
• --journal, -j — comma-separated bibstems
• --set, -s — comma-separated publisher sets (default: IOP, arXiv)
• --force, -f — reprocess entries even if already present

checkdb

Inspect or modify individual entries in the graphics database.

• --identifier, -i <bibcode> — print the stored figures for a bibcode
• --set, -s <source> — list all bibcodes stored for a given source
• --delete, -d <bibcode> — delete the database entry for a bibcode, along with any of its thumbnail images stored in our S3 bucket (thumbnails hosted on third-party sites, e.g. IOP/Elsevier/APS, are left untouched)

backupdb

Back up all database entries for a given source to individual JSON files.

• --set, -s <source> — publisher set/source to back up (required)

getdata

Retrieve MNRAS/MNRASL images from the configured source directory and copy them into the target directory structure.

• positional journal — either MNRAS or MNRASL

export

Export a tab-separated count of thumbnails per bibcode (graphics.tab) and, per source, a TSV of thumbnail/label links (<source>.graphics.links.tsv) to the configured export directory.

Configuration

Configuration is loaded from config.py, optionally overlaid with a local_config.py (not checked into version control) for local/secret overrides such as database URLs and AWS credentials. The graphics database connection is read from SQLALCHEMY_BINDS['graphics'].