Skip to content

Make many improvements #10

Open
az0 wants to merge 25 commits into
wsjdata:masterfrom
az0:master
Open

Make many improvements #10
az0 wants to merge 25 commits into
wsjdata:masterfrom
az0:master

Conversation

@az0

@az0 az0 commented Feb 16, 2026

Copy link
Copy Markdown

No description provided.

az0 added 25 commits August 18, 2024 16:57
- 2to3
- check HTTP status code (but it is 404 now)
- fix call to create_tables()
- create the venv before activation
- install requirements after venv activation
* downloadMetadata.py works
* generatePDFList.py works
* use new style of timestamp
* update state.gov URLs
* use f-string
* improve logging
This stores basic metadata (e.g., page count and page size) in
the SQLite database.
* Change display unit
* Add missing requirement
* autopep8
* Fix: it was tobytes() was still defaulting to png
* Write to /dev/shm instead of /tmp
* Avoid unnecessary work inside loop
* Switch from PNG to PPM format to avoid slow compression
* directory pdfs-> pdf
* filename zipPDFs -> zipPDF
* Use f-string
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant