Skip to content

Conversation

@exowanderer
Copy link
Owner

Started code review before branch was created
Now includes updates to
docker-compose.yml
docker7 run.py
wikidataItemDB
wikidataRetriever

philippesaade-wmde and others added 30 commits March 11, 2025 15:15
Handle network errors from Jina's side
The changes here were done before the code_review branch was created.
They are being added here to streamline the next PR to include all updates from @exowanderer
…on flake8; add PYTHONPATH to docker/2_Data_Processing_save_items_per_lang/Docker
…dd PYTHONPATH to docker/2_Data_Processing_save_items_per_lang/Docker
exowanderer and others added 23 commits March 13, 2025 17:58
…TH=':/'; update use of src. in various python imports; update use of src. in src.language_variables.
- Improved cache db operations and fixed errors involve db insertion
- Improved data storage by storing the smaller base64 data per embedding, which results directly from JinaAI's API
- Refactored handling of DataStax and JinaAI errors
- Fixed duplicate ID errors
- updated our caching and merging of cache
- created migrate_db routine to update from original to smaller db
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants