Field updates (ExternalParentId/ExternalId) + Removed obsolete old system REP

v2.5.21

Update setup.py

Field updates (ExternalParentId/ExternalId) in ProcessBatch

v2.5.20b

remove old REP display

NEW UPLOAD API Latest

v2.5.20

NEW UPLOAD API

Extended domains (social)

Extend social domains (#70)

* Update process_batch.py

* Update process_batch.py

* Update setup.py

* Update spotting.py

* Update spotting.py

Minor preprocessing & case handling fix

Text content won't be lowercased anymore, better keywords extract

v2.5.13

Update setup.py

New Optimized data pipeline (new tag, lower RAM, lighter image)

Optimized data pipeline (new ZS model, better RAM usage)

Update lab_initialization.py
Update pre_install.py
Update zero_shot.py
Update tag.py
Update Dockerfile
Update models.py
Removes a large zero shot model used until now, for a smaller, more efficient, with similar accuracy model.
We now are able to add it to the batch processing data pipeline and remove it from inter-item processing, accelerating the process & lot, reducing RAM usage over time.

The image will now be 1.2Gb smaller or so, and will have very fast item processing time, with all models loaded in RAM beforehand.

Minor domain fix

Batch processing optimization (#66)

* Update lab_initialization.py
* Update pre_install.py
* Update zero_shot.py
* Update tag.py
* Update Dockerfile
* Update models.py


Removes a large zero shot model used until now, for a smaller, more efficient, with similar accuracy model.
We now are able to add it to the batch processing data pipeline and remove it from inter-item processing, accelerating the process & lot, reducing RAM usage over time.

The image will now be 1.2Gb smaller or so, and will have very fast item processing time, with all models loaded in RAM beforehand.

Added raw/translated content

We added the raw & translated content to the IPFS uploads.
This provide more content to the Network.

Improved translation modules + Dockerfile minor fix Latest

Improved translation modules + Dockerfile minor fix
Latest Argostranslate updated to version 1.9.6, with CTranslate2 indirectly bumped to v4.