Release feluda-0.10.0

What's Changed

• merge main to dev by @aatmanvaidya in #608
• merge main to dev by @aatmanvaidya in #612
• fix: operators link by @omkar-334 in #610
• fix: operator name by @omkar-334 in #611
• chore: remove src folder by @aatmanvaidya in #623
• Add Integration Test for feluda, feluda-vid-vec-rep-clip and feluda-dimension-reduction by @blenbot in #625
• merge dev to main by @aatmanvaidya in #627
• #547 Update pyproject.toml with Best Practices by @bhavna3 in #628
• Optimize vid_vec_rep_clip operator for long videos and add profiling … by @Ishaswm in #624
• fix: media urls in media factor test by @aatmanvaidya in #630
• Improve detect_lewd_images.py and update test suite by @Ishaswm in #629
• Refactor feluda core by @omkar-334 in #639
• refactor: vid_vec_rep_clip operator by @omkar-334 in #641
• chore: minor fixes by @omkar-334 in #644
• refactor: ImageVecRepResnet operator by @omkar-334 in #643
• refactor: dimension_reduction operator by @omkar-334 in #646
• Make Feluda core and Operators compatible for Documentation by @omkar-334 in #647
• Add documentation setup by @omkar-334 in #648
• fix: minor changes by @omkar-334 in #652
• refactor: cluster_embeddings operator by @omkar-334 in #654
• refactor: classify_video_zero_shot operator by @omkar-334 in #653
• GitHub Action to Publish Docs by @omkar-334 in #656
• fix: video has tmk logic by @aatmanvaidya in #657
• fix: unit tests by @omkar-334 in #662
• refactor: detect_lewd_images operator by @omkar-334 in #660
• refactor: detect_text_in_image operator by @omkar-334 in #661
• fix: test imports by @omkar-334 in #667
• refactor: video_hash_tmk operator by @omkar-334 in #666
• fix: list/tensor errors by @omkar-334 in #670
• Fix Integration tests by @omkar-334 in #665
• feat: add benchmarks by @omkar-334 in #672
• feat: add lazy Imports by @omkar-334 in #676
• chore: migrate examples by @omkar-334 in #673
• fix: operator class names and imports by @omkar-334 in #677
• Update documentation and examples by @omkar-334 in #678
• merge dev to main by @aatmanvaidya in #679

New Contributors

• @blenbot made their first contribution in #625
• @bhavna3 made their first contribution in #628
• @Ishaswm made their first contribution in #624

Full Changelog: feluda-0.9.4...feluda-0.10.0

Release feluda-0.9.4

What's Changed

• merge main to development by @aatmanvaidya in #537
• Fix broken URL in readme by @omkar-334 in #538
• Fix: typo in README and grammar cleanup by @mohitnandaniya-devloper in #541
• Fix colab examples by @omkar-334 in #542
• fix(cluster_embeddings): update run function to require explicit modality by @Rajat-Yd in #560
• Update root folder and schedule interval by @omkar-334 in #558
• Move Classify_video_zero_shot operator by @omkar-334 in #559
• #564 Add integration tests for vid_vec_rep_clip and cluster_embeddings operators by @hooiv in #566
• test(feluda): add integration test for feluda-cluster-embeddings by @Rajat-Yd in #570
• feat: detect-lewd-images operator (using Bumble's private detector) by @omkar-334 in #571
• fix: delete input file after processing (classify_video_zero_shot operator) by @omkar-334 in #582
• #561 Add Integration Test for feluda and feluda-dimension-reduction by @Dishant-garg in #573
• fix: move classify-video-zero-shot example by @omkar-334 in #572
• feat(test): Add integration test for classify-video-zero-shot operator by @someshjoyguru in #587
• Add UMAP support for dimension reduction by @SarthakB11 in #588
• test(clip): added mock integration tests using CLIP by @Vaibhaav-Tiwari in #569
• docs: add basic usage section to README by @Rajat-Yd in #584
• Fix: Unit test fix and Bug fix by @PinrLi in #532
• #547 Pyproject to ml by @parthshah02 in #568
• #575 fix: move detect text in image tesseract operator as python libraray by @Dishant-garg in #586
• Add unit tests for operator.py by @SarthakB11 in #589
• Pr_security by @denma98 in #585
• misc changes by @aatmanvaidya in #597
• fix: install tesseract-ocr and cleanup by @omkar-334 in #596
• feat: hash operator added by @denma98 in #593
• chore: remove old github actions by @aatmanvaidya in #599
• #473 GitHub action to publish python packages to PyPi by @hooiv in #567
• chore: add video hash tmk operator to uv workspace by @aatmanvaidya in #600
• merge dev to main by @aatmanvaidya in #601

New Contributors

• @omkar-334 made their first contribution in #538
• @mohitnandaniya-devloper made their first contribution in #541
• @Rajat-Yd made their first contribution in #560
• @hooiv made their first contribution in #566
• @Dishant-garg made their first contribution in #573
• @someshjoyguru made their first contribution in #587
• @SarthakB11 made their first contribution in #588
• @Vaibhaav-Tiwari made their first contribution in #569
• @PinrLi made their first contribution in #532
• @parthshah02 made their first contribution in #568

Full Changelog: feluda-0.9.3...feluda-0.9.4

Release feluda-0.9.3

What's Changed

• merge main to dev by @aatmanvaidya in #501
• update operator-test.yml by @rico33631 in #503
• merge main to dev by @aatmanvaidya in #521
• fix: updated semantic script by @denma98 in #520
• test: optimise feluda and image vec integration test by @aatmanvaidya in #524
• fix: added optional dependencies support to toml script by @denma98 in #525
• updated merge-main by @denma98 in #531
• package upgrade and script changes by @aatmanvaidya in #533
• optimise example use cases jupyter notebooks by @aatmanvaidya in #534
• merge development to main by @aatmanvaidya in #535

New Contributors

• @rico33631 made their first contribution in #503
• @denma98 made their first contribution in #520

Full Changelog: feluda-0.9.2...feluda-0.9.3

Release feluda-0.9.2

What's Changed

• merge main to dev by @aatmanvaidya in #486
• tests and minor changes by @aatmanvaidya in #488
• ci: run tests on PR by @aatmanvaidya in #489
• chore: pre-commit hook to sort imports by @aatmanvaidya in #491
• Added Example Notebook for TSNE plots by @plon-Susk7 in #493
• Integration tests by @aatmanvaidya in #495
• chore: fix formatting of example notebook by @aatmanvaidya in #496
• chore: update elasticsearch version by @aatmanvaidya in #498
• docs: update readme by @aatmanvaidya in #500
• merge dev to main by @aatmanvaidya in #499

Full Changelog: feluda-0.9.1...feluda-0.9.2

Release feluda-0.9.1

What's Changed

• chore: testing ci/cd by @dennyabrain in #476
• moving operators by @aatmanvaidya in #479
• merge dev to main by @aatmanvaidya in #480
• merge main to dev by @aatmanvaidya in #481
• Fix semantic script by @aatmanvaidya in #483
• merge dev to main by @aatmanvaidya in #485

Full Changelog: feluda-0.9.0...feluda-0.9.1

Release feluda-0.9.0

Overview

Feluda is now available as a python package. Work is underway to publish feluda operators as packages now.

With this release, feluda has gotten easier to use for developers and researchers who know python but aren't necessarily well versed with Machine Learning. How easy, you ask?

1. Install Dependencies

pip install feluda 
pip install feluda-image-vec-rep-resnet

2. Use in your code

from feluda import Feluda
from feluda.models.media_factory import ImageFactory

feluda = Feluda(r"config.yaml")
feluda.setup() 

image_obj = ImageFactory.make_from_url("https://tattle-media.s3.amazonaws.com/test-data/tattle-search/text-in-image-test-hindi.png")
operator = feluda.operators.get()["image_vec_rep_resnet"]
image_vec = operator.run(image_obj)
print(len(image_vec))

This modularization makes it possible to integrate feluda into your existing workflows and use feluda to analyze multimodal data. With this modularization, we are also encouraging community to work on their own feluda operators.

Majority of this work was led by @aatmanvaidya and @plon-Susk7.

What's Changed

• Wrote Tests for Queue [RabbitMQ] #320 by @plon-Susk7 in #400
• Added support to extract language from video by @plon-Susk7 in #408
• Added support to the operator detect_text_in_image_tesseract for Tamil and Telugu by @plon-Susk7 in #411
• Recipe for searching similar videos by @plon-Susk7 in #412
• Recipe for searching similar audios by @plon-Susk7 in #417
• Recipe for embedding reduction [Videos] by @plon-Susk7 in #418
• Recipe for creating clusters [Videos] by @plon-Susk7 in #419
• Recipe for classifying videos into predefined category by @plon-Susk7 in #420
• Recipe for processing newspaper and searching text through them. by @plon-Susk7 in #424
• chore: moving image vec operator out of src by @aatmanvaidya in #433
• Initial uv setup for Feluda and image_vec_rep_resnet operator by @plon-Susk7 in #434
• feat: refactor feluda API by @aatmanvaidya in #438
• Added update script to update toml files by @plon-Susk7 in #439
• feat: setup uv and refactor feluda structure by @aatmanvaidya in #442
• Test cases for text_vec_rep_paraphrase_lxml operator #421 by @adoo100 in #446
• Added new workflow for version bump by @plon-Susk7 in #458
• some improvements by @aatmanvaidya in #459
• merge dev to main by @aatmanvaidya in #460

New Contributors

• @plon-Susk7 made their first contribution in #400
• @adoo100 made their first contribution in #446

Full Changelog: v0.8.0...feluda-0.9.0

v0.8.0

v0.8.0 (2024-09-12)

Chore

• chore: updating vid vec rep resenet packages (9f212c2)

• chore: updating audio vec embedding pacakges (a41f996)

• chore: updating audio vec embedding pacakges (6e50e06)

• chore: fix conflict in updating requirements packages (acf1a56)

• chore: updating requirements packages (5390073)

• chore: fix ruff lint warnings (5f73898)

• chore: add error handling to clustering and reduction operations (ba01287)

• chore: hardcode perplexity value for t-SNE (60315b5)

• chore: change operator name to be more verbose

Signed-off-by: Snehil Shah <[email protected]> (45bef72)

• chore: remove obsolete print statement

Signed-off-by: Snehil Shah <[email protected]> (92d02e2)

• chore: remove the file after the operation has ended

Signed-off-by: Snehil Shah <[email protected]> (4a384f5)

• chore: removing docs gatsby website (03f5ac0)

Ci

• ci: fix trivy github action (a5d4df8)

• ci: update dependabot yml file (8a6b007)

Feature

• feat: add config

Signed-off-by: Snehil Shah <[email protected]> (73731ec)

• feat: add dimensionality reduction operator (2caf4a4)

• feat: improve exception handling and logic

Co-authored-by: Chaithanya512 <[email protected]>
Signed-off-by: Snehil Shah <[email protected]> (5756a59)

• feat: add cluster_embeddings operator

Signed-off-by: Snehil Shah <[email protected]> (4e08e35)

• feat: add audio embedding operator using CLAP model (233cfd4)

• feat: add classify_video operator

Signed-off-by: Snehil Shah <[email protected]> (2001dab)

• feat: add vid_vec_rep_clip operator

Signed-off-by: Snehil Shah <[email protected]> (8874ce5)

Fix

• fix: es_vec test (08b3085)

• fix: enable worker support for dimension reductionn (89df059)

• fix: update logic as per clustering spec

Signed-off-by: Snehil Shah <[email protected]> (0bea260)

• fix: correct indentation logic (d208d17)

• fix: correct naming and add dimension reduction requirements (0334a4b)

Refactor

• refactor: migrate CLAP operator to Hugging Face Transformers (9e5195a)

• refactor: align dimension reduction with feluda interface (0acfdb7)

• refactor: change modality to video

Signed-off-by: Snehil Shah <[email protected]> (a1506ba)

Style

• style: prepend newline for clearer output in logs

Signed-off-by: Snehil Shah <[email protected]> (bacafdd)

Test

• test: add payload writer for the worker

Signed-off-by: Snehil Shah <[email protected]> (57803e0)

Unknown

• Merge pull request #381 from tattle-made/development

merge dev to main (48bfc87)

• Merge pull request #380 from aatmanvaidya/update-fel

Update Packages and Fix minor Issues (cf64f4d)

• Merge pull request #379 from Snehil-Shah/worker

worker for clustering media (4abae4d)

• nit: add logs

Signed-off-by: Snehil Shah <[email protected]> (1ba6de1)

• draft: implement initial clustering worker (7129ac3)

• init: add Dockerfile for worker

Signed-off-by: Snehil Shah <[email protected]> (777994b)

• Merge pull request #375 from Snehil-Shah/clustering

[81] - add operator to cluster embeddings (1da1c27)

• Merge pull request #376 from Chaithanya512/dim-reduction-operator

feat: add dimensionality reduction operator (cb76d85)

• Merge pull request #372 from Chaithanya512/audio_vec_emb_clap

feat: audio embedding operator using CLAP model (faa9727)

• Merge pull request #370 from Snehil-Shah/classify-video

[81] - add operator to classify videos using a zero-shot approach (91f604b)

• Merge pull request #369 from Snehil-Shah/vid_vec_rep_clip

[81] - add operator to encode videos into vector embeddings using CLIP-ViT-B-32 (c5f09de)

• Merge pull request #367 from aatmanvaidya/remove-docs

chore: removing docs gatsby website (2b9275a)

v0.7.2

v0.7.2 (2024-05-28)

Fix

• fix: Updated pr-security workflow
  fix: Removed ignored vulnerabilities that were fixed (fe9c26a)

Unknown

• Merge pull request #344 from tattle-made/hotfix

Hotfix (10a277c)

• Merge pull request #343 from duggalsu/update_pr_security_workflow

Update pr security workflow (b26a03c)

v0.7.1

v0.7.1 (2024-05-28)

Fix

• fix: Updated github action versions to latest (44b46ad)

Unknown

• Merge pull request #342 from tattle-made/hotfix

Hotfix (eecc55f)

• Merge pull request #341 from duggalsu/update_scorecard_workflow

Update scorecard workflow (b2e2aa8)

v0.7.0

v0.7.0 (2024-05-28)

Chore

• chore: update Dockerfile (8ca692e)

• chore: removing file size limit from vid_vec_rep_resnet (22b9f2a)

Ci

• ci: prod github action for media worker (d4bb47f)

Unknown

• Merge pull request #339 from tattle-made/development

Merge Dev to Main (a1c22d3)

• Merge pull request #340 from tattle-made/aatmanvaidya-patch-1

chore: update Dockerfile (eb018a8)

• Merge pull request #332 from aatmanvaidya/media-worker-for-es

fix: updating media worker to index videos only (e6a8510)

• Merge pull request #324 from Snehil-Shah/language-detection

feat: add operator to detect language in an audio file (acfa3a0)

• Merge remote-tracking branch 'upstream/main' into media-worker-for-es (157508b)