Skip to content

✨ Feature v3 #4406

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 24 commits into
base: develop
Choose a base branch
from
Draft

✨ Feature v3 #4406

wants to merge 24 commits into from

Conversation

ashwinvaidya17
Copy link
Contributor

Summary

  • Adds create_engine wrapper.
  • Adds OpenVINO Engine
  • Adds Native Engine

How to test

Checklist

  • I have added unit tests to cover my changes.​
  • I have added integration tests to cover my changes.​
  • I have ran e2e tests and there is no issues.
  • I have added the description of my changes into CHANGELOG in my target branch (e.g., CHANGELOG in develop).​
  • I have updated the documentation in my target branch accordingly (e.g., documentation in develop).
  • I have linked related issues.

License

  • I submit my code changes under the same Apache License that covers the project.
    Feel free to contact the maintainers if that's a concern.
  • I have updated the license header for each file (see an example below).
# Copyright (C) 2025 Intel Corporation
# SPDX-License-Identifier: Apache-2.0

ashwinvaidya17 and others added 22 commits April 9, 2025 15:34
@ashwinvaidya17 @kprokofi
@eugene123tw @gyuilLim @sovrasov @dependabot
Update feature branch (#4333)
cb42446 
* Update Documentation (#4294)

* update docs

* walk through docs

* minor

* modify docs

* fix readme

* update readme. Delete outdated sections

* 🧹 Minor cleanup (#4299)

Refactor import statements to use 'otx.algo.utils.utils' for InstanceData across multiple files

* Promote/Demote Inst Seg Algo (#4301)

Update model categories in Mask R-CNN templates for balance and accuracy

* Reduce Integration Test Scope (#4303)

* Reduce Integration Test Scope to 2-3 recipes per task
* Add PR comment trigger workflow

* Improve PR comment event trigger (#4307)

* Add GitHub Actions comments for workflow run status in PR

* Update permissions in PR comment trigger workflow (#4309)

* Update PR comment trigger (#4312)

Update PR comment trigger workflow to enhance permissions and improve PR description updates

* Add workflow step to update PR description with run link and status (#4314)

* Enhance PR comment trigger to include last commit message and workflow result (#4316)

Enhance PR comment trigger to include last commit message and workflow run summary

* Refactor PR comment trigger (#4318)

Refactor PR comment trigger to include workflow status emoji and streamline run summary

* Support linear classifier fine-tuning for classification models (#4298)

* Backbone frozen in engine.py and head_only.yaml in multi_class_cls

* update

* Add : implemented linear fine-tuning for model layers

* Updated frozen backbone settings/

* fixes from comments #4286

* Removed the coed comments #4298

* fixes from review #4298

* trailing space and removed head_only.yaml #4298

* Resolve the Dependency Inversion Problem#4298

* removed white space #4298

Update engine.py

* removed white space #4298

* pre-commit

* Added Unit test for frrze_backbone

* update precommit

* modified test_freeze_backbone in test_deit_tiny.py

* modified test_freeze_backbone in test_deit_tiny.py

* modified test_freeze_backbone in test_deit_tiny.py

* run pre-commit

---------

Co-authored-by: Vladislav Sovrasov <[email protected]>

* 🧹 Refactor detection entity (#4322)

* Remove detection entity

---------

Signed-off-by: Ashwin Vaidya <[email protected]>

* Update integration test commands to include run-category-only flag options (#4325)

* Bump rich from 13.9.4 to 14.0.0 (#4324)

Bumps [rich](https://github.com/Textualize/rich) from 13.9.4 to 14.0.0.
- [Release notes](https://github.com/Textualize/rich/releases)
- [Changelog](https://github.com/Textualize/rich/blob/master/CHANGELOG.md)
- [Commits](Textualize/rich@v13.9.4...v14.0.0)

---
updated-dependencies:
- dependency-name: rich
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

---------

Signed-off-by: Ashwin Vaidya <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: Prokofiev Kirill <[email protected]>
Co-authored-by: Eugene Liu <[email protected]>
Co-authored-by: limgyuil <[email protected]>
Co-authored-by: Vladislav Sovrasov <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@ashwinvaidya17
Move engine to native
d7b9b56 
Signed-off-by: Ashwin Vaidya <[email protected]>
@ashwinvaidya17
Fix tests
b626fce 
Signed-off-by: Ashwin Vaidya <[email protected]>
@ashwinvaidya17
Add readme
d2c57e9 
Signed-off-by: Ashwin Vaidya <[email protected]>
@ashwinvaidya17 @kprokofi
@eugene123tw @gyuilLim @sovrasov @dependabot @GauravSRC @rajeshgangireddy @Daankrol
⛙ Merge develop to feature (#4338)
fb34cea 
* Update Documentation (#4294)

* update docs

* walk through docs

* minor

* modify docs

* fix readme

* update readme. Delete outdated sections

* 🧹 Minor cleanup (#4299)

Refactor import statements to use 'otx.algo.utils.utils' for InstanceData across multiple files

* Promote/Demote Inst Seg Algo (#4301)

Update model categories in Mask R-CNN templates for balance and accuracy

* Reduce Integration Test Scope (#4303)

* Reduce Integration Test Scope to 2-3 recipes per task
* Add PR comment trigger workflow

* Improve PR comment event trigger (#4307)

* Add GitHub Actions comments for workflow run status in PR

* Update permissions in PR comment trigger workflow (#4309)

* Update PR comment trigger (#4312)

Update PR comment trigger workflow to enhance permissions and improve PR description updates

* Add workflow step to update PR description with run link and status (#4314)

* Enhance PR comment trigger to include last commit message and workflow result (#4316)

Enhance PR comment trigger to include last commit message and workflow run summary

* Refactor PR comment trigger (#4318)

Refactor PR comment trigger to include workflow status emoji and streamline run summary

* Support linear classifier fine-tuning for classification models (#4298)

* Backbone frozen in engine.py and head_only.yaml in multi_class_cls

* update

* Add : implemented linear fine-tuning for model layers

* Updated frozen backbone settings/

* fixes from comments #4286

* Removed the coed comments #4298

* fixes from review #4298

* trailing space and removed head_only.yaml #4298

* Resolve the Dependency Inversion Problem#4298

* removed white space #4298

Update engine.py

* removed white space #4298

* pre-commit

* Added Unit test for frrze_backbone

* update precommit

* modified test_freeze_backbone in test_deit_tiny.py

* modified test_freeze_backbone in test_deit_tiny.py

* modified test_freeze_backbone in test_deit_tiny.py

* run pre-commit

---------

Co-authored-by: Vladislav Sovrasov <[email protected]>

* 🧹 Refactor detection entity (#4322)

* Remove detection entity

---------

Signed-off-by: Ashwin Vaidya <[email protected]>

* Update integration test commands to include run-category-only flag options (#4325)

* Bump rich from 13.9.4 to 14.0.0 (#4324)

Bumps [rich](https://github.com/Textualize/rich) from 13.9.4 to 14.0.0.
- [Release notes](https://github.com/Textualize/rich/releases)
- [Changelog](https://github.com/Textualize/rich/blob/master/CHANGELOG.md)
- [Commits](Textualize/rich@v13.9.4...v14.0.0)

---
updated-dependencies:
- dependency-name: rich
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Fix integration test commands run-category-only flag (#4329)

* updated repo with mobilenet_v4 (#4321)

* updated repo with mobilenet_v4

* Introduce MobileNetV4 for Improved Performance

* Introduced MobileNetV4 recipe for Improved Performance

---------

Co-authored-by: Vladislav Sovrasov <[email protected]>

* Update documentation and references to Open-Edge Platform (#4331)

* Update documentation and references to Open-Edge Platform- Updated dataset format links in auto_configuration.rst, models_optimization.rst, and various algorithm documentation to point to the Open-Edge Platform repository.
- Changed references from openvinotoolkit to open-edge-platform in multiple files including anomaly detection, classification, object detection, segmentation, and product design documentation.
- Modified installation instructions and CLI command references to reflect the new repository URL.
- Adjusted the help formatter to display the updated GitHub repository link.
- Ensured all links to Datumaro and related resources are consistent with the new repository structure.

* 🧹 Refactor Instance Segmentation Entity (#4327)

Signed-off-by: Ashwin Vaidya <[email protected]>

* 🧹 Refactor Anomaly Entities (#4328)

* Remove anomaly entities

Signed-off-by: Ashwin Vaidya <[email protected]>

---------

Signed-off-by: Ashwin Vaidya <[email protected]>

* Add a contribution guide (#4335)

* Add a contribution guide

* Fix a typo

* Apply grammar suggestions

Co-authored-by: Rajesh Gangireddy <[email protected]>

---------

Co-authored-by: Rajesh Gangireddy <[email protected]>

* Bug Fix : Convert labels for multi-label Classification into LongTensor before one_hot encoding (#4336)

* Update classification.py

* make ruff happy

* make it simpler

* Update src/otx/core/data/dataset/classification.py

Co-authored-by: Daan Krol <[email protected]>

---------

Co-authored-by: Daan Krol <[email protected]>

* Bump OV and NNCF to 2025.1 (#4334)

* Bump OV to 2025.1

* Bump NNCF

* Update changelog

* Update imports

---------

Signed-off-by: Ashwin Vaidya <[email protected]>
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: Prokofiev Kirill <[email protected]>
Co-authored-by: Eugene Liu <[email protected]>
Co-authored-by: limgyuil <[email protected]>
Co-authored-by: Vladislav Sovrasov <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Gaurav Singh <[email protected]>
Co-authored-by: Rajesh Gangireddy <[email protected]>
Co-authored-by: Daan Krol <[email protected]>
@ashwinvaidya17
Merge branch 'feature-v3' into ashwin/engine_refactor_1
5328d4d
@ashwinvaidya17
commit changes
ac9bcc5 
Signed-off-by: Ashwin Vaidya <[email protected]>
@ashwinvaidya17
Fix tests
adee15b 
Signed-off-by: Ashwin Vaidya <[email protected]>
@ashwinvaidya17
Restructure folder
1ab6ce0 
Signed-off-by: Ashwin Vaidya <[email protected]>
@ashwinvaidya17
update imports
1481547 
Signed-off-by: Ashwin Vaidya <[email protected]>
@ashwinvaidya17
Merge branch 'develop' into feature-v3
f44eb71
@ashwinvaidya17
Merge pull request #4346 from ashwinvaidya17/ashwin/merge_develop_to_…
9b80e7c 
…feature

⛙ Merge develop to feature
@ashwinvaidya17
Merge branch 'develop' into ashwin/merge_develop_to_feature
ef25d37
@ashwinvaidya17
Merge pull request #4339 from ashwinvaidya17/ashwin/engine_refactor_1
d9bbebd 
🛠️ Engine Refactor | Native Engine
@ashwinvaidya17
Merge pull request #4356 from ashwinvaidya17/ashwin/merge_develop_to_…
91b9c62 
…feature

🔄 Sync develop to feature
@ashwinvaidya17
Merge branch 'develop' into ashwin/merge_develop_to_feature
f40a8f3
@ashwinvaidya17
Delete mobilenetv4
f815f71 
Signed-off-by: Ashwin Vaidya <[email protected]>
@eugene123tw
Merge branch 'feature-v3' into ashwin/merge_develop_to_feature
dddf698
@ashwinvaidya17
Merge pull request #4368 from ashwinvaidya17/ashwin/merge_develop_to_…
1bf363e 
…feature

🔄 Sync develop with feature
@ashwinvaidya17
Merge branch 'develop' into feature-v3
684513e
@kprokofi
[feature-v3] Add OV Engine (#4374)
c217aff 
* add OV engine as a backend

* update engine

* move backend

* test works

* add predict, delete OVModels

* fix optimize

* add unit test for OVEngine

* fix ruff

* fix mypy issues

* update changes from feature branch

* some fixes

* added API tests with ov_engine

* reply to comments, update docstrings

* inherit OVEngine from Engine

* fix API tests

* fix tests

* fix rest_engine

* try to delete test to check:
@kprokofi
merge develop
be964f5
@github-actions github-actions bot added TEST Any changes in tests BUILD DOC Improvements or additions to documentation labels Jun 3, 2025
@kprokofi
[feature-v3] Move rest of OTX under native backend. Change structure …
bdaef0c 
…of the folders. (#4408)

* move all folders under native

* add missing files

* delete for developers

* add annotations to types

* update __init__

* align AnomalyDataset with OTXDataset

* move cspnext to detection to avoid circular error

* fix linter

* move all unit test

* fix linter

* return __init__ to openvino backend tests

* reply comments

* fix unit tests. Fix class patch

* change copyright

* fix recipe path

* fix inst seg. Move samplers

* minor fix from copilot
@github-actions github-actions bot added the DEPENDENCY Any changes in any dependencies (new dep or its version) should be produced via Change Request on PM label Jun 11, 2025
@kprokofi
[feature-v3] Remove T_* data entities (#4412)
258db4b 
* remove T_* entities

* fix linter

* fix API test

* resolve conflicts

* fix typing

* remove all ignores

* minor fix

* fix duplication
samet-akcay
samet-akcay reviewed Jun 12, 2025
View reviewed changes
docs/source/guide/explanation/additional_features/auto_configuration.rst
@@ -149,7 +149,7 @@ To use this feature, add the following parameter:

.. code-block:: python

from otx.core.data.module import OTXDataModule
from otx.data.module import OTXDataModule
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we have the relative imports so I can do

from otx.data import OTXDataModule

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@samet-akcay samet-akcay samet-akcay left review comments

@eugene123tw eugene123tw Awaiting requested review from eugene123tw eugene123tw will be requested when the pull request is marked ready for review eugene123tw is a code owner

@kprokofi kprokofi Awaiting requested review from kprokofi kprokofi will be requested when the pull request is marked ready for review kprokofi is a code owner

@sovrasov sovrasov Awaiting requested review from sovrasov sovrasov will be requested when the pull request is marked ready for review sovrasov is a code owner

@Daankrol Daankrol Awaiting requested review from Daankrol Daankrol will be requested when the pull request is marked ready for review Daankrol is a code owner

@rajeshgangireddy rajeshgangireddy Awaiting requested review from rajeshgangireddy rajeshgangireddy will be requested when the pull request is marked ready for review rajeshgangireddy is a code owner

At least 2 approving reviews are required to merge this pull request.

Assignees
No one assigned
Labels
BUILD DEPENDENCY Any changes in any dependencies (new dep or its version) should be produced via Change Request on PM DOC Improvements or additions to documentation TEST Any changes in tests
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@ashwinvaidya17 @samet-akcay @eugene123tw @kprokofi