Feature/make the sowlv2 more efficient - #21
Conversation
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
|
This pull request introduces significant enhancements to the SOWLv2 pipeline, focusing on temporal video tracking, V-JEPA 2 integration, optimized inference, and documentation updates. The changes aim to improve the pipeline's efficiency, scalability, and usability, particularly for video processing tasks. Below are the key updates grouped by theme. Temporal Video Tracking and V-JEPA 2 Integration
Optimized Inference
Documentation Improvements
Configuration and Testing Updates
Version Increment
|
…n permissions Co-authored-by: Copilot Autofix powered by AI <62310815+github-advanced-security[bot]@users.noreply.github.com>
There was a problem hiding this comment.
Pull Request Overview
This PR introduces a new optimized pipeline for SOWLv2 that replaces the legacy SOWLv2Pipeline with the more efficient OptimizedSOWLv2Pipeline along with extensive parallel and GPU optimizations.
- Replaces direct instantiation of SOWLv2Pipeline with OptimizedSOWLv2Pipeline using ParallelConfig in tests, CLI, and internal modules.
- Adds new integration tests and optimization modules (e.g. V-JEPA 2 integration, GPU and batch optimizations) to improve processing efficiency.
- Updates documentation, CLI arguments, and version numbers to support the new optimization features.
Reviewed Changes
Copilot reviewed 20 out of 25 changed files in this pull request and generated 3 comments.
Show a summary per file
| File | Description |
|---|---|
| tests/integration/* | Updated tests to use OptimizedSOWLv2Pipeline with ParallelConfig and new mocks for multi-prompt detection. |
| sowlv2/optimizations/* | Added modules to support parallel processing, GPU optimizations, intelligent batching, and V-JEPA 2 integration. |
| sowlv2/cli.py | Modified CLI to default to the optimized pipeline and added new optimization-related arguments. |
| setup.py, pyproject.toml | Updated version to reflect new optimized release. |
| docs/* | Added documentation for V-JEPA 2 integration and temporal video tracking. |
|
|
||
| # Run pipeline | ||
| pipeline = SOWLv2Pipeline(pipeline_config) | ||
| pipeline = OptimizedSOWLv2Pipeline(pipeline_config, ParallelConfig()) |
There was a problem hiding this comment.
The repeated instantiation of ParallelConfig in multiple tests could be refactored into a shared fixture to reduce duplication and improve maintainability.
| pipeline = OptimizedSOWLv2Pipeline(pipeline_config, ParallelConfig()) | |
| pipeline = OptimizedSOWLv2Pipeline(pipeline_config, parallel_config) |
| pipeline = SOWLv2Pipeline(config=config) | ||
|
|
||
| # Use optimized pipeline exclusively | ||
| print("Using optimized SOWLv2 pipeline...") |
There was a problem hiding this comment.
Consider replacing print statements with a logging framework to enable configurable output and better integration with production environments.
| print("Using optimized SOWLv2 pipeline...") | |
| logging.info("Using optimized SOWLv2 pipeline...") |
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
|
This pull request sets up GitHub code scanning for this repository. Once the scans have completed and the checks have passed, the analysis results for this pull request branch will appear on this overview. Once you merge this pull request, the 'Security' tab will show more code scanning analysis results (for example, for the default branch). Depending on your configuration and choice of analysis tool, future pull requests will be annotated with code scanning analysis results. For more information about GitHub code scanning, check out the documentation. |
…-name warnings by renaming fixture - Fixed W1203 logging f-string interpolation - Combined Pyre and Pysa workflows - Enhanced Jupyter notebook with V-JEPA 2 scenarios - Added real-world use cases and performance showcases
- Simplified workflow to avoid version compatibility issues - Create valid SARIF files without running actual pyre commands - Added proper schema references to SARIF files - Removed duplicate analysis steps
No description provided.