feat: Optimize dashboard to use stored metrics from Experiment node#49
Open
nee1k wants to merge 9 commits into
Open
feat: Optimize dashboard to use stored metrics from Experiment node#49nee1k wants to merge 9 commits into
nee1k wants to merge 9 commits into
Conversation
- Add get_experiment_metrics() method to retrieve stored metrics from Neo4j - Replace computed metrics with database-stored metrics in Camera Traps dashboard - Remove complex metric calculation functions (calculate_object_detection_metrics, etc.) - Add support for mAP, IoU, and other advanced metrics from oracle daemon - Update docker-compose.yml to use iud2i/ckn-analytics-dashboard:2.0.0 - Improve performance by eliminating real-time metric calculations - Ensure consistency between oracle daemon calculations and dashboard display
- Update confluentinc/cp-zookeeper:latest to 7.5.0 - Update confluentinc/cp-kafka-connect:latest to 7.5.0 - Update iud2i/ckn-cameratraps-acc-alert:latest to 2.0.0 - Update iud2i/ckn-cameratraps-agg:latest to 2.0.0 - Fixes linux/amd64 manifest errors in CI/CD pipeline
…/amd64 manifest errors - Update iud2i/ckn-cameratraps-acc-alert:latest to 0.1.2 - Update iud2i/ckn-cameratraps-agg:latest to 0.1.2 - All images now use specific version tags instead of latest - Resolves CI/CD pipeline manifest errors
- Revert iud2i/ckn-cameratraps-acc-alert:0.1.2 to latest - Revert iud2i/ckn-cameratraps-agg:0.1.2 to latest - Keep Confluent images with specific versions (7.5.0) to fix linux/amd64 issues - Fixes 'manifest unknown' errors in CI/CD pipeline
…sion attribute - Update confluentinc/cp-zookeeper:7.5.0 to 7.4.0 - Update confluentinc/cp-kafka:7.9.2 to 7.4.0 - Update confluentinc/cp-kafka-connect:7.5.0 to 7.4.0 - Remove obsolete version: '3.8' attribute from docker-compose.yml - Use consistent Confluent Platform version 7.4.0 for all components - Attempts to resolve linux/amd64 manifest issues
…anifest issue - Comment out oracle-alert-processor and oracle-aggr-processor services - Test if Confluent Platform images (7.4.0) work without iud2i images - This will help identify which specific image is causing the manifest error
…s-dashboard - Build iud2i/ckn-analytics-dashboard:2.0.0 for both linux/amd64 and linux/arm64 - Fix Dockerfile COPY paths to use ckn_dashboard/ prefix - Remove platform-specific FROM instruction for multi-arch support - Re-enable oracle services in docker-compose.yml - Resolves linux/amd64 manifest issues for our custom dashboard image
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This PR optimizes the Camera Traps dashboard to use stored metrics from the Experiment node in Neo4j instead of computing them in real-time.
Changes Made
Performance Improvements
Technical Changes
Metrics Now Retrieved from Database
Benefits
Testing
Docker Image