-
Notifications
You must be signed in to change notification settings - Fork 33
fix: update performance tests to use the NLG integration #3049
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
|
Merging to
|
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
# Conflicts: # src/commands/flags.ts
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Coverage summary from CodacySee diff coverage on Codacy
Coverage variation details
Coverage variation is the difference between the coverage for the head and common ancestor commits of the pull request branch: Diff coverage details
Diff coverage is the percentage of lines that are covered by tests out of the coverable lines that the pull request added or modified: See your quality gate settings Change summary preferencesFootnotes
|
Signed-off-by: Ivo Yankov <[email protected]>
Coverage summary from CodacySee diff coverage on Codacy
Coverage variation details
Coverage variation is the difference between the coverage for the head and common ancestor commits of the pull request branch: Diff coverage details
Diff coverage is the percentage of lines that are covered by tests out of the coverable lines that the pull request added or modified: See your quality gate settings Change summary preferencesFootnotes
|
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Signed-off-by: Ivo Yankov <[email protected]>
Coverage summary from CodacySee diff coverage on Codacy
Coverage variation details
Coverage variation is the difference between the coverage for the head and common ancestor commits of the pull request branch: Diff coverage details
Diff coverage is the percentage of lines that are covered by tests out of the coverable lines that the pull request added or modified: See your quality gate settings Change summary preferences |
Signed-off-by: Ivo Yankov <[email protected]>
Log Metrics - One Shot Single - using Podman📊 Runner Resource UsageJSON Log Metrics |
Log Metrics - One Shot Single📊 Runner Resource UsageJSON Log Metrics |
Log Metrics - External database new📊 Runner Resource UsageJSON Log Metrics |
Log Metrics - Block Node📊 Runner Resource UsageJSON Log Metrics |
Log Metrics - Integration📊 Runner Resource UsageJSON Log Metrics |
Log Metrics - Node Upgrade📊 Runner Resource UsageJSON Log Metrics |
Log Metrics - Node Local PTT📊 Runner Resource Usage |
Log Metrics - Performance TestJSON Log Metrics |
Log Metrics - Dual Cluster Full📊 Runner Resource UsageJSON Log Metrics |
Log Metrics - Node Add Local📊 Runner Resource Usage |
Log Metrics - Standard📊 Runner Resource UsageJSON Log Metrics |
Coverage summary from CodacySee diff coverage on Codacy
Coverage variation details
Coverage variation is the difference between the coverage for the head and common ancestor commits of the pull request branch: Diff coverage details
Diff coverage is the percentage of lines that are covered by tests out of the coverable lines that the pull request added or modified: See your quality gate settings Change summary preferences |
Description
This pull request refactors the
performance e2etest suite to leverage therapid-firecommands. It also collects metrics in a 5-second interval for the duration of the test runtime. Those metrics are saved in$SOLO_HOME/logs/$namespace/timeline-metrics.jsonA separate tool for visualizing the data from
timeline-metrics.jsonwas developed, but it will be pushed to a separate repository. It generates charts for the CPU and Memory usage metrics. Ideally, those charts and the JSON file should be linked in a comment in every PR. However, the data size of the JSON exceeds the maximum character limit for GitHub comments, and the API does not support adding file attachments to comments. The best solution for this would be to upload the JSON file and the generated chart image to long-term storage and link them in a PR. This is described in this issue.The PR also fixes the output of the
rapid-firecommands.Chart for the latest run of the Performance tests:
Related Issues
Pull request (PR) checklist
package.jsonchanges have been explained to and approved by a repository managerTesting
The following manual testing was done:
The following was not tested:
Commit message guidelines
We use 'Conventional Commits' to ensure that our commit messages are easy to read, follow a consistent format, and for automated release note generation. Please follow the guidelines below when writing your commit messages: