Skip to content

[Devops] update metrics ci with new tests - #1457

Merged
ourownstory merged 13 commits into
mainfrom
metrics-bot-update
Oct 18, 2023
Merged

[Devops] update metrics ci with new tests #1457
ourownstory merged 13 commits into
mainfrom
metrics-bot-update

Conversation

@ourownstory

@ourownstory ourownstory commented Oct 18, 2023

Copy link
Copy Markdown
Owner

@codecov

codecov Bot commented Oct 18, 2023

Copy link
Copy Markdown

Codecov Report

Merging #1457 (7a1bd00) into main (951198d) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main    #1457   +/-   ##
=======================================
  Coverage   88.32%   88.32%           
=======================================
  Files          38       38           
  Lines        5097     5097           
=======================================
  Hits         4502     4502           
  Misses        595      595           

@ourownstory ourownstory changed the title [Devops] update metrics ci with new tests and move to poetry [Devops] update metrics ci with new tests Oct 18, 2023
@github-actions

Copy link
Copy Markdown

Model Benchmark

Benchmark Metric main current diff
PeytonManning_test30 MAE_val - 0.9731 -
PeytonManning_test30 RMSE_val - 1.128 -
PeytonManning_test30 Loss_val - 0.0317 -
PeytonManning_test30 MAE - 0.33 -
PeytonManning_test30 RMSE - 0.4574 -
PeytonManning_test30 Loss - 0.0044 -
PeytonManning_test30 time - 45.34 -
YosemiteTemps MAE_val 1.34899 0.44287 -67.17% 🎉
YosemiteTemps RMSE_val 2.00817 0.62874 -68.69% 🎉
YosemiteTemps Loss_val 0.00078 7e-05 -91.32% 🎉
YosemiteTemps MAE 1.32133 0.80138 -39.35% 🎉
YosemiteTemps RMSE 2.13713 1.44081 -32.58% 🎉
YosemiteTemps Loss 0.00064 0.00027 -57.67% 🎉
YosemiteTemps time 63.56224 141.45 122.54%
YosemiteTemps_test20 MAE_val - 1.8 -
YosemiteTemps_test20 RMSE_val - 2.2687 -
YosemiteTemps_test20 Loss_val - 0.001 -
YosemiteTemps_test20 MAE - 0.8432 -
YosemiteTemps_test20 RMSE - 1.4617 -
YosemiteTemps_test20 Loss - 0.0003 -
YosemiteTemps_test20 time - 124.49 -
AirPassengers_test30 MAE_val - 25.3608 -
AirPassengers_test30 RMSE_val - 30.624 -
AirPassengers_test30 Loss_val - 0.0074 -
AirPassengers_test30 MAE - 5.3982 -
AirPassengers_test30 RMSE - 6.8828 -
AirPassengers_test30 Loss - 0.0002 -
AirPassengers_test30 time - 20.17 -
AirPassengers MAE_val 13.0627 30.1272 130.64%
AirPassengers RMSE_val 15.94532 31.014 94.5%
AirPassengers Loss_val 0.00131 0.00371 182.63%
AirPassengers MAE 9.88153 6.27639 -36.48% 🎉
AirPassengers RMSE 11.73543 7.88805 -32.78% 🎉
AirPassengers Loss 0.00052 0.00019 -62.92% 🎉
AirPassengers time 5.81633 20.94 260.02%
PeytonManning MAE_val 0.58162 0.34778 -40.21% 🎉
PeytonManning RMSE_val 0.72218 0.49928 -30.86% 🎉
PeytonManning Loss_val 0.01239 0.00595 -51.96% 🎉
PeytonManning MAE 0.41671 0.35123 -15.71% 🎉
PeytonManning RMSE 0.55961 0.48066 -14.11% 🎉
PeytonManning Loss 0.00612 0.0046 -24.8% 🎉
PeytonManning time 13.84269 52.46 278.97%
Model training plots

Model Training

PeytonManning

PeytonManning_test30

YosemiteTemps

YosemiteTemps_test20

AirPassengers

AirPassengers_test30

@ourownstory
ourownstory merged commit 3328378 into main Oct 18, 2023
@ourownstory
ourownstory deleted the metrics-bot-update branch October 18, 2023 23:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant