PR3: Update AWS dvc.yaml by tintinrevient · Pull Request #137 · ProteinGym/proteingym-benchmark

tintinrevient · 2025-10-22T12:46:35Z

Changes

Resolves #99

In testing phase.

Checklist

I broke the PR down so that it contains a reasonable amount of changes for an effective review
I performed a self-review of my code. Amongst other things, I have commented my code in hard-to-understand areas.
I made corresponding changes to the documentation
I added tests that prove my fix is effective or that my feature works
I accounted for dependent changes to be merged and published in downstream modules

tintinrevient · 2025-10-22T12:52:48Z

✅ Supervised models have all passed validation.

metric_name,metric_value
Overall ACC,0.0
Overall RACCU,0.0030303030303030303
Overall RACC,0.0
Kappa,0.0
Gwet AC1,-0.0030395136778115636
Bennett S,-0.00303951367781155
Kappa Standard Error,0.0
Kappa Unbiased,-0.00303951367781155
Scott PI,-0.00303951367781155
Kappa No Prevalence,-1.0
Kappa 95% CI,"(0.0, 0.0)"
Standard Error,0.0
95% CI,"(0.0, 0.0)"
Chi-Squared,None
Phi-Squared,None
Cramer V,None
Response Entropy,7.366322214245807
Reference Entropy,7.366322214245807
Cross Entropy,0
Joint Entropy,7.366322214245807
Conditional Entropy,-0.0
Mutual Information,7.366322214245807
KL Divergence,None
Lambda B,1.0
Lambda A,1.0
Chi-Squared DF,108241
Overall J,"(0.0, 0.0)"
Hamming Loss,1.0
Zero-one Loss,165
NIR,0.006060606060606061
P-Value,1
Overall CEN,0.0
Overall MCEN,0.0
Overall MCC,0.0
RR,0.5
CBA,0.0
AUNU,None
AUNP,None
RCI,1.0
Pearson C,None
TPR Micro,0.0
TPR Macro,None
CSI,None
ARI,None
TNR Micro,0.9969604863221885
TNR Macro,0.996969696969697
Bangdiwala B,None
Krippendorff Alpha,0.0
SOA1(Landis & Koch),Slight
SOA2(Fleiss),Poor
SOA3(Altman),Poor
SOA4(Cicchetti),Poor
SOA5(Cramer),None
SOA6(Matthews),Negligible
SOA7(Lambda A),Perfect
SOA8(Lambda B),Perfect
SOA9(Krippendorff Alpha),Low
SOA10(Pearson C),None
FPR Macro,0.00303030303030305
FNR Macro,None
PPV Macro,None
NPV Macro,0.996969696969697
ACC Macro,0.9939393939393939
F1 Macro,0.0
FPR Micro,0.003039513677811523
FNR Micro,1.0
PPV Micro,0.0
F1 Micro,0.0
NPV Micro,0.9969604863221885

✅ Zero-shot models have all passed validation.

metric_name,metric_value
Overall ACC,0.0
Overall RACCU,0.00010350554262465215
Overall RACC,0.0
Kappa,0.0
Gwet AC1,-0.00010027040554341335
Bennett S,-0.0001002707309736288
Kappa Standard Error,0.0
Kappa Unbiased,-0.00010351625713101698
Scott PI,-0.00010351625713101698
Kappa No Prevalence,-1.0
Kappa 95% CI,"(0.0, 0.0)"
Standard Error,0.0
95% CI,"(0.0, 0.0)"
Chi-Squared,None
Phi-Squared,None
Cramer V,None
Response Entropy,12.286557761608659
Reference Entropy,12.270402713018697
Cross Entropy,0
Joint Entropy,12.286557761608659
Conditional Entropy,0.0161550485899576
Mutual Information,12.2704027130187
KL Divergence,None
Lambda B,0.9963963963963964
Lambda A,1.0
Chi-Squared DF,99460729
Overall J,"(0.0, 0.0)"
Hamming Loss,0.9999999999999999
Zero-one Loss,4996
NIR,0.0038030424339471577
P-Value,1
Overall CEN,0.0005655020094343343
Overall MCEN,0.0005655020094343343
Overall MCC,0.0
RR,0.5009023460998596
CBA,0.0
AUNU,None
AUNP,None
RCI,1.0000000000000002
Pearson C,None
TPR Micro,0.0
TPR Macro,None
CSI,None
ARI,0.0
TNR Micro,0.9998997292690264
TNR Macro,0.9998997393222379
Bangdiwala B,None
Krippendorff Alpha,-3.425833166131969e-06
SOA1(Landis & Koch),Slight
SOA2(Fleiss),Poor
SOA3(Altman),Poor
SOA4(Cicchetti),Poor
SOA5(Cramer),None
SOA6(Matthews),Negligible
SOA7(Lambda A),Perfect
SOA8(Lambda B),Very Strong
SOA9(Krippendorff Alpha),Low
SOA10(Pearson C),None
FPR Macro,0.00010026067776214287
FNR Macro,None
PPV Macro,None
NPV Macro,0.9998997393222379
ACC Macro,0.9997994786444756
F1 Macro,0.0
FPR Micro,0.00010027073097362837
FNR Micro,1.0
PPV Micro,0.0
F1 Micro,0.0
NPV Micro,0.9998997292690264

tintinrevient · 2025-10-22T12:54:18Z

✅ Supervised models have all passed validation.

metric_name,metric_value
Overall ACC,0.0
Overall RACCU,0.0030303030303030303
Overall RACC,0.0
Kappa,0.0
Gwet AC1,-0.0030395136778115636
Bennett S,-0.00303951367781155
Kappa Standard Error,0.0
Kappa Unbiased,-0.00303951367781155
Scott PI,-0.00303951367781155
Kappa No Prevalence,-1.0
Kappa 95% CI,"(0.0, 0.0)"
Standard Error,0.0
95% CI,"(0.0, 0.0)"
Chi-Squared,None
Phi-Squared,None
Cramer V,None
Response Entropy,7.366322214245807
Reference Entropy,7.366322214245807
Cross Entropy,0
Joint Entropy,7.366322214245807
Conditional Entropy,-0.0
Mutual Information,7.366322214245807
KL Divergence,None
Lambda B,1.0
Lambda A,1.0
Chi-Squared DF,108241
Overall J,"(0.0, 0.0)"
Hamming Loss,1.0
Zero-one Loss,165
NIR,0.006060606060606061
P-Value,1
Overall CEN,0.0
Overall MCEN,0.0
Overall MCC,0.0
RR,0.5
CBA,0.0
AUNU,None
AUNP,None
RCI,1.0
Pearson C,None
TPR Micro,0.0
TPR Macro,None
CSI,None
ARI,None
TNR Micro,0.9969604863221885
TNR Macro,0.996969696969697
Bangdiwala B,None
Krippendorff Alpha,0.0
SOA1(Landis & Koch),Slight
SOA2(Fleiss),Poor
SOA3(Altman),Poor
SOA4(Cicchetti),Poor
SOA5(Cramer),None
SOA6(Matthews),Negligible
SOA7(Lambda A),Perfect
SOA8(Lambda B),Perfect
SOA9(Krippendorff Alpha),Low
SOA10(Pearson C),None
FPR Macro,0.00303030303030305
FNR Macro,None
PPV Macro,None
NPV Macro,0.996969696969697
ACC Macro,0.9939393939393939
F1 Macro,0.0
FPR Micro,0.003039513677811523
FNR Micro,1.0
PPV Micro,0.0
F1 Micro,0.0
NPV Micro,0.9969604863221885

✅ Zero-shot models have all passed validation.

metric_name,metric_value
Overall ACC,0.0
Overall RACCU,0.00010350554262465215
Overall RACC,0.0
Kappa,0.0
Gwet AC1,-0.00010027040554341335
Bennett S,-0.0001002707309736288
Kappa Standard Error,0.0
Kappa Unbiased,-0.00010351625713101698
Scott PI,-0.00010351625713101698
Kappa No Prevalence,-1.0
Kappa 95% CI,"(0.0, 0.0)"
Standard Error,0.0
95% CI,"(0.0, 0.0)"
Chi-Squared,None
Phi-Squared,None
Cramer V,None
Response Entropy,12.286557761608659
Reference Entropy,12.270402713018697
Cross Entropy,0
Joint Entropy,12.286557761608659
Conditional Entropy,0.0161550485899576
Mutual Information,12.2704027130187
KL Divergence,None
Lambda B,0.9963963963963964
Lambda A,1.0
Chi-Squared DF,99460729
Overall J,"(0.0, 0.0)"
Hamming Loss,0.9999999999999999
Zero-one Loss,4996
NIR,0.0038030424339471577
P-Value,1
Overall CEN,0.0005655020094343343
Overall MCEN,0.0005655020094343343
Overall MCC,0.0
RR,0.5009023460998596
CBA,0.0
AUNU,None
AUNP,None
RCI,1.0000000000000002
Pearson C,None
TPR Micro,0.0
TPR Macro,None
CSI,None
ARI,0.0
TNR Micro,0.9998997292690264
TNR Macro,0.9998997393222379
Bangdiwala B,None
Krippendorff Alpha,-3.425833166131969e-06
SOA1(Landis & Koch),Slight
SOA2(Fleiss),Poor
SOA3(Altman),Poor
SOA4(Cicchetti),Poor
SOA5(Cramer),None
SOA6(Matthews),Negligible
SOA7(Lambda A),Perfect
SOA8(Lambda B),Very Strong
SOA9(Krippendorff Alpha),Low
SOA10(Pearson C),None
FPR Macro,0.00010026067776214287
FNR Macro,None
PPV Macro,None
NPV Macro,0.9998997393222379
ACC Macro,0.9997994786444756
F1 Macro,0.0
FPR Micro,0.00010027073097362837
FNR Micro,1.0
PPV Micro,0.0
F1 Micro,0.0
NPV Micro,0.9998997292690264

tintinrevient · 2025-10-22T17:07:08Z

✅ Supervised models have all passed validation.

metric_name,metric_value
Overall ACC,0.0
Overall RACCU,0.0030303030303030303
Overall RACC,0.0
Kappa,0.0
Gwet AC1,-0.0030395136778115636
Bennett S,-0.00303951367781155
Kappa Standard Error,0.0
Kappa Unbiased,-0.00303951367781155
Scott PI,-0.00303951367781155
Kappa No Prevalence,-1.0
Kappa 95% CI,"(0.0, 0.0)"
Standard Error,0.0
95% CI,"(0.0, 0.0)"
Chi-Squared,None
Phi-Squared,None
Cramer V,None
Response Entropy,7.366322214245807
Reference Entropy,7.366322214245807
Cross Entropy,0
Joint Entropy,7.366322214245807
Conditional Entropy,-0.0
Mutual Information,7.366322214245807
KL Divergence,None
Lambda B,1.0
Lambda A,1.0
Chi-Squared DF,108241
Overall J,"(0.0, 0.0)"
Hamming Loss,1.0
Zero-one Loss,165
NIR,0.006060606060606061
P-Value,1
Overall CEN,0.0
Overall MCEN,0.0
Overall MCC,0.0
RR,0.5
CBA,0.0
AUNU,None
AUNP,None
RCI,1.0
Pearson C,None
TPR Micro,0.0
TPR Macro,None
CSI,None
ARI,None
TNR Micro,0.9969604863221885
TNR Macro,0.996969696969697
Bangdiwala B,None
Krippendorff Alpha,0.0
SOA1(Landis & Koch),Slight
SOA2(Fleiss),Poor
SOA3(Altman),Poor
SOA4(Cicchetti),Poor
SOA5(Cramer),None
SOA6(Matthews),Negligible
SOA7(Lambda A),Perfect
SOA8(Lambda B),Perfect
SOA9(Krippendorff Alpha),Low
SOA10(Pearson C),None
FPR Macro,0.00303030303030305
FNR Macro,None
PPV Macro,None
NPV Macro,0.996969696969697
ACC Macro,0.9939393939393939
F1 Macro,0.0
FPR Micro,0.003039513677811523
FNR Micro,1.0
PPV Micro,0.0
F1 Micro,0.0
NPV Micro,0.9969604863221885

✅ Zero-shot models have all passed validation.

metric_name,metric_value
Overall ACC,0.0
Overall RACCU,0.00010350554262465215
Overall RACC,0.0
Kappa,0.0
Gwet AC1,-0.00010027040554341335
Bennett S,-0.0001002707309736288
Kappa Standard Error,0.0
Kappa Unbiased,-0.00010351625713101698
Scott PI,-0.00010351625713101698
Kappa No Prevalence,-1.0
Kappa 95% CI,"(0.0, 0.0)"
Standard Error,0.0
95% CI,"(0.0, 0.0)"
Chi-Squared,None
Phi-Squared,None
Cramer V,None
Response Entropy,12.286557761608659
Reference Entropy,12.270402713018697
Cross Entropy,0
Joint Entropy,12.286557761608659
Conditional Entropy,0.0161550485899576
Mutual Information,12.2704027130187
KL Divergence,None
Lambda B,0.9963963963963964
Lambda A,1.0
Chi-Squared DF,99460729
Overall J,"(0.0, 0.0)"
Hamming Loss,0.9999999999999999
Zero-one Loss,4996
NIR,0.0038030424339471577
P-Value,1
Overall CEN,0.0005655020094343343
Overall MCEN,0.0005655020094343343
Overall MCC,0.0
RR,0.5009023460998596
CBA,0.0
AUNU,None
AUNP,None
RCI,1.0000000000000002
Pearson C,None
TPR Micro,0.0
TPR Macro,None
CSI,None
ARI,0.0
TNR Micro,0.9998997292690264
TNR Macro,0.9998997393222379
Bangdiwala B,None
Krippendorff Alpha,-3.425833166131969e-06
SOA1(Landis & Koch),Slight
SOA2(Fleiss),Poor
SOA3(Altman),Poor
SOA4(Cicchetti),Poor
SOA5(Cramer),None
SOA6(Matthews),Negligible
SOA7(Lambda A),Perfect
SOA8(Lambda B),Very Strong
SOA9(Krippendorff Alpha),Low
SOA10(Pearson C),None
FPR Macro,0.00010026067776214287
FNR Macro,None
PPV Macro,None
NPV Macro,0.9998997393222379
ACC Macro,0.9997994786444756
F1 Macro,0.0
FPR Micro,0.00010027073097362837
FNR Micro,1.0
PPV Micro,0.0
F1 Micro,0.0
NPV Micro,0.9998997292690264

tintinrevient · 2025-10-22T17:13:35Z

✅ Supervised models have all passed validation.

metric_name,metric_value
Overall ACC,0.0
Overall RACCU,0.0030303030303030303
Overall RACC,0.0
Kappa,0.0
Gwet AC1,-0.0030395136778115636
Bennett S,-0.00303951367781155
Kappa Standard Error,0.0
Kappa Unbiased,-0.00303951367781155
Scott PI,-0.00303951367781155
Kappa No Prevalence,-1.0
Kappa 95% CI,"(0.0, 0.0)"
Standard Error,0.0
95% CI,"(0.0, 0.0)"
Chi-Squared,None
Phi-Squared,None
Cramer V,None
Response Entropy,7.366322214245807
Reference Entropy,7.366322214245807
Cross Entropy,0
Joint Entropy,7.366322214245807
Conditional Entropy,-0.0
Mutual Information,7.366322214245807
KL Divergence,None
Lambda B,1.0
Lambda A,1.0
Chi-Squared DF,108241
Overall J,"(0.0, 0.0)"
Hamming Loss,1.0
Zero-one Loss,165
NIR,0.006060606060606061
P-Value,1
Overall CEN,0.0
Overall MCEN,0.0
Overall MCC,0.0
RR,0.5
CBA,0.0
AUNU,None
AUNP,None
RCI,1.0
Pearson C,None
TPR Micro,0.0
TPR Macro,None
CSI,None
ARI,None
TNR Micro,0.9969604863221885
TNR Macro,0.996969696969697
Bangdiwala B,None
Krippendorff Alpha,0.0
SOA1(Landis & Koch),Slight
SOA2(Fleiss),Poor
SOA3(Altman),Poor
SOA4(Cicchetti),Poor
SOA5(Cramer),None
SOA6(Matthews),Negligible
SOA7(Lambda A),Perfect
SOA8(Lambda B),Perfect
SOA9(Krippendorff Alpha),Low
SOA10(Pearson C),None
FPR Macro,0.00303030303030305
FNR Macro,None
PPV Macro,None
NPV Macro,0.996969696969697
ACC Macro,0.9939393939393939
F1 Macro,0.0
FPR Micro,0.003039513677811523
FNR Micro,1.0
PPV Micro,0.0
F1 Micro,0.0
NPV Micro,0.9969604863221885

✅ Zero-shot models have all passed validation.

metric_name,metric_value
Overall ACC,0.0
Overall RACCU,0.00010350554262465215
Overall RACC,0.0
Kappa,0.0
Gwet AC1,-0.00010027040554341335
Bennett S,-0.0001002707309736288
Kappa Standard Error,0.0
Kappa Unbiased,-0.00010351625713101698
Scott PI,-0.00010351625713101698
Kappa No Prevalence,-1.0
Kappa 95% CI,"(0.0, 0.0)"
Standard Error,0.0
95% CI,"(0.0, 0.0)"
Chi-Squared,None
Phi-Squared,None
Cramer V,None
Response Entropy,12.286557761608659
Reference Entropy,12.270402713018697
Cross Entropy,0
Joint Entropy,12.286557761608659
Conditional Entropy,0.0161550485899576
Mutual Information,12.2704027130187
KL Divergence,None
Lambda B,0.9963963963963964
Lambda A,1.0
Chi-Squared DF,99460729
Overall J,"(0.0, 0.0)"
Hamming Loss,0.9999999999999999
Zero-one Loss,4996
NIR,0.0038030424339471577
P-Value,1
Overall CEN,0.0005655020094343343
Overall MCEN,0.0005655020094343343
Overall MCC,0.0
RR,0.5009023460998596
CBA,0.0
AUNU,None
AUNP,None
RCI,1.0000000000000002
Pearson C,None
TPR Micro,0.0
TPR Macro,None
CSI,None
ARI,0.0
TNR Micro,0.9998997292690264
TNR Macro,0.9998997393222379
Bangdiwala B,None
Krippendorff Alpha,-3.425833166131969e-06
SOA1(Landis & Koch),Slight
SOA2(Fleiss),Poor
SOA3(Altman),Poor
SOA4(Cicchetti),Poor
SOA5(Cramer),None
SOA6(Matthews),Negligible
SOA7(Lambda A),Perfect
SOA8(Lambda B),Very Strong
SOA9(Krippendorff Alpha),Low
SOA10(Pearson C),None
FPR Macro,0.00010026067776214287
FNR Macro,None
PPV Macro,None
NPV Macro,0.9998997393222379
ACC Macro,0.9997994786444756
F1 Macro,0.0
FPR Micro,0.00010027073097362837
FNR Micro,1.0
PPV Micro,0.0
F1 Micro,0.0
NPV Micro,0.9998997292690264

tintinrevient · 2025-10-23T07:43:05Z

✅ Supervised models have all passed validation.

metric_name,metric_value
Overall ACC,0.0
Overall RACCU,0.0030303030303030303
Overall RACC,0.0
Kappa,0.0
Gwet AC1,-0.0030395136778115636
Bennett S,-0.00303951367781155
Kappa Standard Error,0.0
Kappa Unbiased,-0.00303951367781155
Scott PI,-0.00303951367781155
Kappa No Prevalence,-1.0
Kappa 95% CI,"(0.0, 0.0)"
Standard Error,0.0
95% CI,"(0.0, 0.0)"
Chi-Squared,None
Phi-Squared,None
Cramer V,None
Response Entropy,7.366322214245807
Reference Entropy,7.366322214245807
Cross Entropy,0
Joint Entropy,7.366322214245807
Conditional Entropy,-0.0
Mutual Information,7.366322214245807
KL Divergence,None
Lambda B,1.0
Lambda A,1.0
Chi-Squared DF,108241
Overall J,"(0.0, 0.0)"
Hamming Loss,1.0
Zero-one Loss,165
NIR,0.006060606060606061
P-Value,1
Overall CEN,0.0
Overall MCEN,0.0
Overall MCC,0.0
RR,0.5
CBA,0.0
AUNU,None
AUNP,None
RCI,1.0
Pearson C,None
TPR Micro,0.0
TPR Macro,None
CSI,None
ARI,None
TNR Micro,0.9969604863221885
TNR Macro,0.996969696969697
Bangdiwala B,None
Krippendorff Alpha,0.0
SOA1(Landis & Koch),Slight
SOA2(Fleiss),Poor
SOA3(Altman),Poor
SOA4(Cicchetti),Poor
SOA5(Cramer),None
SOA6(Matthews),Negligible
SOA7(Lambda A),Perfect
SOA8(Lambda B),Perfect
SOA9(Krippendorff Alpha),Low
SOA10(Pearson C),None
FPR Macro,0.00303030303030305
FNR Macro,None
PPV Macro,None
NPV Macro,0.996969696969697
ACC Macro,0.9939393939393939
F1 Macro,0.0
FPR Micro,0.003039513677811523
FNR Micro,1.0
PPV Micro,0.0
F1 Micro,0.0
NPV Micro,0.9969604863221885

✅ Zero-shot models have all passed validation.

metric_name,metric_value
Overall ACC,0.0
Overall RACCU,0.00010350554262465215
Overall RACC,0.0
Kappa,0.0
Gwet AC1,-0.00010027040554341335
Bennett S,-0.0001002707309736288
Kappa Standard Error,0.0
Kappa Unbiased,-0.00010351625713101698
Scott PI,-0.00010351625713101698
Kappa No Prevalence,-1.0
Kappa 95% CI,"(0.0, 0.0)"
Standard Error,0.0
95% CI,"(0.0, 0.0)"
Chi-Squared,None
Phi-Squared,None
Cramer V,None
Response Entropy,12.286557761608659
Reference Entropy,12.270402713018697
Cross Entropy,0
Joint Entropy,12.286557761608659
Conditional Entropy,0.0161550485899576
Mutual Information,12.2704027130187
KL Divergence,None
Lambda B,0.9963963963963964
Lambda A,1.0
Chi-Squared DF,99460729
Overall J,"(0.0, 0.0)"
Hamming Loss,0.9999999999999999
Zero-one Loss,4996
NIR,0.0038030424339471577
P-Value,1
Overall CEN,0.0005655020094343343
Overall MCEN,0.0005655020094343343
Overall MCC,0.0
RR,0.5009023460998596
CBA,0.0
AUNU,None
AUNP,None
RCI,1.0000000000000002
Pearson C,None
TPR Micro,0.0
TPR Macro,None
CSI,None
ARI,0.0
TNR Micro,0.9998997292690264
TNR Macro,0.9998997393222379
Bangdiwala B,None
Krippendorff Alpha,-3.425833166131969e-06
SOA1(Landis & Koch),Slight
SOA2(Fleiss),Poor
SOA3(Altman),Poor
SOA4(Cicchetti),Poor
SOA5(Cramer),None
SOA6(Matthews),Negligible
SOA7(Lambda A),Perfect
SOA8(Lambda B),Very Strong
SOA9(Krippendorff Alpha),Low
SOA10(Pearson C),None
FPR Macro,0.00010026067776214287
FNR Macro,None
PPV Macro,None
NPV Macro,0.9998997393222379
ACC Macro,0.9997994786444756
F1 Macro,0.0
FPR Micro,0.00010027073097362837
FNR Micro,1.0
PPV Micro,0.0
F1 Micro,0.0
NPV Micro,0.9998997292690264

JCZuurmond

Waiting with reviewing this one as this might move to a private repo

tintinrevient · 2025-10-30T15:01:42Z

Supervised Models

✅ Supervised models have all passed validation.

{
  "Average Spearman": "0.011855849117089201"
}

Zero-shot Models

✅ Zero-shot models have all passed validation.

{
  "Average Spearman": "-0.1585753304998414"
}

JCZuurmond

LGTM; we will move out the AWS stuff as our instance is non-public

JCZuurmond · 2025-10-30T15:14:36Z

-destination:
-  output_dir: output
-  metric_dir: metric
+metrics: '"spearman"'


Same comment that this is preferred to be a list

tintinrevient · 2025-10-31T12:10:44Z

Supervised Models

✅ Supervised models have all passed validation.

{
  "spearman": -0.03860497422060749
}

Zero-shot Models

✅ Zero-shot models have all passed validation.

{
  "spearman": -0.04390739267156756
}

Test dummy workflow

d20acb0

tintinrevient marked this pull request as draft October 22, 2025 12:46

Add test folder

4cbe36b

tintinrevient added 5 commits October 22, 2025 15:09

Test model names

5b694b7

Test model names

695097c

Test model names

0ec32bf

Test aws login

c95e68a

Use datasets.json and models.json for AWS dvc.yaml

93d8a4f

tintinrevient requested a review from JCZuurmond October 22, 2025 16:49

tintinrevient marked this pull request as ready for review October 22, 2025 16:52

tintinrevient added 2 commits October 22, 2025 19:00

Use single item for dvc repro

39e312b

Update README.md with -s

b693790

tintinrevient changed the title ~~CI - Upload model to Amazon ECR~~ Update AWS dvc.yaml Oct 22, 2025

tintinrevient changed the title ~~Update AWS dvc.yaml~~ PR3: Update AWS dvc.yaml Oct 22, 2025

tintinrevient self-assigned this Oct 22, 2025

Add README.md to force push the latest README.md

66b2f46

JCZuurmond reviewed Oct 23, 2025

View reviewed changes

tintinrevient added 2 commits October 30, 2025 15:37

Merge branch 'feat/custom-metric' into feat/ci-upload-model-image-to-ecr

11435d2

Use the latest metric.py

08c654c

tintinrevient changed the base branch from main to feat/custom-metric October 30, 2025 14:48

JCZuurmond approved these changes Oct 30, 2025

View reviewed changes

tintinrevient requested a review from JCZuurmond October 30, 2025 15:21

tintinrevient added 2 commits October 30, 2025 17:17

Merge branch 'feat/custom-metric' into feat/ci-upload-model-image-to-ecr

5a6fe25

Create metrics string from default.yaml

2729968

Base automatically changed from feat/custom-metric to main October 31, 2025 11:37

tintinrevient added 3 commits October 31, 2025 12:43

Update dvc.yaml with latest metric.py

e30fbee

Merge branch 'main' into feat/ci-upload-model-image-to-ecr

4c9b02d

Update dvc.yaml with the latest metric.py

46f1b37

tintinrevient merged commit 03858bf into main Oct 31, 2025
1 check passed

tintinrevient deleted the feat/ci-upload-model-image-to-ecr branch October 31, 2025 12:18

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

PR3: Update AWS dvc.yaml#137

PR3: Update AWS dvc.yaml#137
tintinrevient merged 17 commits intomainfrom
feat/ci-upload-model-image-to-ecr

tintinrevient commented Oct 22, 2025

Uh oh!

tintinrevient commented Oct 22, 2025

Uh oh!

tintinrevient commented Oct 22, 2025

Uh oh!

tintinrevient commented Oct 22, 2025

Uh oh!

tintinrevient commented Oct 22, 2025

Uh oh!

tintinrevient commented Oct 23, 2025

Uh oh!

JCZuurmond left a comment

Uh oh!

tintinrevient commented Oct 30, 2025

Uh oh!

JCZuurmond left a comment

Uh oh!

JCZuurmond Oct 30, 2025

Uh oh!

tintinrevient commented Oct 31, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

tintinrevient commented Oct 22, 2025

Changes

Checklist

Uh oh!

tintinrevient commented Oct 22, 2025

Uh oh!

tintinrevient commented Oct 22, 2025

Uh oh!

tintinrevient commented Oct 22, 2025

Uh oh!

tintinrevient commented Oct 22, 2025

Uh oh!

tintinrevient commented Oct 23, 2025

Uh oh!

JCZuurmond left a comment

Choose a reason for hiding this comment

Uh oh!

tintinrevient commented Oct 30, 2025

Supervised Models

Zero-shot Models

Uh oh!

JCZuurmond left a comment

Choose a reason for hiding this comment

Uh oh!

JCZuurmond Oct 30, 2025

Choose a reason for hiding this comment

Uh oh!

tintinrevient commented Oct 31, 2025

Supervised Models

Zero-shot Models

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants