Skip to content

Commit a7066f3

Browse files
committed
Update setup names in leaderboard.yml
1 parent ea18ff1 commit a7066f3

1 file changed

Lines changed: 8 additions & 8 deletions

File tree

data/benchmark/leaderboard.yml

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ rows:
1818
latency: "8h 30m"
1919
date: "2026-04-26"
2020
#--------------------------------------------------------------------------
21-
- setup: "Junie (Opus 4.7 max)"
21+
- setup: "Junie + Opus 4.7 max"
2222
submitted: 105
2323
resolved: 86
2424
resolutionRate: 81.90
@@ -98,55 +98,55 @@ rows:
9898
latency: "4h 54m"
9999
date: "2026-05-07"
100100
#--------------------------------------------------------------------------
101-
- setup: "Junie (GPT-5.4)"
101+
- setup: "Junie + GPT-5.4"
102102
submitted: 105
103103
resolved: 72
104104
resolutionRate: 68.57
105105
tokens: 15.29
106106
latency: "11h 30m"
107107
date: "2026-04-02"
108108
#--------------------------------------------------------------------------
109-
- setup: "Junie (Gemini 3.1 Pro Preview)"
109+
- setup: "Junie + Gemini 3.1 Pro Preview"
110110
submitted: 105
111111
resolved: 63
112112
resolutionRate: 60.00
113113
tokens: 32.41
114114
latency: "13h 41m"
115115
date: "2026-03-23"
116116
#--------------------------------------------------------------------------
117-
- setup: "Junie (Gemini 3 Flash)"
117+
- setup: "Junie + Gemini 3 Flash"
118118
submitted: 105
119119
resolved: 64
120120
resolutionRate: 60.95
121121
tokens: 40.17
122122
latency: "11h 27m"
123123
date: "2026-03-23"
124124
#--------------------------------------------------------------------------
125-
- setup: "Junie (GPT-5.3-codex)"
125+
- setup: "Junie + GPT-5.3-codex"
126126
submitted: 105
127127
resolved: 69
128128
resolutionRate: 65.71
129129
tokens: 15.68
130130
latency: "11h 8m"
131131
date: "2026-03-23"
132132
#--------------------------------------------------------------------------
133-
- setup: "Junie (Opus-4.6)"
133+
- setup: "Junie + Opus-4.6"
134134
submitted: 105
135135
resolved: 81
136136
resolutionRate: 77.14
137137
tokens: 7.45
138138
latency: "8h 36m"
139139
date: "2026-03-23"
140140
#--------------------------------------------------------------------------
141-
- setup: "Gemini CLI (Gemini 3.1 Pro)"
141+
- setup: "Gemini CLI + Gemini 3.1 Pro"
142142
submitted: 105
143143
resolved: 69
144144
resolutionRate: 65.71
145145
tokens: 21.03
146146
latency: "17h 1m"
147147
date: "2026-03-21"
148148
#--------------------------------------------------------------------------
149-
- setup: "Gemini CLI (Gemini 3 Flash)"
149+
- setup: "Gemini CLI + Gemini 3 Flash"
150150
submitted: 105
151151
resolved: 47
152152
resolutionRate: 44.76

0 commit comments

Comments
 (0)