File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -20,7 +20,7 @@ For more details on how model grades are evaluated in Spice, refer to the [model
2020| ` o1-2024-12-17 (Reasoning effort: low) ` | ** C** | ` openai ` | 200k tokens<br / >100k tokens | ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | 2024-12-17 | v1.0.2 |
2121| ` gpt-4o-2024-08-06 ` | ** B** | ` openai ` | 128k tokens<br / >16384 tokens | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | 2024-08-06 | v1.0.2 |
2222| ` claude-3-5-sonnet-20241022 ` | ** C** | ` anthropic ` | 200k tokens<br / >8192 tokens | ✅ | ❌ | ✅ | ✅ | ❌ | ✅ | 2024-10-22 | v1.0.2 |
23- | ` grok-2-1212 ` | Ungraded | ` xai ` | − | ✅ | − | − | − | ❌ | − | Not Available | v1.0.2 |
23+ | ` grok-4.3 ` | Ungraded | ` xai ` | 1M tokens< br / >− | ✅ | − | − | − | ✅ | − | 2026 | v2.1 |
2424| ` deepseek-ai/DeepSeek-R1-Distill-Llama-8B ` | Ungraded | ` huggingface ` | − | ✅ | − | − | − | ✅ | − | Not Available | v1.0.2 |
2525| ` meta-llama/Llama-3.2-3B-Instruct ` | Ungraded | ` huggingface ` | − | ✅ | − | − | − | ❌ | − | Not Available | v1.0.2 |
2626| ` deepseek-reasoner ` | Ungraded | ` openai ` | 64k tokens<br / >8k tokens | ✅ | − | − | − | ✅ | ✅ | 2025/01/20 | v1.0.4 |
You can’t perform that action at this time.
0 commit comments