-
Notifications
You must be signed in to change notification settings - Fork 53
Insights: IBM/unitxt
Overview
-
0 Active issues
-
- 16 Merged pull requests
- 3 Open pull requests
- 0 Closed issues
- 0 New issues
Could not load contribution data
Please try again later
16 Pull requests merged by 7 people
-
Start implementing assesment for unitxt assitant
#1625 merged
Feb 24, 2025 -
Add provider specific args and allow using unrecognized model names
#1621 merged
Feb 23, 2025 -
Enable offline mode for hugginface by using local pre-downloaded metrics, datasets and models
#1603 merged
Feb 23, 2025 -
Add correctness_based_on_ground_truth criteria
#1623 merged
Feb 23, 2025 -
Fix Azure OpenAI based LLM judges
#1619 merged
Feb 23, 2025 -
Text2sql execution accuracy metric updates
#1604 merged
Feb 18, 2025 -
Simplify preparation tests with better error handling
#1618 merged
Feb 18, 2025 -
Add CoT to LLM as judge assessments
#1612 merged
Feb 18, 2025 -
Update tables benchmark name to torr
#1617 merged
Feb 18, 2025 -
add ragbench faithfulness cards
#1598 merged
Feb 18, 2025 -
Granite guardian minor changes
#1605 merged
Feb 18, 2025 -
Added example of custom metric
#1616 merged
Feb 18, 2025 -
Add verify as an option to LoadFromAPI
#1608 merged
Feb 18, 2025 -
Fix Ollama inference engine
#1611 merged
Feb 18, 2025 -
Allow read timeout error in preparation tests
#1615 merged
Feb 18, 2025 -
Add download and etag timeout settings to workflow configurations
#1613 merged
Feb 18, 2025
3 Pull requests opened by 2 people
-
Add prediction variable name customization to LLM as Judge
#1622 opened
Feb 21, 2025 -
no main-memory cache to loaders
#1624 opened
Feb 22, 2025 -
small changes to profiler
#1627 opened
Feb 24, 2025
2 Unresolved conversations
Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.
-
Example for evaluating system message leakage
#1609 commented on
Feb 24, 2025 • 2 new comments -
Try re-using huggingface cache in GitHub Actions
#1571 commented on
Feb 18, 2025 • 0 new comments