Evaluation on LiveCodeBench-Cpp#885

Merged

wasiahmad merged 46 commits into

mainfrom

livecodebench_cpp

Oct 13, 2025

Commits on Oct 3, 2025

Commits on Oct 4, 2025

Commits on Oct 6, 2025

Commits on Oct 9, 2025

Increase sandbox client timeouts and skip code re-execution on timeout (#900)

i-vainn
authored and
wasiahmad
committed
Control max_concurrent_requests in subclasses with parallel generations (#899)

Kipok
authored and
wasiahmad
committed
Token count for BFCL (#896)

shtoshni
authored and
wasiahmad
committed
MT datasets FLORES200 and WMT24pp (#892)

authored and
wasiahmad
committed
Add responses api type (#889)

smahdavi4
authored and
wasiahmad
committed
Add concurrent semaphore control to llm base class (#907)

smahdavi4
authored and
wasiahmad
committed
Add qos slurm parameter (#906)

authored and
wasiahmad
committed
Fix typo in default tools parameter for token count (#910)

Kipok
authored and
wasiahmad
committed
resolving conflicts
wasiahmad
committed
Slurm tests for code execution timeouts (#905)

i-vainn
authored and
wasiahmad
committed
Add copyright checks workflow (#912)

authored and
wasiahmad
committed
Context error recovery (#914)

shtoshni
authored and
wasiahmad
committed
Fix MCP tests (#916)

gwarmstrong
authored and
wasiahmad
committed
Addding BFCL headers (#917)

shtoshni
authored and
wasiahmad
committed
updated year in copyright message
wasiahmad
committed
lcb-cpp eval without sandbox
wasiahmad
committed
minor doc update
wasiahmad
committed

Commits on Oct 12, 2025