Heavy Tests

Support GPT-5.2 and GPT-5.2 Pro (#1266) #883

Sign in to view logs

Re-run triggered December 12, 2025 15:02

develop

Status Failure

Total duration 10m 33s

Artifacts 12

heavy-tests.yml

on: push

Matrix: integration-tests

Annotations

6 errors

SingleLLMPromptExecutorIntegrationTest.[3] LLModel(provider=OpenAI, id=gpt-5.1-codex, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L102

org.opentest4j.AssertionFailedError: <empty string> should include substring "paris" expected:<paris> but was:<<empty string>>

SingleLLMPromptExecutorIntegrationTest.[10] LLModel(provider=OpenRouter, id=qwen/qwen3-vl-8b-instruct, capabilities=[Temperature, Speculation, Tools, Completion, Image, Standard, ToolChoice], contextLength=131072, maxOutputTokens=33000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L187

org.opentest4j.AssertionFailedError: expected:<calculator> but was:<nothing>

SingleLLMPromptExecutorIntegrationTest.[3] LLModel(provider=OpenAI, id=gpt-5.1-codex, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L273

java.lang.IllegalArgumentException: List has more than one element.

SingleLLMPromptExecutorIntegrationTest.[1] LLModel(provider=OpenAI, id=gpt-5.2, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Completions, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L309

java.util.NoSuchElementException: Collection contains no element matching the predicate.

SingleLLMPromptExecutorIntegrationTest.[3] LLModel(provider=OpenAI, id=gpt-5.1-codex, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L230

java.lang.IllegalArgumentException: List has more than one element.

single-llm-executor-tests

Process completed with exit code 1.

Artifacts

Produced during runtime

Name	Size	Digest
reports-ubuntu-latest-single-llm-executor-tests	306 KB	`sha256:f11cd7add9a941fe3e667ac8c51a12ea6d655eec20b274c527ca92e7f127ada1`