Skip to content

KG-178. Drop runId from agent execution path. #896

KG-178. Drop runId from agent execution path.

KG-178. Drop runId from agent execution path. #896

Triggered via push December 17, 2025 13:03
Status Failure
Total duration 11m 29s
Artifacts 9

heavy-tests.yml

on: push
Matrix: integration-tests
Fit to window
Zoom out
Zoom in

Annotations

31 errors
ModelCapabilitiesIntegrationTest.[67] LLModel(provider=Google, id=gemini-2.5-flash, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536), Image[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/capabilities/ModelCapabilitiesIntegrationTest.kt#L179
ai.koog.prompt.executor.clients.LLMClientException: Error from client: GoogleLLMClient Illegal input: Field 'candidates' is required for type with serial name 'ai.koog.prompt.executor.clients.google.models.GoogleResponse', but it was missing at path: $
ModelCapabilitiesIntegrationTest.[57] LLModel(provider=Google, id=gemini-2.5-pro, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536), Image[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/capabilities/ModelCapabilitiesIntegrationTest.kt#L179
ai.koog.prompt.executor.clients.LLMClientException: Error from client: GoogleLLMClient Illegal input: Field 'candidates' is required for type with serial name 'ai.koog.prompt.executor.clients.google.models.GoogleResponse', but it was missing at path: $
ModelCapabilitiesIntegrationTest.[34] LLModel(provider=OpenAI, id=gpt-5.1-codex, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Responses], contextLength=400000, maxOutputTokens=128000), MultipleChoices[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/capabilities/ModelCapabilitiesIntegrationTest.kt#L134
ai.koog.prompt.executor.clients.LLMClientException: Error from client: OpenAILLMClient Error from client: OpenAILLMClient Status code: 4***4 Error body: { "error": { "message": "This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?", "type": "invalid_request_error", "param": "model", "code": null } }
ModelCapabilitiesIntegrationTest.[33] LLModel(provider=OpenAI, id=gpt-5.1-codex, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Responses], contextLength=400000, maxOutputTokens=128000), Document[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/capabilities/ModelCapabilitiesIntegrationTest.kt#L1
ai.koog.http.client.KoogHttpClientException: Error from client: OpenAILLMClient Status code: 4*** Error body: { "error": { "message": "Missing required parameter: 'input[1].content[***]'.", "type": "invalid_request_error", "param": "input[1].content[***]", "code": "missing_required_parameter" } }
capabilities-tests
Process completed with exit code 1.
AIAgentIntegrationTest.[10] LLModel(provider=OpenRouter, id=qwen/qwen3-vl-8b-instruct, capabilities=[Temperature, Speculation, Tools, Completion, Image, Standard, ToolChoice], contextLength=131072, maxOutputTokens=33000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/agent/AIAgentIntegrationTest.kt#L445
kotlinx.serialization.json.internal.JsonDecodingException: Unexpected JSON token at offset 44: Expected EOF after parsing, but had { instead at path: $ JSON input: {"operation": "MULTIPLY", "a": 7, "b": 2} {"milliseconds": 5***}
AIAgentIntegrationTest.[10] LLModel(provider=OpenRouter, id=qwen/qwen3-vl-8b-instruct, capabilities=[Temperature, Speculation, Tools, Completion, Image, Standard, ToolChoice], contextLength=131072, maxOutputTokens=33000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/agent/AIAgentIntegrationTest.kt#L972
org.opentest4j.AssertionFailedError: calculator tool should be called for model LLModel(provider=OpenRouter, id=qwen/qwen3-vl-8b-instruct, capabilities=[Temperature, Speculation, Tools, Completion, Image, Standard, ToolChoice], contextLength=131***72, maxOutputTokens=33***) Unexpected elements from index 1 expected:<["calculator"]> but was:<["calculator", "calculator"]>
AIAgentIntegrationTest.[10] LLModel(provider=OpenRouter, id=qwen/qwen3-vl-8b-instruct, capabilities=[Temperature, Speculation, Tools, Completion, Image, Standard, ToolChoice], contextLength=131072, maxOutputTokens=33000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/agent/AIAgentIntegrationTest.kt#L464
kotlinx.serialization.json.internal.JsonDecodingException: Unexpected JSON token at offset 44: Expected EOF after parsing, but had { instead at path: $ JSON input: {"operation": "MULTIPLY", "a": 7, "b": 2} {"milliseconds": 5***}
agent-tests
Process completed with exit code 1.
SingleLLMPromptExecutorIntegrationTest.[2] BASIC_PNG, LLModel(provider=Google, id=gemini-2.5-pro, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L209
ai.koog.prompt.executor.clients.LLMClientException: Error from client: GoogleLLMClient Illegal input: Field 'candidates' is required for type with serial name 'ai.koog.prompt.executor.clients.google.models.GoogleResponse', but it was missing at path: $
SingleLLMPromptExecutorIntegrationTest.[20] SMALL_IMAGE, LLModel(provider=Google, id=gemini-2.5-pro, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L209
ai.koog.prompt.executor.clients.LLMClientException: Error from client: GoogleLLMClient Illegal input: Field 'candidates' is required for type with serial name 'ai.koog.prompt.executor.clients.google.models.GoogleResponse', but it was missing at path: $
SingleLLMPromptExecutorIntegrationTest.[8] LLModel(provider=Google, id=gemini-2.5-flash, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L230
ai.koog.prompt.executor.clients.LLMClientException: Error from client: GoogleLLMClient Illegal input: Field 'candidates' is required for type with serial name 'ai.koog.prompt.executor.clients.google.models.GoogleResponse', but it was missing at path: $
SingleLLMPromptExecutorIntegrationTest.[7] LLModel(provider=Google, id=gemini-2.5-pro, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L230
ai.koog.prompt.executor.clients.LLMClientException: Error from client: GoogleLLMClient Illegal input: Field 'candidates' is required for type with serial name 'ai.koog.prompt.executor.clients.google.models.GoogleResponse', but it was missing at path: $
SingleLLMPromptExecutorIntegrationTest.[15] LARGE_IMAGE, LLModel(provider=OpenAI, id=gpt-5.2, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Completions, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L209
org.opentest4j.AssertionFailedError: "Error from client: OpenAILLMClient Error from client: OpenAILLMClient Status code: 4*** Error body: { "error": { "message": "Invalid content type. image_url is only supported by certain models.", "type": "invalid_request_error", "param": "messages.[1].content.[1].type", "code": null } } " should include substring "image exceeds" Match[***]: part of slice with indexes [***..4] matched actual[152..156] Line[***] ="Error from client: OpenAILLMClient" Line[1] ="Error from client: OpenAILLMClient" Line[2] ="Status code: 4***" Line[3] ="Error body:" Line[4] ="{" Line[5] =" "error": {" Line[6] =" "message": "Invalid content type. image_url is only supported by certain models."," Match[***]= --------------------------------------+++++------------------------------------------- Line[7] =" "type": "invalid_request_error"," Line[8] =" "param": "messages.[1].content.[1].type"," Line[9] =" "code": null" Line[1***] =" }" Line[11] ="}" expected:<image exceeds> but was:<Error from client: OpenAILLMClient Error from client: OpenAILLMClient Status code: 4*** Error body: { "error": { "message": "Invalid content type. image_url is only supported by certain models.", "type": "invalid_request_error", "param": "messages.[1].content.[1].type", "code": null } } >
SingleLLMPromptExecutorIntegrationTest.[3] LLModel(provider=Google, id=gemini-2.5-pro, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L315
org.opentest4j.AssertionFailedError: "Of course, let's continue with the next step. **Step 4 (from previous calculation):** We count the total number of apples. We started with 5 and added 5 more. Counting them all together (1, 2, 3, 4, 5... 6, 7, 8, 9, 1***), we get a total of 1***. * So, 5 + 5 = 1***. Now, let's multiply that result by 2" should include substring "2***" expected:<2***> but was:<Of course, let's continue with the next step. **Step 4 (from previous calculation):** We count the total number of apples. We started with 5 and added 5 more. Counting them all together (1, 2, 3, 4, 5... 6, 7, 8, 9, 1***), we get a total of 1***. * So, 5 + 5 = 1***. Now, let's multiply that result by 2>
SingleLLMPromptExecutorIntegrationTest.[6] BASIC_JPG, LLModel(provider=OpenAI, id=gpt-5.2, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Completions, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L209
ai.koog.prompt.executor.clients.LLMClientException: Error from client: OpenAILLMClient Error from client: OpenAILLMClient Status code: 4*** Error body: { "error": { "message": "Invalid content type. image_url is only supported by certain models.", "type": "invalid_request_error", "param": "messages.[1].content.[1].type", "code": null } }
single-llm-executor-tests
Process completed with exit code 1.
MultipleLLMPromptExecutorIntegrationTest.[2] BASIC_PNG, LLModel(provider=Google, id=gemini-2.5-pro, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L89
ai.koog.prompt.executor.clients.LLMClientException: Error from client: GoogleLLMClient Illegal input: Field 'candidates' is required for type with serial name 'ai.koog.prompt.executor.clients.google.models.GoogleResponse', but it was missing at path: $
MultipleLLMPromptExecutorIntegrationTest.[20] SMALL_IMAGE, LLModel(provider=Google, id=gemini-2.5-pro, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L89
ai.koog.prompt.executor.clients.LLMClientException: Error from client: GoogleLLMClient Illegal input: Field 'candidates' is required for type with serial name 'ai.koog.prompt.executor.clients.google.models.GoogleResponse', but it was missing at path: $
MultipleLLMPromptExecutorIntegrationTest.[8] LLModel(provider=Google, id=gemini-2.5-flash, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L199
ai.koog.prompt.executor.clients.LLMClientException: Error from client: GoogleLLMClient Illegal input: Field 'candidates' is required for type with serial name 'ai.koog.prompt.executor.clients.google.models.GoogleResponse', but it was missing at path: $
MultipleLLMPromptExecutorIntegrationTest.[7] LLModel(provider=Google, id=gemini-2.5-pro, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L199
ai.koog.prompt.executor.clients.LLMClientException: Error from client: GoogleLLMClient Illegal input: Field 'candidates' is required for type with serial name 'ai.koog.prompt.executor.clients.google.models.GoogleResponse', but it was missing at path: $
MultipleLLMPromptExecutorIntegrationTest.[15] LARGE_IMAGE, LLModel(provider=OpenAI, id=gpt-5.2, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Completions, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L89
org.opentest4j.AssertionFailedError: "Error from client: OpenAILLMClient Error from client: OpenAILLMClient Status code: 4*** Error body: { "error": { "message": "Invalid content type. image_url is only supported by certain models.", "type": "invalid_request_error", "param": "messages.[1].content.[1].type", "code": null } } " should include substring "image exceeds" Match[***]: part of slice with indexes [***..4] matched actual[152..156] Line[***] ="Error from client: OpenAILLMClient" Line[1] ="Error from client: OpenAILLMClient" Line[2] ="Status code: 4***" Line[3] ="Error body:" Line[4] ="{" Line[5] =" "error": {" Line[6] =" "message": "Invalid content type. image_url is only supported by certain models."," Match[***]= --------------------------------------+++++------------------------------------------- Line[7] =" "type": "invalid_request_error"," Line[8] =" "param": "messages.[1].content.[1].type"," Line[9] =" "code": null" Line[1***] =" }" Line[11] ="}" expected:<image exceeds> but was:<Error from client: OpenAILLMClient Error from client: OpenAILLMClient Status code: 4*** Error body: { "error": { "message": "Invalid content type. image_url is only supported by certain models.", "type": "invalid_request_error", "param": "messages.[1].content.[1].type", "code": null } } >
MultipleLLMPromptExecutorIntegrationTest.[3] LLModel(provider=Google, id=gemini-2.5-pro, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L271
org.opentest4j.AssertionFailedError: "Of course! Let's continue with the next step. 1. **Recall the previous result:** From our last calculation (5 + 5), the result was **1*****. 2. **Identify the new operation:** The instruction is to "multiply... by 2". The multiplication sign is "x" or "*". 3. **Set up the new problem:** We need to calculate: 1*** *" should include substring "2***" expected:<2***> but was:<Of course! Let's continue with the next step. 1. **Recall the previous result:** From our last calculation (5 + 5), the result was **1*****. 2. **Identify the new operation:** The instruction is to "multiply... by 2". The multiplication sign is "x" or "*". 3. **Set up the new problem:** We need to calculate: 1*** *>
MultipleLLMPromptExecutorIntegrationTest.[6] BASIC_JPG, LLModel(provider=OpenAI, id=gpt-5.2, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Completions, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L89
ai.koog.prompt.executor.clients.LLMClientException: Error from client: OpenAILLMClient Error from client: OpenAILLMClient Status code: 4*** Error body: { "error": { "message": "Invalid content type. image_url is only supported by certain models.", "type": "invalid_request_error", "param": "messages.[1].content.[1].type", "code": null } }
multiple-llm-executor-tests
Process completed with exit code 1.

Artifacts

Produced during runtime
Name Size Digest
reports-ubuntu-latest-agent-tests
334 KB
sha256:5bd98e6395d9e434e61b82cd978b6cf8f355e08f1b42177782362b540c41b27d
reports-ubuntu-latest-anthropic-schema-test
287 KB
sha256:ea283283f3150005bc425b0c052176d9e64f04b38780f588849a43632b62e447
reports-ubuntu-latest-bedrock-credentials-test
284 KB
sha256:dcf70aea1a4006e2f53bca00d77987a6cee5225dee4ee145a187abff4861cfdb
reports-ubuntu-latest-bedrock-tests
284 KB
sha256:91884fded5015845c52031059e048d23d58dcdfc7ccfd24e52127146a94baf17
reports-ubuntu-latest-capabilities-tests
297 KB
sha256:18668ed6bca420485d8038cefc4636ec7fdb89195f7c2849366d40d47d1728ad
reports-ubuntu-latest-embeddings-test
284 KB
sha256:cad5d6663621568caf200c2f084c972a46a9a941f0382f0ee9f27428a34e2eb1
reports-ubuntu-latest-multiple-llm-executor-tests
310 KB
sha256:064cc1f950d5fd98e7b98eacbddca61189ea633b381681c1d943116a1279b752
reports-ubuntu-latest-other-executor-tests
284 KB
sha256:224abd375f4b9fb389e29e6c8175760a807e1fcc69ea5d3b2fc4ff9b938c2d4d
reports-ubuntu-latest-single-llm-executor-tests
312 KB
sha256:c112c5ce6c079a399f40e88d7cbef4bf0700c1c4631d6380c616561425971de8