ModelCapabilitiesIntegrationTest.[34] LLModel(provider=OpenAI, id=gpt-5.1-codex, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Responses], contextLength=400000, maxOutputTokens=128000), MultipleChoices[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/capabilities/ModelCapabilitiesIntegrationTest.kt#L134
ai.koog.prompt.executor.clients.LLMClientException: Error from client: OpenAILLMClient
Error from client: OpenAILLMClient
Status code: 4***4
Error body:
{
"error": {
"message": "This is not a chat model and thus not supported in the v1/chat/completions endpoint. Did you mean to use v1/completions?",
"type": "invalid_request_error",
"param": "model",
"code": null
}
}
Show more
Show less
ModelCapabilitiesIntegrationTest.[33] LLModel(provider=OpenAI, id=gpt-5.1-codex, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Responses], contextLength=400000, maxOutputTokens=128000), Document[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/capabilities/ModelCapabilitiesIntegrationTest.kt#L1
ai.koog.http.client.KoogHttpClientException: Error from client: OpenAILLMClient
Status code: 4***
Error body:
{
"error": {
"message": "Missing required parameter: 'input[1].content[***]'.",
"type": "invalid_request_error",
"param": "input[1].content[***]",
"code": "missing_required_parameter"
}
}
Show more
Show less
AIAgentIntegrationTest.[10] LLModel(provider=OpenRouter, id=qwen/qwen3-vl-8b-instruct, capabilities=[Temperature, Speculation, Tools, Completion, Image, Standard, ToolChoice], contextLength=131072, maxOutputTokens=33000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/agent/AIAgentIntegrationTest.kt#L972
org.opentest4j.AssertionFailedError: calculator tool should be called for model LLModel(provider=OpenRouter, id=qwen/qwen3-vl-8b-instruct, capabilities=[Temperature, Speculation, Tools, Completion, Image, Standard, ToolChoice], contextLength=131***72, maxOutputTokens=33***)
Unexpected elements from index 1
expected:<["calculator"]> but was:<["calculator", "calculator"]>
Show more
Show less
AIAgentIntegrationTest.[10] LLModel(provider=OpenRouter, id=qwen/qwen3-vl-8b-instruct, capabilities=[Temperature, Speculation, Tools, Completion, Image, Standard, ToolChoice], contextLength=131072, maxOutputTokens=33000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/agent/AIAgentIntegrationTest.kt#L464
org.opentest4j.AssertionFailedError: There should be more or equal than 2 single tool calls in a Sequential single run scenario
1 should be >= 2
Show more
Show less
agent-tests
Process completed with exit code 1.
Show more
Show less
SingleLLMPromptExecutorIntegrationTest.[3] LLModel(provider=OpenAI, id=gpt-5.1-codex, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L102
org.opentest4j.AssertionFailedError: <empty string> should include substring "paris"
expected:<paris> but was:<<empty string>>
Show more
Show less
SingleLLMPromptExecutorIntegrationTest.[10] LLModel(provider=OpenRouter, id=qwen/qwen3-vl-8b-instruct, capabilities=[Temperature, Speculation, Tools, Completion, Image, Standard, ToolChoice], contextLength=131072, maxOutputTokens=33000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L187
org.opentest4j.AssertionFailedError: expected:<calculator> but was:<nothing>
Show more
Show less
SingleLLMPromptExecutorIntegrationTest.[3] LLModel(provider=OpenAI, id=gpt-5.1-codex, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L273
java.lang.IllegalArgumentException: List has more than one element.
Show more
Show less
SingleLLMPromptExecutorIntegrationTest.[1] LLModel(provider=OpenAI, id=gpt-5.2, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Completions, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L309
java.util.NoSuchElementException: Collection contains no element matching the predicate.
Show more
Show less
SingleLLMPromptExecutorIntegrationTest.[15] LARGE_IMAGE, LLModel(provider=OpenAI, id=gpt-5.2, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Completions, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L209
org.opentest4j.AssertionFailedError: "Error from client: OpenAILLMClient
Error from client: OpenAILLMClient
Status code: 4***
Error body:
{
"error": {
"message": "Invalid content type. image_url is only supported by certain models.",
"type": "invalid_request_error",
"param": "messages.[1].content.[1].type",
"code": null
}
}
" should include substring "image exceeds"
Match[***]: part of slice with indexes [***..4] matched actual[152..156]
Line[***] ="Error from client: OpenAILLMClient"
Line[1] ="Error from client: OpenAILLMClient"
Line[2] ="Status code: 4***"
Line[3] ="Error body:"
Line[4] ="{"
Line[5] =" "error": {"
Line[6] =" "message": "Invalid content type. image_url is only supported by certain models.","
Match[***]= --------------------------------------+++++-------------------------------------------
Line[7] =" "type": "invalid_request_error","
Line[8] =" "param": "messages.[1].content.[1].type","
Line[9] =" "code": null"
Line[1***] =" }"
Line[11] ="}"
expected:<image exceeds> but was:<Error from client: OpenAILLMClient
Error from client: OpenAILLMClient
Status code: 4***
Error body:
{
"error": {
"message": "Invalid content type. image_url is only supported by certain models.",
"type": "invalid_request_error",
"param": "messages.[1].content.[1].type",
"code": null
}
}
>
Show more
Show less
SingleLLMPromptExecutorIntegrationTest.[3] LLModel(provider=OpenAI, id=gpt-5.1-codex, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L230
java.lang.IllegalArgumentException: List has more than one element.
Show more
Show less
SingleLLMPromptExecutorIntegrationTest.[3] LLModel(provider=Google, id=gemini-2.5-pro, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L315
org.opentest4j.AssertionFailedError: "Of course. Let's continue with the next step.
1. **Start with the previous result:** Our result from the last calculation (5 + 5) was 1***.
2. **Identify the new operation:** The instruction is to "multiply". This means we need to find the total of adding a number to itself a certain number of times.
3. **Identify the number to multiply by:** We need to multiply by 2.
4. **Perform the multiplication:** Multiplying 1*** by 2 is the" should include substring "2***"
expected:<2***> but was:<Of course. Let's continue with the next step.
1. **Start with the previous result:** Our result from the last calculation (5 + 5) was 1***.
2. **Identify the new operation:** The instruction is to "multiply". This means we need to find the total of adding a number to itself a certain number of times.
3. **Identify the number to multiply by:** We need to multiply by 2.
4. **Perform the multiplication:** Multiplying 1*** by 2 is the>
Show more
Show less
SingleLLMPromptExecutorIntegrationTest.[6] BASIC_JPG, LLModel(provider=OpenAI, id=gpt-5.2, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Completions, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L209
ai.koog.prompt.executor.clients.LLMClientException: Error from client: OpenAILLMClient
Error from client: OpenAILLMClient
Status code: 4***
Error body:
{
"error": {
"message": "Invalid content type. image_url is only supported by certain models.",
"type": "invalid_request_error",
"param": "messages.[1].content.[1].type",
"code": null
}
}
Show more
Show less
MultipleLLMPromptExecutorIntegrationTest.[1] LLModel(provider=OpenAI, id=gpt-5.2, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Completions, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L265
java.util.NoSuchElementException: Collection contains no element matching the predicate.
Show more
Show less
MultipleLLMPromptExecutorIntegrationTest.[3] LLModel(provider=OpenAI, id=gpt-5.1-codex, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L108
org.opentest4j.AssertionFailedError: <empty string> should include substring "paris"
expected:<paris> but was:<<empty string>>
Show more
Show less
MultipleLLMPromptExecutorIntegrationTest.[3] LLModel(provider=OpenAI, id=gpt-5.1-codex, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L235
java.lang.IllegalArgumentException: List has more than one element.
Show more
Show less
MultipleLLMPromptExecutorIntegrationTest.[3] LLModel(provider=OpenAI, id=gpt-5.1-codex, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L199
java.lang.IllegalArgumentException: List has more than one element.
Show more
Show less
MultipleLLMPromptExecutorIntegrationTest.[2] BASIC_PNG, LLModel(provider=Google, id=gemini-2.5-pro, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L89
ai.koog.prompt.executor.clients.LLMClientException: Error from client: GoogleLLMClient
Illegal input: Field 'candidates' is required for type with serial name 'ai.koog.prompt.executor.clients.google.models.GoogleResponse', but it was missing at path: $
Show more
Show less
MultipleLLMPromptExecutorIntegrationTest.[15] LARGE_IMAGE, LLModel(provider=OpenAI, id=gpt-5.2, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Completions, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L89
org.opentest4j.AssertionFailedError: "Error from client: OpenAILLMClient
Error from client: OpenAILLMClient
Status code: 4***
Error body:
{
"error": {
"message": "Invalid content type. image_url is only supported by certain models.",
"type": "invalid_request_error",
"param": "messages.[1].content.[1].type",
"code": null
}
}
" should include substring "image exceeds"
Match[***]: part of slice with indexes [***..4] matched actual[152..156]
Line[***] ="Error from client: OpenAILLMClient"
Line[1] ="Error from client: OpenAILLMClient"
Line[2] ="Status code: 4***"
Line[3] ="Error body:"
Line[4] ="{"
Line[5] =" "error": {"
Line[6] =" "message": "Invalid content type. image_url is only supported by certain models.","
Match[***]= --------------------------------------+++++-------------------------------------------
Line[7] =" "type": "invalid_request_error","
Line[8] =" "param": "messages.[1].content.[1].type","
Line[9] =" "code": null"
Line[1***] =" }"
Line[11] ="}"
expected:<image exceeds> but was:<Error from client: OpenAILLMClient
Error from client: OpenAILLMClient
Status code: 4***
Error body:
{
"error": {
"message": "Invalid content type. image_url is only supported by certain models.",
"type": "invalid_request_error",
"param": "messages.[1].content.[1].type",
"code": null
}
}
>
Show more
Show less
MultipleLLMPromptExecutorIntegrationTest.[6] BASIC_JPG, LLModel(provider=OpenAI, id=gpt-5.2, capabilities=[Completion, Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Completions, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]:
integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L89
ai.koog.prompt.executor.clients.LLMClientException: Error from client: OpenAILLMClient
Error from client: OpenAILLMClient
Status code: 4***
Error body:
{
"error": {
"message": "Invalid content type. image_url is only supported by certain models.",
"type": "invalid_request_error",
"param": "messages.[1].content.[1].type",
"code": null
}
}
Show more
Show less
EugeneTheDev