Skip to content

Heavy Tests

Heavy Tests #915

Manually triggered December 23, 2025 10:28
Status Failure
Total duration 9m 24s
Artifacts 9

heavy-tests.yml

on: workflow_dispatch
Matrix: integration-tests
Fit to window
Zoom out
Zoom in

Annotations

11 errors
AIAgentIntegrationTest.[1] LLModel(provider=OpenAI, id=gpt-5.2, capabilities=[Completion, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Completions, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/agent/AIAgentIntegrationTest.kt#L759
org.opentest4j.AssertionFailedError: Collection should contain element "Hello" based on object equality; but the collection is ["d4b51ade-1b74-43d2-bba9-4***38d1951b84/continuous-persistence-strategy/Hello", "d4b51ade-1b74-43d2-bba9-4***38d1951b84/continuous-persistence-strategy/Save", "d4b51ade-1b74-43d2-bba9-4***38d1951b84/continuous-persistence-strategy/Bye-bye", "tombstone"]
AIAgentIntegrationTest.[13] LLModel(provider=MistralAI, id=mistral-medium-latest, capabilities=[Temperature, Completion, Tools, ToolChoice, Basic, Standard, Image, Document, MultipleChoices], contextLength=128000, maxOutputTokens=null)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/agent/AIAgentIntegrationTest.kt#L759
org.opentest4j.AssertionFailedError: Collection should contain element "Hello" based on object equality; but the collection is ["f5***eb97d-982f-4a82-b436-cadef9edd5***5/continuous-persistence-strategy/Hello", "f5***eb97d-982f-4a82-b436-cadef9edd5***5/continuous-persistence-strategy/Save", "f5***eb97d-982f-4a82-b436-cadef9edd5***5/continuous-persistence-strategy/Bye-bye", "tombstone"]
AIAgentIntegrationTest.[12] LLModel(provider=Bedrock, id=us.anthropic.claude-sonnet-4-5-20250929-v1:0, capabilities=[Temperature, Tools, ToolChoice, Completion], contextLength=200000, maxOutputTokens=64000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/agent/AIAgentIntegrationTest.kt#L759
org.opentest4j.AssertionFailedError: Collection should contain element "Hello" based on object equality; but the collection is ["acdddcc8-a3e6-415***-8d1d-88af***857f4fd/continuous-persistence-strategy/Hello", "acdddcc8-a3e6-415***-8d1d-88af***857f4fd/continuous-persistence-strategy/Save", "acdddcc8-a3e6-415***-8d1d-88af***857f4fd/continuous-persistence-strategy/Bye-bye", "tombstone"]
AIAgentIntegrationTest.[11] LLModel(provider=Bedrock, id=us.meta.llama3-1-70b-instruct-v1:0, capabilities=[Temperature, Completion], contextLength=128000, maxOutputTokens=null)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/agent/AIAgentIntegrationTest.kt#L759
org.opentest4j.AssertionFailedError: Collection should contain element "Hello" based on object equality; but the collection is ["***dad***38a-bed7-4f***-9dfd-4a19c17d4f87/continuous-persistence-strategy/Hello", "***dad***38a-bed7-4f***-9dfd-4a19c17d4f87/continuous-persistence-strategy/Save", "***dad***38a-bed7-4f***-9dfd-4a19c17d4f87/continuous-persistence-strategy/Bye-bye", "tombstone"]
AIAgentIntegrationTest.[10] LLModel(provider=OpenRouter, id=qwen/qwen3-vl-8b-instruct, capabilities=[Temperature, Speculation, Tools, Completion, Image, Standard, ToolChoice], contextLength=131072, maxOutputTokens=33000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/agent/AIAgentIntegrationTest.kt#L759
org.opentest4j.AssertionFailedError: Collection should contain element "Hello" based on object equality; but the collection is ["31c9a***c7-e94c-48e5-8b31-73c95a3e2b***4/continuous-persistence-strategy/Hello", "31c9a***c7-e94c-48e5-8b31-73c95a3e2b***4/continuous-persistence-strategy/Save", "31c9a***c7-e94c-48e5-8b31-73c95a3e2b***4/continuous-persistence-strategy/Bye-bye", "tombstone"]
AIAgentIntegrationTest.[9] LLModel(provider=OpenRouter, id=deepseek/deepseek-chat-v3-0324, capabilities=[Temperature, Speculation, Tools, Completion], contextLength=163800, maxOutputTokens=163800)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/agent/AIAgentIntegrationTest.kt#L759
org.opentest4j.AssertionFailedError: Collection should contain element "Hello" based on object equality; but the collection is ["***66141b-4818-49ed-a53a-4d631f374ea8/continuous-persistence-strategy/Hello", "***66141b-4818-49ed-a53a-4d631f374ea8/continuous-persistence-strategy/Save", "***66141b-4818-49ed-a53a-4d631f374ea8/continuous-persistence-strategy/Bye-bye", "tombstone"]
AIAgentIntegrationTest.[8] LLModel(provider=Google, id=gemini-2.5-flash, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/agent/AIAgentIntegrationTest.kt#L759
org.opentest4j.AssertionFailedError: Collection should contain element "Hello" based on object equality; but the collection is ["b58acd3e-f8e1-4cb7-b285-3baf19bffac7/continuous-persistence-strategy/Hello", "b58acd3e-f8e1-4cb7-b285-3baf19bffac7/continuous-persistence-strategy/Save", "b58acd3e-f8e1-4cb7-b285-3baf19bffac7/continuous-persistence-strategy/Bye-bye", "tombstone"]
AIAgentIntegrationTest.[7] LLModel(provider=Google, id=gemini-2.5-pro, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/agent/AIAgentIntegrationTest.kt#L759
org.opentest4j.AssertionFailedError: Collection should contain element "Hello" based on object equality; but the collection is ["25c5ffb1-869f-434c-a5b***-c***1656ec88***b/continuous-persistence-strategy/Hello", "25c5ffb1-869f-434c-a5b***-c***1656ec88***b/continuous-persistence-strategy/Save", "25c5ffb1-869f-434c-a5b***-c***1656ec88***b/continuous-persistence-strategy/Bye-bye", "tombstone"]
AIAgentIntegrationTest.[6] LLModel(provider=Anthropic, id=claude-sonnet-4-5, capabilities=[Temperature, Tools, ToolChoice, Image, Document, Completion], contextLength=200000, maxOutputTokens=64000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/agent/AIAgentIntegrationTest.kt#L759
org.opentest4j.AssertionFailedError: Collection should contain element "Hello" based on object equality; but the collection is ["895f562c-8cea-4***a***-bae7-c9ece***a7d66e/continuous-persistence-strategy/Hello", "895f562c-8cea-4***a***-bae7-c9ece***a7d66e/continuous-persistence-strategy/Save", "895f562c-8cea-4***a***-bae7-c9ece***a7d66e/continuous-persistence-strategy/Bye-bye", "tombstone"]
AIAgentIntegrationTest.[5] LLModel(provider=Anthropic, id=claude-haiku-4-5, capabilities=[Temperature, Tools, ToolChoice, Image, Document, Completion], contextLength=200000, maxOutputTokens=64000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/agent/AIAgentIntegrationTest.kt#L759
org.opentest4j.AssertionFailedError: Collection should contain element "Hello" based on object equality; but the collection is ["3***2***8168-9142-49bb-8ddc-e35cc7da4cb5/continuous-persistence-strategy/Hello", "3***2***8168-9142-49bb-8ddc-e35cc7da4cb5/continuous-persistence-strategy/Save", "3***2***8168-9142-49bb-8ddc-e35cc7da4cb5/continuous-persistence-strategy/Bye-bye", "tombstone"]
agent-tests
Process completed with exit code 1.

Artifacts

Produced during runtime
Name Size Digest
reports-ubuntu-latest-agent-tests
331 KB
sha256:9d654482f6103e2a29865d82c2a6f5321d79d58fc50cc58c4f87aea2f5017be8
reports-ubuntu-latest-anthropic-schema-test
291 KB
sha256:07dfb650fe2a17c0d62aff43f183595f03b042a67d5d063e39c19232041f8dc8
reports-ubuntu-latest-bedrock-credentials-test
288 KB
sha256:a4b3d5e994a054c636f7ee32e8fc2f68928b8045c155d6a4e2ac414b689e07d9
reports-ubuntu-latest-bedrock-tests
288 KB
sha256:cefb3cff928f8e80099ac1c686e74ab9ab1dde0f1a854e34180157bdb77d06a0
reports-ubuntu-latest-capabilities-tests
298 KB
sha256:3e698546d8d5ea12fe6a887a483c58a92041980e2835f9b46e38e83017461062
reports-ubuntu-latest-embeddings-test
288 KB
sha256:5fe0a86bd787d7a7116b24c05c48bf118fccd9330581a7f47af7a2dcd9af85e2
reports-ubuntu-latest-multiple-llm-executor-tests
309 KB
sha256:eec6364aa6d19344dfa79e56ec1b044b4d69b5fe626e767aba59f8aa7ee19333
reports-ubuntu-latest-other-executor-tests
288 KB
sha256:79196beeb12b678acfb3e556eb35b2795c9a8f6f95a4be030d39ee1c3480b1a6
reports-ubuntu-latest-single-llm-executor-tests
309 KB
sha256:b9f3a715add7220de5b00a8495b81ab375938270cdc46fee2c17bc3ddcea98c1