Skip to content
Heavy Tests

Heavy Tests #973

Sign in to view logs

Heavy Tests

Heavy Tests #973

Manually triggered January 22, 2026 16:43
@skarpovdevskarpovdev
⁠ cdf0ed9
skarpov/ai-tests-summary
Status Failure
Total duration 11m 15s
Artifacts 12

heavy-tests.yml

on: workflow_dispatch
Matrix: integration-tests
Fit to window
Zoom out
Zoom in

Annotations

15 errors
ModelCapabilitiesIntegrationTest.[75] model=LLModel(provider=Google, id=gemini-2.5-flash, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536), capability=Image[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/capabilities/ModelCapabilitiesIntegrationTest.kt#L135
java.nio.file.NoSuchFileException: /home/runner/work/koog/koog/integration-tests/build/processedResources/jvm/test/media/basic.jpg
ModelCapabilitiesIntegrationTest.[65] model=LLModel(provider=Google, id=gemini-2.5-pro, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536), capability=Image[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/capabilities/ModelCapabilitiesIntegrationTest.kt#L135
java.nio.file.NoSuchFileException: /home/runner/work/koog/koog/integration-tests/build/processedResources/jvm/test/media/basic.jpg
ModelCapabilitiesIntegrationTest.[55] model=LLModel(provider=Google, id=gemini-3-pro-preview, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536), capability=Image[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/capabilities/ModelCapabilitiesIntegrationTest.kt#L135
java.nio.file.NoSuchFileException: /home/runner/work/koog/koog/integration-tests/build/processedResources/jvm/test/media/basic.jpg
ModelCapabilitiesIntegrationTest.[49] model=LLModel(provider=Anthropic, id=claude-sonnet-4-5, capabilities=[Temperature, Tools, ToolChoice, Image, Document, Completion], contextLength=200000, maxOutputTokens=64000), capability=Image[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/capabilities/ModelCapabilitiesIntegrationTest.kt#L135
java.nio.file.NoSuchFileException: /home/runner/work/koog/koog/integration-tests/build/processedResources/jvm/test/media/basic.jpg
ModelCapabilitiesIntegrationTest.[37] model=LLModel(provider=Anthropic, id=claude-opus-4-5, capabilities=[Temperature, Tools, ToolChoice, Image, Document, Completion], contextLength=200000, maxOutputTokens=64000), capability=Image[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/capabilities/ModelCapabilitiesIntegrationTest.kt#L135
java.nio.file.NoSuchFileException: /home/runner/work/koog/koog/integration-tests/build/processedResources/jvm/test/media/basic.jpg
ModelCapabilitiesIntegrationTest.[43] model=LLModel(provider=Anthropic, id=claude-haiku-4-5, capabilities=[Temperature, Tools, ToolChoice, Image, Document, Completion], contextLength=200000, maxOutputTokens=64000), capability=Image[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/capabilities/ModelCapabilitiesIntegrationTest.kt#L135
java.nio.file.NoSuchFileException: /home/runner/work/koog/koog/integration-tests/build/processedResources/jvm/test/media/basic.jpg
ModelCapabilitiesIntegrationTest.[30] model=LLModel(provider=OpenAI, id=gpt-5.1-codex, capabilities=[Completion, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Responses], contextLength=400000, maxOutputTokens=128000), capability=Image[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/capabilities/ModelCapabilitiesIntegrationTest.kt#L135
java.nio.file.NoSuchFileException: /home/runner/work/koog/koog/integration-tests/build/processedResources/jvm/test/media/basic.jpg
ModelCapabilitiesIntegrationTest.[18] model=LLModel(provider=OpenAI, id=gpt-4.1, capabilities=[Temperature, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, Completion, MultipleChoices, Completions, Responses], contextLength=1047576, maxOutputTokens=32768), capability=Image[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/capabilities/ModelCapabilitiesIntegrationTest.kt#L135
java.nio.file.NoSuchFileException: /home/runner/work/koog/koog/integration-tests/build/processedResources/jvm/test/media/basic.jpg
ModelCapabilitiesIntegrationTest.[7] model=LLModel(provider=OpenAI, id=gpt-5.2, capabilities=[Completion, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Completions, Responses], contextLength=400000, maxOutputTokens=128000), capability=Image[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/capabilities/ModelCapabilitiesIntegrationTest.kt#L135
java.nio.file.NoSuchFileException: /home/runner/work/koog/koog/integration-tests/build/processedResources/jvm/test/media/basic.jpg
capabilities-tests
Process completed with exit code 1.
SingleLLMPromptExecutorIntegrationTest.[7] model=LLModel(provider=Google, id=gemini-3-pro-preview, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/SingleLLMPromptExecutorIntegrationTest.kt#L292
ai.koog.prompt.executor.clients.LLMClientException: Error from client: GoogleLLMClient Error from client: GoogleLLMClient Status code: 429 Error body: { "error": { "code": 429, "message": "You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits. To monitor your current usage, head to: https://ai.dev/rate-limit. \n* Quota exceeded for metric: generativelanguage.googleapis.com/generate_requests_per_model_per_day, limit: ***", "status": "RESOURCE_EXHAUSTED", "details": [ { "@type": "type.googleapis.com/google.rpc.Help", "links": [ { "description": "Learn more about Gemini API quotas", "url": "https://ai.google.dev/gemini-api/docs/rate-limits" } ] }, { "@type": "type.googleapis.com/google.rpc.QuotaFailure", "violations": [ { "quotaMetric": "generativelanguage.googleapis.com/generate_requests_per_model_per_day", "quotaId": "GenerateRequestsPerDayPerProjectPerModel" } ] } ] } }
single-llm-executor-tests
Process completed with exit code 1.
MultipleLLMPromptExecutorIntegrationTest.[3] model=LLModel(provider=OpenAI, id=gpt-5.1-codex, capabilities=[Completion, Basic, Standard, Speculation, Tools, ToolChoice, Image, Document, MultipleChoices, Responses], contextLength=400000, maxOutputTokens=128000)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L1
ai.koog.http.client.KoogHttpClientException: Error from client: OpenAILLMClient Status code: 5*** Error body: { "error": { "message": "An error occurred while processing your request. You can retry your request, or contact us through our help center at help.openai.com if the error persists. Please include the request ID req_d2ec429c55b84cefa622dfc***ce3452*** in your message.", "type": "server_error", "param": null, "code": "server_error" } }
MultipleLLMPromptExecutorIntegrationTest.[7] model=LLModel(provider=Google, id=gemini-3-pro-preview, capabilities=[Temperature, Completion, MultipleChoices, Image, Video, Audio, Tools, ToolChoice, Basic, Standard], contextLength=1048576, maxOutputTokens=65536)[jvm]: integration-tests/src/jvmTest/kotlin/ai/koog/integration/tests/executor/MultipleLLMPromptExecutorIntegrationTest.kt#L245
ai.koog.prompt.executor.clients.LLMClientException: Error from client: GoogleLLMClient Error from client: GoogleLLMClient Status code: 429 Error body: { "error": { "code": 429, "message": "You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits. To monitor your current usage, head to: https://ai.dev/rate-limit. \n* Quota exceeded for metric: generativelanguage.googleapis.com/generate_requests_per_model_per_day, limit: ***", "status": "RESOURCE_EXHAUSTED", "details": [ { "@type": "type.googleapis.com/google.rpc.Help", "links": [ { "description": "Learn more about Gemini API quotas", "url": "https://ai.google.dev/gemini-api/docs/rate-limits" } ] }, { "@type": "type.googleapis.com/google.rpc.QuotaFailure", "violations": [ { "quotaMetric": "generativelanguage.googleapis.com/generate_requests_per_model_per_day", "quotaId": "GenerateRequestsPerDayPerProjectPerModel" } ] } ] } }
multiple-llm-executor-tests
Process completed with exit code 1.

Artifacts

Produced during runtime
Name Size Digest
ai-analysis-capabilities-tests-973 Expired
1.85 KB
sha256:fd457dab29534cd8b201e572040db4220bc7b3f4972d47ac5d58bddbae1eea6f
ai-analysis-multiple-llm-executor-tests-973 Expired
1.88 KB
sha256:7be464a5792e4033689d08fd88b815579a94b267471adba2907ca018dcc838e9
ai-analysis-single-llm-executor-tests-973 Expired
1.94 KB
sha256:018f51a3813a01faea16715004a65a4670149d831dce6e0746a3aa61b2351e28
reports-ubuntu-latest-agent-tests
479 KB
sha256:c1e90cac6af4380c3522c19ec989ccf5939d3581e36a1b3f1027f6aeb7df9f54
reports-ubuntu-latest-anthropic-schema-test
292 KB
sha256:92360a4dbc3aea6717314b935a67e5a173b6288b312c478005880b616ac2fa9c
reports-ubuntu-latest-bedrock-credentials-test
288 KB
sha256:1203298bd4ed8b57f1ea9b6f0e9e7e3fbcdcd77a094b769083e43349bf0351d2
reports-ubuntu-latest-bedrock-tests
288 KB
sha256:c9008b0dbbfe85fd24d02c02998714d2841847efa192c25de3426456be7d37f9
reports-ubuntu-latest-capabilities-tests
316 KB
sha256:84f70e9db04f84f464c7a61a09b59760f9c8d051a1a75d8b0bb93e0ea91a6ebd
reports-ubuntu-latest-embeddings-test
288 KB
sha256:72d7cc4da1d82b07e4bf668a17ac8efc9f5d1dde2a4607da96b75e53a8197c4f
reports-ubuntu-latest-multiple-llm-executor-tests
520 KB
sha256:0ae2b6970adba9653fcc6db6238afd02d3b66ea7049d2ab2170b5d07dd06cca6
reports-ubuntu-latest-other-executor-tests
288 KB
sha256:318e7b7ab1c710e168fd3bf3f8c5906783176f30d380b2ad467fb11461fa3334
reports-ubuntu-latest-single-llm-executor-tests
524 KB
sha256:09c0d0194f82c45ccb9845dfa03936258a8b45919673eec18d582c117ca0ae75