fix, Expected log string in test to match output of new "gotestsum" v… #906
ci.yml
on: push
Build container images
/
docker
3m 4s
Lint the repository
/
lint
27s
Clean up container images
/
delete_branch_container_versions
4s
Clean up container images
/
delete_untagged_container_versions
7s
Matrix: Run tests and lint artifacts
Annotations
7 errors
|
Run tests and lint artifacts (ubuntu-latest) / test
Process completed with exit code 2.
|
|
Run tests and lint artifacts (ubuntu-latest) / test
generated unit test file plain_symflower_test.go\\nAnalyzed 1 out of 1 source files\\nHad 0 errors that block a full analysis\\nGenerated 1 test\\nFound 0 potential problems\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\n\"\ntime=2025-03-18T09:22:33.367Z level=INFO msg=\"command execution\" command=\"go mod tidy\" output=\"\"\ntime=2025-03-18T09:22:34.830Z level=INFO msg=\"command execution\" command=\"symflower test --language golang --workspace /tmp/eval-dev-quality1106064971/plain --coverage-file /tmp/eval-dev-quality1106064971/plain/coverage.json\" output=\"\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\"\ntime=2025-03-18T09:22:34.830Z level=INFO msg=\"model response alone failed execution, attempting to fix with \\\"symflower fix\\\"\"\ntime=2025-03-18T09:22:36.274Z level=INFO msg=\"command execution\" command=\"symflower fix --language golang --workspace /tmp/eval-dev-quality1106064971/plain\" output=\"Repairing plain.go\\nRepairing plain_symflower_test.go\\nRepairing plain_test.go\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\n\"\ntime=2025-03-18T09:22:36.305Z level=INFO msg=\"command execution\" command=\"go mod tidy\" output=\"\"\ntime=2025-03-18T09:22:38.031Z level=INFO msg=\"command execution\" command=\"symflower test --language golang --workspace /tmp/eval-dev-quality1106064971/plain --coverage-file /tmp/eval-dev-quality1106064971/plain/coverage.json\" output=\"\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\"\ntime=2025-03-18T09:22:38.031Z level=INFO msg=\"evaluated model\" model=symflower/symbolic-execution task=write-tests language=golang repository=golang/plain problems=\"[exit status 1\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\\ngithub.com/symflower/eval-dev-quality/util.CommandWithResult\\n\\t/app/util/exec.go:61\\ngithub.com/symflower/eval-dev-quality/language/golang.(*Language).ExecuteTests\\n\\t/app/language/golang/language.go:85\\ngithub.com/symflower/eval-dev-quality/evaluate/task.runModelAndSymflowerFix\\n\\t/app/evaluate/task/symflower.go:92\\ngithub.com/symflower/eval-dev-quality/evaluate/task.(*WriteTests).Run\\n\\t/app/evaluate/task/write-test.go:103\\ngithub.com/symflower/eval-dev-quality/evaluate.Evaluate.func2\\n\\t/app/evaluate/evaluate.go:165\\ngithub.com/symflower/eval-dev-quality/evaluate.withLoadedModel\\n\\t/app/evaluate/evaluate.go:322\\ngithub.com/symflower/eval-dev-quality/evaluate.Evaluate\\n\\t/app/evaluate/evaluate.go:142\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.(*Evaluate).evaluateLocal\\n\\t/app/cmd/eval-dev-quality/cmd/evaluate.go:567\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.(*Evaluate).Execute\\n\\t/app/cmd/eval-dev-quality/cmd/evaluate.go:548\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.Execute.func1\\n\\t/app/cmd/eval-dev-quality/cmd/command.go:66\\ngithub.com/jessevdk/go-flags.(*Parser).ParseArgs\\n\\t/go/pkg/mod/github.com/jessevdk/go-flags@v1.6.1/parser.go:337\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.Execute\\n\\t/app/cmd/eval-dev-quality/cmd/command.go:69\\nmain.main\\n\\t/app/cmd/eval-dev-quality/main.go:11\\nruntime.main\\n\\t/usr/loca
|
|
Run tests and lint artifacts (ubuntu-latest) / test
generated unit test file plain_symflower_test.go\\nAnalyzed 1 out of 1 source files\\nHad 0 errors that block a full analysis\\nGenerated 1 test\\nFound 0 potential problems\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\n\"\ntime=2025-03-18T09:22:33.306Z level=INFO msg=\"command execution\" command=\"go mod tidy\" output=\"\"\ntime=2025-03-18T09:22:35.101Z level=INFO msg=\"command execution\" command=\"symflower test --language golang --workspace /tmp/eval-dev-quality3517858816/plain --coverage-file /tmp/eval-dev-quality3517858816/plain/coverage.json\" output=\"\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\"\ntime=2025-03-18T09:22:35.101Z level=INFO msg=\"model response alone failed execution, attempting to fix with \\\"symflower fix\\\"\"\ntime=2025-03-18T09:22:36.568Z level=INFO msg=\"command execution\" command=\"symflower fix --language golang --workspace /tmp/eval-dev-quality3517858816/plain\" output=\"Repairing plain_test.go\\nRepairing plain.go\\nRepairing plain_symflower_test.go\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\n\"\ntime=2025-03-18T09:22:36.602Z level=INFO msg=\"command execution\" command=\"go mod tidy\" output=\"\"\ntime=2025-03-18T09:22:38.345Z level=INFO msg=\"command execution\" command=\"symflower test --language golang --workspace /tmp/eval-dev-quality3517858816/plain --coverage-file /tmp/eval-dev-quality3517858816/plain/coverage.json\" output=\"\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\"\ntime=2025-03-18T09:22:38.345Z level=INFO msg=\"evaluated model\" model=symflower/symbolic-execution task=write-tests language=golang repository=golang/plain problems=\"[exit status 1\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\\ngithub.com/symflower/eval-dev-quality/util.CommandWithResult\\n\\t/app/util/exec.go:61\\ngithub.com/symflower/eval-dev-quality/language/golang.(*Language).ExecuteTests\\n\\t/app/language/golang/language.go:85\\ngithub.com/symflower/eval-dev-quality/evaluate/task.runModelAndSymflowerFix\\n\\t/app/evaluate/task/symflower.go:92\\ngithub.com/symflower/eval-dev-quality/evaluate/task.(*WriteTests).Run\\n\\t/app/evaluate/task/write-test.go:103\\ngithub.com/symflower/eval-dev-quality/evaluate.Evaluate.func2\\n\\t/app/evaluate/evaluate.go:165\\ngithub.com/symflower/eval-dev-quality/evaluate.withLoadedModel\\n\\t/app/evaluate/evaluate.go:322\\ngithub.com/symflower/eval-dev-quality/evaluate.Evaluate\\n\\t/app/evaluate/evaluate.go:142\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.(*Evaluate).evaluateLocal\\n\\t/app/cmd/eval-dev-quality/cmd/evaluate.go:567\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.(*Evaluate).Execute\\n\\t/app/cmd/eval-dev-quality/cmd/evaluate.go:548\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.Execute.func1\\n\\t/app/cmd/eval-dev-quality/cmd/command.go:66\\ngithub.com/jessevdk/go-flags.(*Parser).ParseArgs\\n\\t/go/pkg/mod/github.com/jessevdk/go-flags@v1.6.1/parser.go:337\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.Execute\\n\\t/app/cmd/eval-dev-quality/cmd/command.go:69\\nmain.main\\n\\t/app/cmd/eval-dev-quality/main.go:11\\nruntime.main\\n\\t/usr/loca
|
|
Run tests and lint artifacts (ubuntu-latest) / test
generated unit test file plain_symflower_test.go\\nAnalyzed 1 out of 1 source files\\nHad 0 errors that block a full analysis\\nGenerated 1 test\\nFound 0 potential problems\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\n\"\ntime=2025-03-18T09:22:33.579Z level=INFO msg=\"command execution\" command=\"go mod tidy\" output=\"\"\ntime=2025-03-18T09:22:35.028Z level=INFO msg=\"command execution\" command=\"symflower test --language golang --workspace /tmp/eval-dev-quality3493832762/plain --coverage-file /tmp/eval-dev-quality3493832762/plain/coverage.json\" output=\"\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\"\ntime=2025-03-18T09:22:35.028Z level=INFO msg=\"model response alone failed execution, attempting to fix with \\\"symflower fix\\\"\"\ntime=2025-03-18T09:22:36.469Z level=INFO msg=\"command execution\" command=\"symflower fix --language golang --workspace /tmp/eval-dev-quality3493832762/plain\" output=\"Repairing plain.go\\nRepairing plain_symflower_test.go\\nRepairing plain_test.go\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\n\"\ntime=2025-03-18T09:22:36.497Z level=INFO msg=\"command execution\" command=\"go mod tidy\" output=\"\"\ntime=2025-03-18T09:22:37.961Z level=INFO msg=\"command execution\" command=\"symflower test --language golang --workspace /tmp/eval-dev-quality3493832762/plain --coverage-file /tmp/eval-dev-quality3493832762/plain/coverage.json\" output=\"\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\"\ntime=2025-03-18T09:22:37.962Z level=INFO msg=\"evaluated model\" model=symflower/symbolic-execution task=write-tests language=golang repository=golang/plain problems=\"[exit status 1\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\\ngithub.com/symflower/eval-dev-quality/util.CommandWithResult\\n\\t/app/util/exec.go:61\\ngithub.com/symflower/eval-dev-quality/language/golang.(*Language).ExecuteTests\\n\\t/app/language/golang/language.go:85\\ngithub.com/symflower/eval-dev-quality/evaluate/task.runModelAndSymflowerFix\\n\\t/app/evaluate/task/symflower.go:92\\ngithub.com/symflower/eval-dev-quality/evaluate/task.(*WriteTests).Run\\n\\t/app/evaluate/task/write-test.go:103\\ngithub.com/symflower/eval-dev-quality/evaluate.Evaluate.func2\\n\\t/app/evaluate/evaluate.go:165\\ngithub.com/symflower/eval-dev-quality/evaluate.withLoadedModel\\n\\t/app/evaluate/evaluate.go:322\\ngithub.com/symflower/eval-dev-quality/evaluate.Evaluate\\n\\t/app/evaluate/evaluate.go:142\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.(*Evaluate).evaluateLocal\\n\\t/app/cmd/eval-dev-quality/cmd/evaluate.go:567\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.(*Evaluate).Execute\\n\\t/app/cmd/eval-dev-quality/cmd/evaluate.go:548\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.Execute.func1\\n\\t/app/cmd/eval-dev-quality/cmd/command.go:66\\ngithub.com/jessevdk/go-flags.(*Parser).ParseArgs\\n\\t/go/pkg/mod/github.com/jessevdk/go-flags@v1.6.1/parser.go:337\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.Execute\\n\\t/app/cmd/eval-dev-quality/cmd/command.go:69\\nmain.main\\n\\t/app/cmd/eval-dev-quality/main.go:11\\nruntime.main\\n\\t/usr/loca
|
|
Run tests and lint artifacts (ubuntu-latest) / test
generated unit test file plain_symflower_test.go\\nAnalyzed 1 out of 1 source files\\nHad 0 errors that block a full analysis\\nGenerated 1 test\\nFound 0 potential problems\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\n\"\ntime=2025-03-18T09:22:33.367Z level=INFO msg=\"command execution\" command=\"go mod tidy\" output=\"\"\ntime=2025-03-18T09:22:34.830Z level=INFO msg=\"command execution\" command=\"symflower test --language golang --workspace /tmp/eval-dev-quality1106064971/plain --coverage-file /tmp/eval-dev-quality1106064971/plain/coverage.json\" output=\"\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\"\ntime=2025-03-18T09:22:34.830Z level=INFO msg=\"model response alone failed execution, attempting to fix with \\\"symflower fix\\\"\"\ntime=2025-03-18T09:22:36.274Z level=INFO msg=\"command execution\" command=\"symflower fix --language golang --workspace /tmp/eval-dev-quality1106064971/plain\" output=\"Repairing plain.go\\nRepairing plain_symflower_test.go\\nRepairing plain_test.go\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\n\"\ntime=2025-03-18T09:22:36.305Z level=INFO msg=\"command execution\" command=\"go mod tidy\" output=\"\"\ntime=2025-03-18T09:22:38.031Z level=INFO msg=\"command execution\" command=\"symflower test --language golang --workspace /tmp/eval-dev-quality1106064971/plain --coverage-file /tmp/eval-dev-quality1106064971/plain/coverage.json\" output=\"\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\"\ntime=2025-03-18T09:22:38.031Z level=INFO msg=\"evaluated model\" model=symflower/symbolic-execution task=write-tests language=golang repository=golang/plain problems=\"[exit status 1\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\\ngithub.com/symflower/eval-dev-quality/util.CommandWithResult\\n\\t/app/util/exec.go:61\\ngithub.com/symflower/eval-dev-quality/language/golang.(*Language).ExecuteTests\\n\\t/app/language/golang/language.go:85\\ngithub.com/symflower/eval-dev-quality/evaluate/task.runModelAndSymflowerFix\\n\\t/app/evaluate/task/symflower.go:92\\ngithub.com/symflower/eval-dev-quality/evaluate/task.(*WriteTests).Run\\n\\t/app/evaluate/task/write-test.go:103\\ngithub.com/symflower/eval-dev-quality/evaluate.Evaluate.func2\\n\\t/app/evaluate/evaluate.go:165\\ngithub.com/symflower/eval-dev-quality/evaluate.withLoadedModel\\n\\t/app/evaluate/evaluate.go:322\\ngithub.com/symflower/eval-dev-quality/evaluate.Evaluate\\n\\t/app/evaluate/evaluate.go:142\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.(*Evaluate).evaluateLocal\\n\\t/app/cmd/eval-dev-quality/cmd/evaluate.go:567\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.(*Evaluate).Execute\\n\\t/app/cmd/eval-dev-quality/cmd/evaluate.go:548\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.Execute.func1\\n\\t/app/cmd/eval-dev-quality/cmd/command.go:66\\ngithub.com/jessevdk/go-flags.(*Parser).ParseArgs\\n\\t/go/pkg/mod/github.com/jessevdk/go-flags@v1.6.1/parser.go:337\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.Execute\\n\\t/app/cmd/eval-dev-quality/cmd/command.go:69\\nmain.main\\n\\t/app/cmd/eval-dev-quality/main.go:11\\nruntime.main\\n\\t/usr/loca
|
|
Run tests and lint artifacts (ubuntu-latest) / test
generated unit test file plain_symflower_test.go\\nAnalyzed 1 out of 1 source files\\nHad 0 errors that block a full analysis\\nGenerated 1 test\\nFound 0 potential problems\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\n\"\ntime=2025-03-18T09:22:33.306Z level=INFO msg=\"command execution\" command=\"go mod tidy\" output=\"\"\ntime=2025-03-18T09:22:35.101Z level=INFO msg=\"command execution\" command=\"symflower test --language golang --workspace /tmp/eval-dev-quality3517858816/plain --coverage-file /tmp/eval-dev-quality3517858816/plain/coverage.json\" output=\"\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\"\ntime=2025-03-18T09:22:35.101Z level=INFO msg=\"model response alone failed execution, attempting to fix with \\\"symflower fix\\\"\"\ntime=2025-03-18T09:22:36.568Z level=INFO msg=\"command execution\" command=\"symflower fix --language golang --workspace /tmp/eval-dev-quality3517858816/plain\" output=\"Repairing plain_test.go\\nRepairing plain.go\\nRepairing plain_symflower_test.go\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\n\"\ntime=2025-03-18T09:22:36.602Z level=INFO msg=\"command execution\" command=\"go mod tidy\" output=\"\"\ntime=2025-03-18T09:22:38.345Z level=INFO msg=\"command execution\" command=\"symflower test --language golang --workspace /tmp/eval-dev-quality3517858816/plain --coverage-file /tmp/eval-dev-quality3517858816/plain/coverage.json\" output=\"\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\"\ntime=2025-03-18T09:22:38.345Z level=INFO msg=\"evaluated model\" model=symflower/symbolic-execution task=write-tests language=golang repository=golang/plain problems=\"[exit status 1\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\\ngithub.com/symflower/eval-dev-quality/util.CommandWithResult\\n\\t/app/util/exec.go:61\\ngithub.com/symflower/eval-dev-quality/language/golang.(*Language).ExecuteTests\\n\\t/app/language/golang/language.go:85\\ngithub.com/symflower/eval-dev-quality/evaluate/task.runModelAndSymflowerFix\\n\\t/app/evaluate/task/symflower.go:92\\ngithub.com/symflower/eval-dev-quality/evaluate/task.(*WriteTests).Run\\n\\t/app/evaluate/task/write-test.go:103\\ngithub.com/symflower/eval-dev-quality/evaluate.Evaluate.func2\\n\\t/app/evaluate/evaluate.go:165\\ngithub.com/symflower/eval-dev-quality/evaluate.withLoadedModel\\n\\t/app/evaluate/evaluate.go:322\\ngithub.com/symflower/eval-dev-quality/evaluate.Evaluate\\n\\t/app/evaluate/evaluate.go:142\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.(*Evaluate).evaluateLocal\\n\\t/app/cmd/eval-dev-quality/cmd/evaluate.go:567\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.(*Evaluate).Execute\\n\\t/app/cmd/eval-dev-quality/cmd/evaluate.go:548\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.Execute.func1\\n\\t/app/cmd/eval-dev-quality/cmd/command.go:66\\ngithub.com/jessevdk/go-flags.(*Parser).ParseArgs\\n\\t/go/pkg/mod/github.com/jessevdk/go-flags@v1.6.1/parser.go:337\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.Execute\\n\\t/app/cmd/eval-dev-quality/cmd/command.go:69\\nmain.main\\n\\t/app/cmd/eval-dev-quality/main.go:11\\nruntime.main\\n\\t/usr/loca
|
|
Run tests and lint artifacts (ubuntu-latest) / test
generated unit test file plain_symflower_test.go\\nAnalyzed 1 out of 1 source files\\nHad 0 errors that block a full analysis\\nGenerated 1 test\\nFound 0 potential problems\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\n\"\ntime=2025-03-18T09:22:33.579Z level=INFO msg=\"command execution\" command=\"go mod tidy\" output=\"\"\ntime=2025-03-18T09:22:35.028Z level=INFO msg=\"command execution\" command=\"symflower test --language golang --workspace /tmp/eval-dev-quality3493832762/plain --coverage-file /tmp/eval-dev-quality3493832762/plain/coverage.json\" output=\"\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\"\ntime=2025-03-18T09:22:35.028Z level=INFO msg=\"model response alone failed execution, attempting to fix with \\\"symflower fix\\\"\"\ntime=2025-03-18T09:22:36.469Z level=INFO msg=\"command execution\" command=\"symflower fix --language golang --workspace /tmp/eval-dev-quality3493832762/plain\" output=\"Repairing plain.go\\nRepairing plain_symflower_test.go\\nRepairing plain_test.go\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\n\"\ntime=2025-03-18T09:22:36.497Z level=INFO msg=\"command execution\" command=\"go mod tidy\" output=\"\"\ntime=2025-03-18T09:22:37.961Z level=INFO msg=\"command execution\" command=\"symflower test --language golang --workspace /tmp/eval-dev-quality3493832762/plain --coverage-file /tmp/eval-dev-quality3493832762/plain/coverage.json\" output=\"\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\"\ntime=2025-03-18T09:22:37.962Z level=INFO msg=\"evaluated model\" model=symflower/symbolic-execution task=write-tests language=golang repository=golang/plain problems=\"[exit status 1\\n\\x1b[0;34mGive us your feedback and let us know how we can improve Symflower at hello@symflower.com or https://github.com/symflower/symflower. Thanks so much for your help!\\x1b[0m\\nERROR: execution failed: exec: \\\"gotestsum\\\": executable file not found in $PATH\\n\\ngithub.com/symflower/eval-dev-quality/util.CommandWithResult\\n\\t/app/util/exec.go:61\\ngithub.com/symflower/eval-dev-quality/language/golang.(*Language).ExecuteTests\\n\\t/app/language/golang/language.go:85\\ngithub.com/symflower/eval-dev-quality/evaluate/task.runModelAndSymflowerFix\\n\\t/app/evaluate/task/symflower.go:92\\ngithub.com/symflower/eval-dev-quality/evaluate/task.(*WriteTests).Run\\n\\t/app/evaluate/task/write-test.go:103\\ngithub.com/symflower/eval-dev-quality/evaluate.Evaluate.func2\\n\\t/app/evaluate/evaluate.go:165\\ngithub.com/symflower/eval-dev-quality/evaluate.withLoadedModel\\n\\t/app/evaluate/evaluate.go:322\\ngithub.com/symflower/eval-dev-quality/evaluate.Evaluate\\n\\t/app/evaluate/evaluate.go:142\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.(*Evaluate).evaluateLocal\\n\\t/app/cmd/eval-dev-quality/cmd/evaluate.go:567\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.(*Evaluate).Execute\\n\\t/app/cmd/eval-dev-quality/cmd/evaluate.go:548\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.Execute.func1\\n\\t/app/cmd/eval-dev-quality/cmd/command.go:66\\ngithub.com/jessevdk/go-flags.(*Parser).ParseArgs\\n\\t/go/pkg/mod/github.com/jessevdk/go-flags@v1.6.1/parser.go:337\\ngithub.com/symflower/eval-dev-quality/cmd/eval-dev-quality/cmd.Execute\\n\\t/app/cmd/eval-dev-quality/cmd/command.go:69\\nmain.main\\n\\t/app/cmd/eval-dev-quality/main.go:11\\nruntime.main\\n\\t/usr/loca
|