Not able to execute TestZeus Hercules

[Utk98]

Describe the bug

I am trying to execute same steps as done in https://www.youtube.com/watch?v=9D-SZGoDrfc&t=453s . But facing problem while executing final command .

To Reproduce

When executing
" testzeus-hercules --project-base=project_base --llm-model gemini-2.0-flash-exp --llm-model-api-key XXX" , As writtern in document testzeus can also work with gemini 1.5pro and above so i am using gemini 2.0 flash , but still getting an error,I had attached the logs

Screenshots
Attested logs

testzeus.txt

Desktop (please complete the following information):

• OS: [e.g. iOS]
• Version [e.g. 22]

Additional context
Add any other context about the problem here.

[shriyanshagnihotri]

Hi

you can refer to this file
https://github.com/test-zeus-ai/testzeus-hercules/blob/main/agents_llm_config-example.json

to run with non OpenAI llms
you can check this file. We forgot to document this step in the ReadMe.

Check link: https://testzeuscommunityhq.slack.com/archives/C081GTY2T8V/p1738300347723369

also we would love to get this part documented in the Readme or run_me

we welcome community PRs.

[Utk98]

Getting this when trying to login community in slack [image: image.png]

…

On Tue, Feb 4, 2025 at 1:54 PM Shriyansh Agnihotri ***@***.***> wrote: Hi you can refer to this file https://github.com/test-zeus-ai/testzeus-hercules/blob/main/agents_llm_config-example.json to run with non OpenAI llms you can check this file. We forgot to document this step in the ReadMe. Check link: https://testzeuscommunityhq.slack.com/archives/C081GTY2T8V/p1738300347723369 also we would love to get this part documented in the Readme or run_me <https://github.com/test-zeus-ai/testzeus-hercules/blob/main/docs/run_guide.md> we welcome community PRs. — Reply to this email directly, view it on GitHub <#37 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AV2LREMAUZKBD6LRQRROCZL2OB2MZAVCNFSM6AAAAABWLSNRDOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMMZTGE4TKNBSGI> . You are receiving this because you authored the thread.Message ID: ***@***.***>

[Utk98]

Where should I place these lines within the folder structure, and in which specific file should they be added?

"gemini": {
"planner_agent": {
"model_name": "gemini-1.5-pro-002",
"model_api_type": "google",
"llm_config_params": {
"cache_seed": null,
"temperature": 0.0,
"top_p": 0.001,
"seed": 12345
}
},
"nav_agent": {
"model_name": "gemini-1.5-pro-002",
"model_api_type": "google",
"llm_config_params": {
"cache_seed": null,
"temperature": 0.0,
"top_p": 0.001,
"seed": 12345
}
}
}

[shriyanshagnihotri]

1. you have to create .env from .env-example file
2. the LLM_MODEL_NAME and LLM_API_KEY only works for openAI models.
3. For any non-OpenAI model you have to create a copy of this https://github.com/test-zeus-ai/testzeus-hercules/blob/main/agents_llm_config-example.json and then fill the details of LLM in that based on the type of LLM that you are trying to use.
4. then fill the AGENTS_LLM_CONFIG_FILE=(the new config file path) in the .env file created in 1.
5. then fill the AGENTS_LLM_CONFIG_FILE_REF_KEY= llm of your choice from the config file.
6. Don't forget to comment LLM_MODEL_NAME and LLM_MODEL_API_KEY in .env if you are opting for any non OpenAI llms.

[shriyanshagnihotri]

@Utk98 shall we close this issue?

[Rafe2001]

I was running testzeus hercules and I got the error

2025-02-12 23:50:47] INFO {playwright_manager.py:389} - Connecting over CDP with provided configuration.
Traceback (most recent call last):
File "", line 198, in run_module_as_main
File "", line 88, in run_code
File "E:\her_clone\env\Scripts\testzeus-hercules.exe_main.py", line 7, in
File "E:\her_clone\env\Lib\site-packages\testzeus_hercules_main.py", line 255, in main
asyncio.run(a_main())
File "E:\her_clone\env\Lib\site-packages\nest_asyncio.py", line 30, in run
return loop.run_until_complete(task)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\her_clone\env\Lib\site-packages\nest_asyncio.py", line 98, in run_until_complete
return f.result()
^^^^^^^^^^
File "C:\Python311\Lib\asyncio\futures.py", line 203, in result
raise self._exception.with_traceback(self._exception_tb)
File "C:\Python311\Lib\asyncio\tasks.py", line 267, in step
result = coro.send(None)
^^^^^^^^^^^^^^^
File "E:\her_clone\env\Lib\site-packages\testzeus_hercules_main.py", line 252, in a_main
await sequential_process()
File "E:\her_clone\env\Lib\site-packages\testzeus_hercules_main.py", line 67, in sequential_process
await runner.start()
File "E:\her_clone\env\Lib\site-packages\testzeus_hercules\core\runner.py", line 222, in start
await self.initialize()
File "E:\her_clone\env\Lib\site-packages\testzeus_hercules\core\runner.py", line 64, in initialize
await self.browser_manager.async_initialize()
File "E:\her_clone\env\Lib\site-packages\testzeus_hercules\core\playwright_manager.py", line 267, in async_initialize
await self.ensure_browser_context()
File "E:\her_clone\env\Lib\site-packages\testzeus_hercules\core\playwright_manager.py", line 277, in ensure_browser_context
await self.create_browser_context()
File "E:\her_clone\env\Lib\site-packages\testzeus_hercules\core\playwright_manager.py", line 402, in create_browser_context
_browser = await browser_type.connect_over_cdp(endpoint_url, timeout=120000)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\her_clone\env\Lib\site-packages\playwright\async_api_generated.py", line 14779, in connect_over_cdp
await self._impl_obj.connect_over_cdp(
File "E:\her_clone\env\Lib\site-packages\playwright_impl_browser_type.py", line 174, in connect_over_cdp
response = await self._channel.send_return_as_dict("connectOverCDP", params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\her_clone\env\Lib\site-packages\playwright_impl_connection.py", line 67, in send_return_as_dict
return await self._connection.wrap_api_call(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\her_clone\env\Lib\site-packages\playwright_impl_connection.py", line 528, in wrap_api_call
raise rewrite_error(error, f"{parsed_st['apiName']}: {error}") from None
playwright._impl._errors.Error: BrowserType.connect_over_cdp: WebSocket error: connect ECONNREFUSED ::1:9222
Call log:

• ws://localhost:9222/devtools/browser/b12de40a-fc1c-4ebb-81d9-046e901f376d
• • ws://localhost:9222/devtools/browser/b12de40a-fc1c-4ebb-81d9-046e901f376d error connect ECONNREFUSED ::1:9222
• • ws://localhost:9222/devtools/browser/b12de40a-fc1c-4ebb-81d9-046e901f376d connect ECONNREFUSED ::1:9222
• • ws://localhost:9222/devtools/browser/b12de40a-fc1c-4ebb-81d9-046e901f376d code=1006 reason=

Sentry is attempting to send 2 pending events
Waiting up to 2 seconds
Press Ctrl-Break to quit

how can I resolve this error

Playwright is attempting to connect to a browser instance via the Chrome DevTools Protocol (CDP) at ws://localhost:9222 but isn’t able to establish a connection because the connection is being actively refused. In practical terms, nothing is listening on port 9222 when Playwright tries to connect, which results in the ECONNREFUSED error.

How can I resolve this

[generalrobin]

@Rafe2001 - Can you please highlight the configuration you are using? And the details like LLM/Hardware/Software versions.