Sometimes, there are failures when using the OpenRouter provider with the OpenAIChatCompletionClient.

[zhengkezhou1]

I run example-web-search-analysis code, its not 100% works with OpenRouter openai/gpt-4o model.

Is it a network problem or an issue with OpenRouter API availability?

Successful log

---------- TextMessage (user) ----------
Who was the Miami Heat player with the highest points in the 2006-2007 season, and what was the percentage change in his total rebounds between the 2007-2008 and 2008-2009 seasons?
---------- ToolCallRequestEvent (WebSearchAgent) ----------
[FunctionCall(id='call_uDkqEcqcScDKdUs5Uf3oU733', arguments='{"query": "Miami Heat highest scorer 2006-2007 season"}', name='search_web_tool'), FunctionCall(id='call_xYtHbKSsW2dSfpLkxuPmkUbr', arguments='{"query": "Miami Heat player highest scorer 2006-2007 rebounds 2007-2008 season"}', name='search_web_tool'), FunctionCall(id='call_q4vOaAXGxfaG1M2HbQyGHtj2', arguments='{"query": "Miami Heat player highest scorer 2006-2007 rebounds 2008-2009 season"}', name='search_web_tool')]
---------- ToolCallExecutionEvent (WebSearchAgent) ----------
[FunctionExecutionResult(content='Here are the total points scored by Miami Heat players in the 2006-2007 season:\n        Udonis Haslem: 844 points\n        Dwayne Wade: 1397 points\n        James Posey: 550 points\n        ...\n        ', name='search_web_tool', call_id='call_uDkqEcqcScDKdUs5Uf3oU733', is_error=False), FunctionExecutionResult(content='Here are the total points scored by Miami Heat players in the 2006-2007 season:\n        Udonis Haslem: 844 points\n        Dwayne Wade: 1397 points\n        James Posey: 550 points\n        ...\n        ', name='search_web_tool', call_id='call_xYtHbKSsW2dSfpLkxuPmkUbr', is_error=False), FunctionExecutionResult(content='Here are the total points scored by Miami Heat players in the 2006-2007 season:\n        Udonis Haslem: 844 points\n        Dwayne Wade: 1397 points\n        James Posey: 550 points\n        ...\n        ', name='search_web_tool', call_id='call_q4vOaAXGxfaG1M2HbQyGHtj2', is_error=False)]
---------- ToolCallSummaryMessage (WebSearchAgent) ----------
Here are the total points scored by Miami Heat players in the 2006-2007 season:
        Udonis Haslem: 844 points
        Dwayne Wade: 1397 points
        James Posey: 550 points
        ...

Here are the total points scored by Miami Heat players in the 2006-2007 season:
        Udonis Haslem: 844 points
        Dwayne Wade: 1397 points
        James Posey: 550 points
        ...

Here are the total points scored by Miami Heat players in the 2006-2007 season:
        Udonis Haslem: 844 points
        Dwayne Wade: 1397 points
        James Posey: 550 points
        ...

---------- ThoughtEvent (WebSearchAgent) ----------
The Miami Heat player with the highest points in the 2006-2007 season was Dwyane Wade, with 1,397 points. Let's find the percentage change in his total rebounds between the 2007-2008 and 2008-2009 seasons.
---------- ToolCallRequestEvent (WebSearchAgent) ----------
[FunctionCall(id='call_9vQcLP0tVq2NRW03g5d2IOSK', arguments='{"query": "Dwyane Wade total rebounds 2007-2008 season"}', name='search_web_tool'), FunctionCall(id='call_Rmic5wKpAJYEBAbquKkqvQ8m', arguments='{"query": "Dwyane Wade total rebounds 2008-2009 season"}', name='search_web_tool')]
---------- ToolCallExecutionEvent (WebSearchAgent) ----------
[FunctionExecutionResult(content='The number of total rebounds for Dwayne Wade in the Miami Heat season 2007-2008 is 214.', name='search_web_tool', call_id='call_9vQcLP0tVq2NRW03g5d2IOSK', is_error=False), FunctionExecutionResult(content='The number of total rebounds for Dwayne Wade in the Miami Heat season 2008-2009 is 398.', name='search_web_tool', call_id='call_Rmic5wKpAJYEBAbquKkqvQ8m', is_error=False)]
---------- ToolCallSummaryMessage (WebSearchAgent) ----------
The number of total rebounds for Dwayne Wade in the Miami Heat season 2007-2008 is 214.
The number of total rebounds for Dwayne Wade in the Miami Heat season 2008-2009 is 398.
---------- ToolCallRequestEvent (DataAnalystAgent) ----------
[FunctionCall(id='call_bGuizSHoVlLB0stZOC7PnnbA', arguments='{"start":214,"end":398}', name='percentage_change_tool')]
---------- ToolCallExecutionEvent (DataAnalystAgent) ----------
[FunctionExecutionResult(content='85.98130841121495', name='percentage_change_tool', call_id='call_bGuizSHoVlLB0stZOC7PnnbA', is_error=False)]
---------- ToolCallSummaryMessage (DataAnalystAgent) ----------
85.98130841121495
---------- TextMessage (PlanningAgent) ----------
To address the user's query, let's break it down into subtasks.

1. WebSearchAgent: Confirm who had the highest points in the Miami Heat during the 2006-2007 season.
2. WebSearchAgent: Gather Dwyane Wade's total rebounds for the 2007-2008 and 2008-2009 seasons.
3. DataAnalystAgent: Calculate the percentage change in Dwyane Wade's total rebounds between the two seasons.

Once these tasks are completed, we can analyze the findings. Let's start by verifying the information about the player with the highest points in the 2006-2007 season.
---------- TextMessage (WebSearchAgent) ----------
The Miami Heat player with the highest points in the 2006-2007 season was Dwyane Wade, who scored 1,397 points. From the search, we obtained the following data regarding Dwyane Wade's total rebounds:

- 2007-2008 season: 214 total rebounds
- 2008-2009 season: 398 total rebounds

The percentage change in his total rebounds between these two seasons is approximately 85.98%.
---------- TextMessage (PlanningAgent) ----------
Here is a summary of the findings:

- The Miami Heat player with the highest points in the 2006-2007 season was Dwayne Wade, who scored a total of 1,397 points.
- Dwayne Wade's total rebounds were as follows:
  - 214 rebounds in the 2007-2008 season
  - 398 rebounds in the 2008-2009 season
- The percentage change in his total rebounds from the 2007-2008 season to the 2008-2009 season was approximately 85.98%.

If there are any further questions or tasks, feel free to ask. Otherwise, TERMINATE.

Error log

---------- TextMessage (user) ----------
Who was the Miami Heat player with the highest points in the 2006-2007 season, and what was the percentage change in his total rebounds between the 2007-2008 and 2008-2009 seasons?
---------- TextMessage (PlanningAgent) ----------
1. WebSearchAgent: Search for the Miami Heat player with the highest points in the 2006-2007 NBA season.
2. WebSearchAgent: Find the total rebounds for that player in the 2007-2008 NBA season.
3. WebSearchAgent: Find the total rebounds for the same player in the 2008-2009 NBA season.
4. DataAnalystAgent: Calculate the percentage change in total rebounds for the player between the 2007-2008 and 2008-2009 seasons.
---------- ToolCallRequestEvent (WebSearchAgent) ----------
[FunctionCall(id='call_xup1QZkxxSRkHtVrMypmCnge', arguments='{"query":"Miami Heat highest points player 2006-2007 season"}', name='search_web_tool')]
---------- ToolCallExecutionEvent (WebSearchAgent) ----------
[FunctionExecutionResult(content='Here are the total points scored by Miami Heat players in the 2006-2007 season:\n        Udonis Haslem: 844 points\n        Dwayne Wade: 1397 points\n        James Posey: 550 points\n        ...\n        ', name='search_web_tool', call_id='call_xup1QZkxxSRkHtVrMypmCnge', is_error=False)]
---------- ToolCallSummaryMessage (WebSearchAgent) ----------
Here are the total points scored by Miami Heat players in the 2006-2007 season:
        Udonis Haslem: 844 points
        Dwayne Wade: 1397 points
        James Posey: 550 points
        ...

---------- ToolCallRequestEvent (WebSearchAgent) ----------
[FunctionCall(id='call_o8dVK6NDiWCrLii8BgsWuQVX', arguments='{"query":"Dwayne Wade total rebounds 2007-2008 season"}', name='search_web_tool')]
---------- ToolCallExecutionEvent (WebSearchAgent) ----------
[FunctionExecutionResult(content='The number of total rebounds for Dwayne Wade in the Miami Heat season 2007-2008 is 214.', name='search_web_tool', call_id='call_o8dVK6NDiWCrLii8BgsWuQVX', is_error=False)]
---------- ToolCallSummaryMessage (WebSearchAgent) ----------
The number of total rebounds for Dwayne Wade in the Miami Heat season 2007-2008 is 214.
---------- ToolCallRequestEvent (WebSearchAgent) ----------
[FunctionCall(id='call_CxGifOnHgx1WSsrh7PLCYfAw', arguments='{"query":"Dwayne Wade total rebounds 2008-2009 season"}', name='search_web_tool')]
---------- ToolCallExecutionEvent (WebSearchAgent) ----------
[FunctionExecutionResult(content='The number of total rebounds for Dwayne Wade in the Miami Heat season 2008-2009 is 398.', name='search_web_tool', call_id='call_CxGifOnHgx1WSsrh7PLCYfAw', is_error=False)]
---------- ToolCallSummaryMessage (WebSearchAgent) ----------
The number of total rebounds for Dwayne Wade in the Miami Heat season 2008-2009 is 398.
/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/site-packages/autogen_agentchat/teams/_group_chat/_selector_group_chat.py:227: UserWarning: Resolved model mismatch: openai/gpt-4o != None. Model mapping in autogen_ext.models.openai may be incorrect. Set the model to None to enhance token/cost estimation and suppress this warning.
  response = await self._model_client.create(messages=select_speaker_messages)
Error processing publish message for SelectorGroupChatManager_4f38b386-7b16-4dbb-a77a-7908b26d4fe5/4f38b386-7b16-4dbb-a77a-7908b26d4fe5
Traceback (most recent call last):
  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/site-packages/autogen_core/_single_threaded_agent_runtime.py", line 533, in _on_message
    return await agent.on_message(
           ^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/site-packages/autogen_core/_base_agent.py", line 113, in on_message
    return await self.on_message_impl(message, ctx)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/site-packages/autogen_agentchat/teams/_group_chat/_sequential_routed_agent.py", line 67, in on_message_impl
    return await super().on_message_impl(message, ctx)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/site-packages/autogen_core/_routed_agent.py", line 485, in on_message_impl
    return await h(self, message, ctx)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/site-packages/autogen_core/_routed_agent.py", line 268, in wrapper
    return_value = await func(self, message, ctx)  # type: ignore
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/site-packages/autogen_agentchat/teams/_group_chat/_base_group_chat_manager.py", line 163, in handle_agent_response
    speaker_name = await speaker_name_future
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/site-packages/autogen_agentchat/teams/_group_chat/_selector_group_chat.py", line 187, in select_speaker
    agent_name = await self._select_speaker(roles, participants, history, self._max_selector_attempts)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/site-packages/autogen_agentchat/teams/_group_chat/_selector_group_chat.py", line 227, in _select_speaker
    response = await self._model_client.create(messages=select_speaker_messages)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/site-packages/autogen_ext/models/openai/_openai_client.py", line 653, in create
    choice: Union[ParsedChoice[Any], ParsedChoice[BaseModel], Choice] = result.choices[0]
                                                                        ~~~~~~~~~~~~~~^^^
TypeError: 'NoneType' object is not subscriptable
Traceback (most recent call last):
  File "/Users/zhengkezhou/workplace/autogen-test/team.py", line 117, in <module>
    asyncio.run(main())
  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/asyncio/runners.py", line 195, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/asyncio/base_events.py", line 691, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/Users/zhengkezhou/workplace/autogen-test/team.py", line 115, in main
    await Console(team.run_stream(task=task))
  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/site-packages/autogen_agentchat/ui/_console.py", line 117, in Console
    async for message in stream:
  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/site-packages/autogen_agentchat/teams/_group_chat/_base_group_chat.py", line 518, in run_stream
    raise RuntimeError(str(message.error))
RuntimeError: TypeError: 'NoneType' object is not subscriptable
Traceback:
Traceback (most recent call last):

  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/site-packages/autogen_agentchat/teams/_group_chat/_base_group_chat_manager.py", line 163, in handle_agent_response
    speaker_name = await speaker_name_future
                   ^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/site-packages/autogen_agentchat/teams/_group_chat/_selector_group_chat.py", line 187, in select_speaker
    agent_name = await self._select_speaker(roles, participants, history, self._max_selector_attempts)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/site-packages/autogen_agentchat/teams/_group_chat/_selector_group_chat.py", line 227, in _select_speaker
    response = await self._model_client.create(messages=select_speaker_messages)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/Users/zhengkezhou/miniconda3/envs/autogen/lib/python3.12/site-packages/autogen_ext/models/openai/_openai_client.py", line 653, in create
    choice: Union[ParsedChoice[Any], ParsedChoice[BaseModel], Choice] = result.choices[0]
                                                                        ~~~~~~~~~~~~~~^^^

TypeError: 'NoneType' object is not subscriptable