Skip to content

Mitigation eval problem in some tasks like redeploy_without_PV #85

@daklqw

Description

@daklqw

Sometimes this is triggered and no evaluation result was saved

redeploy_without_pv

Traceback (most recent call last):
  File "/eval/AIOpsLab/./clients/gpt.py", line 91, in <module>
    asyncio.run(orchestrator.start_problem(max_steps=30))
  File "/usr/lib/python3.12/asyncio/runners.py", line 195, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/asyncio/base_events.py", line 691, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/eval/AIOpsLab/aiopslab/orchestrator/orchestrator.py", line 184, in start_problem
    results = self.session.problem.eval(
              ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/eval/AIOpsLab/aiopslab/orchestrator/problems/redeploy_without_pv/redeploy_without_pv.py", line 173, in eval
    for container_status in pod.status.container_statuses:
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: 'NoneType' object is not iterable
Recovering fault before exit...

user_unregistered_mongodb

Traceback (most recent call last):
  File "/eval/AIOpsLab/./clients/gpt-full.py", line 120, in <module>
    asyncio.run(orchestrator.start_problem(max_steps=30))
  File "/usr/lib/python3.12/asyncio/runners.py", line 195, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/asyncio/base_events.py", line 691, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/eval/AIOpsLab/aiopslab/orchestrator/orchestrator.py", line 184, in start_problem
    results = self.session.problem.eval(
              ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/eval/AIOpsLab/aiopslab/orchestrator/problems/storage_user_unregistered/storage_user_unregistered.py", line 182, in eval
    for container_status in pod.status.container_statuses:
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: 'NoneType' object is not iterable

revoke_auth_mongodb

Traceback (most recent call last):
  File "/eval/AIOpsLab/./clients/gpt-full.py", line 120, in <module>
    asyncio.run(orchestrator.start_problem(max_steps=30))
  File "/usr/lib/python3.12/asyncio/runners.py", line 195, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/asyncio/base_events.py", line 691, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/eval/AIOpsLab/aiopslab/orchestrator/orchestrator.py", line 184, in start_problem
    results = self.session.problem.eval(
              ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/eval/AIOpsLab/aiopslab/orchestrator/problems/revoke_auth/revoke_auth.py", line 174, in eval
    for container_status in pod.status.container_statuses:
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: 'NoneType' object is not iterable

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions