thalesdoc_en_all recipe is failing

[kelson42]

At https://farm.openzim.org/recipes/thalesdoc_en_all

Debug log is:

Traceback (most recent call last):
  File "/usr/bin/zimit", line 8, in <module>
    sys.exit(zimit.zimit())
             ~~~~~~~~~~~^^
  File "/app/zimit/lib/python3.13/site-packages/zimit/zimit.py", line 1247, in zimit
    sys.exit(run(sys.argv[1:]))
             ~~~^^^^^^^^^^^^^^
  File "/app/zimit/lib/python3.13/site-packages/zimit/zimit.py", line 1017, in run
    download_file(warc_location, warc_file)
    ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/app/zimit/lib/python3.13/site-packages/zimit/utils.py", line 11, in download_file
    resp.raise_for_status()
    ~~~~~~~~~~~~~~~~~~~~~^^
  File "/app/zimit/lib/python3.13/site-packages/requests/models.py", line 1024, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://s3.us-west-1.wasabisys.com/org-kiwix-zimfarm-artifacts/fc9d98c4-af97-496b-9c39-0756ab346813_zimit.tar

Strongly suspect this is bound to the lack of artefact, but then the handling would be buggy.

[benoit74]

Which handling is buggy? Currently there is nothing in the Zimfarm automatically adding / removing schedule configuration flags. There is just a functionality to store artifacts (and report URL) at the end of a task. This is a dev option which needs "special care" to work appropriately.

Simply remove the warcs setting and error will be gone.

[kelson42]

Here is why I says it is buggy:

• I have no clue of this URL, where it comes from, when this is deleted, etc... Actually I see no reason why the user should deal with it
• If this is a recipe of Zimit, it should be checked in the UI
• If this is a parameter of the scraper, it should be checked at start and a proper error should be generated if NOK
• Exception display (with full backlog) can be helpful... but this is not proper error handling

Here we have a fullstack of weakness. I will move the issue to the ZIMfarm.