Allocs failed due to timeout are not marked as timed out in failure reason

[eabatalov]

There are two code paths in Server: FE termination handling and alloc outcome processing. Both need to handle the timeouts idempotently. This doesn't happen right now.

[eabatalov]

Looks like the same happens when Executor gets terminated due to autoscaling logic lag.

See https://app.datadoghq.com/logs?query=service%3Aindexify-server%20env%3Adev%20%40request_id%3AOaE2_alfuMTX1Y0_mJ2pd&agg_m=count&agg_m_source=base&agg_t=count&cols=host%2Cservice&messageDisplay=inline&refresh_mode=sliding&storage=hot&stream_sort=time%2Cdesc&viz=stream&from_ts=1764170532692&to_ts=1764184932692&live=true