❗BEFORE YOU BEGIN❗
Are you on discord? 🤗 We'd love to have you asking questions on discord instead: https://discord.com/invite/a3K9c8GRGt
Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
I noticed that the current evaluation system doesn't provide a mechanism for timeout handling, and in practice, retrying LLM reasoning indefinitely isn't robust in production
Adding a configurable maximum number of attempts or a maximum timeout to the retry decorator should be better.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
❗BEFORE YOU BEGIN❗
Are you on discord? 🤗 We'd love to have you asking questions on discord instead: https://discord.com/invite/a3K9c8GRGt
Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
Describe the solution you'd like
I noticed that the current evaluation system doesn't provide a mechanism for timeout handling, and in practice, retrying LLM reasoning indefinitely isn't robust in production
Adding a configurable maximum number of attempts or a maximum timeout to the retry decorator should be better.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.