fix: DIA-1910: Modify retry policy to speed up inference

[hakan458]

No description provided.

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 25.00000% with 78 lines in your changes missing coverage. Please review.

Project coverage is 65.49%. Comparing base (4ada863) to head (a063360).
Report is 4 commits behind head on master.

Files with missing lines	Patch %	Lines
adala/utils/model_info_utils.py	19.44%	58 Missing ⚠️
adala/runtimes/_litellm.py	36.66%	19 Missing ⚠️
server/app.py	0.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master     #350      +/-   ##
==========================================
- Coverage   65.97%   65.49%   -0.49%     
==========================================
  Files          48       49       +1     
  Lines        2713     2739      +26     
==========================================
+ Hits         1790     1794       +4     
- Misses        923      945      +22     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.