Added litellm model config options and improved _prepare_max_new_tokens
#3373
| Job | Run time |
|---|---|
| 2m 50s | |
| 2m 50s |
_prepare_max_new_tokens
#3373
| Job | Run time |
|---|---|
| 2m 50s | |
| 2m 50s |