feat: switch to gpt5 models #92#113
Conversation
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
|
/deploy-review
|
| max_concurrent: int = Field(5, description="Maximum number of concurrent background tasks") | ||
| task_timeout: float | None = Field( | ||
| 1800.0, description="Timeout in seconds for a single background task (None to disable)" | ||
| 3600.0, description="Timeout in seconds for a single background task (None to disable)" |
There was a problem hiding this comment.
that's fix to timeouts we had during indexing
There was a problem hiding this comment.
@Fedir-Yatsenko are you okay with this? looks like it affects all background jobs, not only indexing ones
| class BaseRagState(ToolMessageState): | ||
| type: ToolTypes = ToolTypes.FILE_RAG | ||
| version: RAGVersion | ||
| version: RAGVersion = RAGVersion.DIAL |
There was a problem hiding this comment.
why do we set this default?
| default_factory=lambda: LLMModelConfig(deployment=LLMModelsEnum.GPT_4_1_MINI_2025_04_14), | ||
| default_factory=lambda: LLMModelConfig( | ||
| deployment=LLMModelsEnum.GPT_5_MINI_2025_08_07, | ||
| reasoning_effort=ReasoningEffortEnum.MINIMAL, |
There was a problem hiding this comment.
there is no none reasoning for mini
| description="LLM Model used for normalization", | ||
| default_factory=lambda: LLMModelConfig(deployment=LLMModelsEnum.GPT_4_1_MINI_2025_04_14), | ||
| default_factory=lambda: LLMModelConfig( | ||
| deployment=LLMModelsEnum.GPT_5_MINI_2025_08_07, |
| deployment=LLMModelsEnum.GPT_5_MINI_2025_08_07, | ||
| reasoning_effort=ReasoningEffortEnum.MINIMAL, | ||
| verbosity=VerbosityEnum.LOW, | ||
| temperature=1, |
There was a problem hiding this comment.
same. can try gpt-5.4-mini and none reasoning
| default_reasoning_effort: ReasoningEffortEnum | None = Field( | ||
| default=ReasoningEffortEnum.NONE, | ||
| description="Default reasoning effort for GPT-5 models (none/minimal/low/medium/high/xhigh)", | ||
| ) | ||
|
|
||
| default_verbosity: VerbosityEnum | None = Field( | ||
| default=VerbosityEnum.LOW, | ||
| description="Default verbosity for GPT-5 models (low/medium/high). None means use model default.", | ||
| ) | ||
|
|
There was a problem hiding this comment.
all changes to this whole file look stale. need to remove them
Applicable issues
Description of changes
Checklist
Reviewenvironment.By submitting this pull request, I confirm that my contribution is made under the terms of the MIT license.