Skip to content

Commit 2c5b14b

Browse files
darkwulexburner
andauthored
FIX ISSUE:The parameter max_tokens specified in the request are not valid: max_tokens and max_completion_tokens cannot be set at the same time;Refactor maxTokens assignment in AbstractLlmService (#177)
在依赖的agentscope中OpenAIChatFormatter.java第107-110行,代码同时将maxTokens设置到了OpenAIRequest的maxCompletionTokens和maxTokens两个字段中,这导致了API返回400错误,因为这两个参数是互斥的。根据OpenAI API文档,max_completion_tokens是较新的参数,用于替代max_tokens,所以应该只设置其中一个。 Co-authored-by: daofeng <xujingfeng95@gmail.com>
1 parent 8b67c1d commit 2c5b14b

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

himarket-server/src/main/java/com/alibaba/himarket/service/hichat/service/AbstractLlmService.java

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -176,7 +176,7 @@ protected ModelFeature getOrDefaultModelFeature(ProductResult product) {
176176

177177
return ModelFeature.builder()
178178
.model(modelFeature.getModel())
179-
.maxTokens(ObjectUtil.defaultIfNull(modelFeature.getMaxTokens(), 5000))
179+
.maxTokens(modelFeature.getMaxTokens())
180180
.temperature(ObjectUtil.defaultIfNull(modelFeature.getTemperature(), 0.9))
181181
.streaming(ObjectUtil.defaultIfNull(modelFeature.getStreaming(), true))
182182
.webSearch(ObjectUtil.defaultIfNull(modelFeature.getWebSearch(), false))

0 commit comments

Comments
 (0)