Skip to content

ci(model): validate GLM provider via real API calls and add mock unit… #1472

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Jinhaooo wants to merge 1 commit into
base: v2_dev
Choose a base branch
from
Open

ci(model): validate GLM provider via real API calls and add mock unit… #1472

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 17 additions & 0 deletions scripts/smoke_test/fixtures/glm_multimodal_input_response.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
{
"id": "2026041315321769d6829764f4495a",
"type": "chat",
"created_at": "2026-04-13 15:32:23.717",
"content": [
{
"type": "text",
"text": "这张图片展示了一棵约书亚树在夜空下的剪影。背景是繁星点点的星空，其中一颗彗星的尾巴清晰可见。远处的山峦轮廓也隐约可见，整个画面呈现出一种宁静而壮丽的自然景观。"
}
],
"usage": {
"input_tokens": 555,
"output_tokens": 55,
"time": 1.530905
},
"metadata": null
}
17 changes: 17 additions & 0 deletions scripts/smoke_test/fixtures/glm_non_streaming_response.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
{
"id": "202604131531506ae57d3662764a1c",
"type": "chat",
"created_at": "2026-04-13 15:31:56.102",
"content": [
{
"type": "text",
"text": "我是一个致力于提供丰富信息和帮助的人工智能助手。"
}
],
"usage": {
"input_tokens": 9,
"output_tokens": 12,
"time": 0.928485
},
"metadata": null
}
21 changes: 21 additions & 0 deletions scripts/smoke_test/fixtures/glm_reasoning_response.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
{
"id": "20260413153155f5346b12b84d4404",
"type": "chat",
"created_at": "2026-04-13 15:32:21.306",
"content": [
{
"type": "thinking",
"thinking": "1. **分析请求：** 用户想要计算两个整数的乘积：$12345 \\times 67890$。\n2. **确定方法：** 我可以手动计算（竖式乘法）或使用近似计算/性质来验证结果，但为了准确性，直接计算是最好的。\n3. **执行计算：**\n * $12345 \\times 67890$\n * 让我们分解一下：\n * $12345 \\times 6789 \\times 10$\n * 计算 $12345 \\times 6789$：\n * $12345 \\times 9 = 111105$\n * $12345 \\times 80 = 987600$\n * $12345 \\times 700 = 8641500$\n * $12345 \\times 6000 = 74070000$\n * 求和：\n * $111105$\n * $987600$\n * $8641500$\n * $74070000$\n * -------\n * $111105 + 987600 = 1,098,705$\n * $1,098,705 + 8,641,500 = 9,740,205$\n * $9,740,205 + 74,070,000 = 83,810,205$\n * 应用最后的乘以 10：\n * $838,102,050$\n4. **验证：**\n * $12345 \\times 67890$\n * 注意 $67890 = 6789 \\times 10$。\n * $12345 \\times 6789$ 的数字和：$1+2+3+4+5 = 15$（奇数），$6+7+8+9 = 30$（偶数）。结果应为偶数。\n * 让我们重新检查求和：\n * $5 \\times 9 = 45$（末尾是 5）\n * $5 \\times 9 + 4 + 0 = 45+4 = 49$（末尾是 9）\n * $5 \\times 8 + 4 + 7 = 40+11 = 51$（末尾是 1）\n * $5 \\times 7 + 5 + 1 = 35+6 = 41$（末尾是 1）\n * $5 \\times 6 + 4 + 1 = 30+5 = 35$（末尾是 5）\n * $...0$（末尾是 0）\n * 结果：...102050。\n * 让我们检查中间部分。\n * $12345 \\times 67890 = 838102050$。\n5. **构建输出：** 清晰地展示最终结果。"
},
{
"type": "text",
"text": "12345 × 67890 = 838102050"
}
],
"usage": {
"input_tokens": 16,
"output_tokens": 668,
"time": 21.169449
},
"metadata": null
}
307 changes: 307 additions & 0 deletions scripts/smoke_test/fixtures/glm_streaming_chunks.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,307 @@
[
{
"id": "202604131600407a1910480f4144af",
"choices": [
{
"delta": {
"content": "我是一个",
"function_call": null,
"refusal": null,
"role": "assistant",
"tool_calls": null
},
"finish_reason": null,
"index": 0,
"logprobs": null
}
],
"created": 1776067240,
"model": "glm-4-flash",
"object": "chat.completion.chunk",
"service_tier": null,
"system_fingerprint": null,
"usage": null
},
{
"id": "202604131600407a1910480f4144af",
"choices": [
{
"delta": {
"content": "专注于",
"function_call": null,
"refusal": null,
"role": "assistant",
"tool_calls": null
},
"finish_reason": null,
"index": 0,
"logprobs": null
}
],
"created": 1776067240,
"model": "glm-4-flash",
"object": "chat.completion.chunk",
"service_tier": null,
"system_fingerprint": null,
"usage": null
},
{
"id": "202604131600407a1910480f4144af",
"choices": [
{
"delta": {
"content": "提供",
"function_call": null,
"refusal": null,
"role": "assistant",
"tool_calls": null
},
"finish_reason": null,
"index": 0,
"logprobs": null
}
],
"created": 1776067240,
"model": "glm-4-flash",
"object": "chat.completion.chunk",
"service_tier": null,
"system_fingerprint": null,
"usage": null
},
{
"id": "202604131600407a1910480f4144af",
"choices": [
{
"delta": {
"content": "有帮助",
"function_call": null,
"refusal": null,
"role": "assistant",
"tool_calls": null
},
"finish_reason": null,
"index": 0,
"logprobs": null
}
],
"created": 1776067240,
"model": "glm-4-flash",
"object": "chat.completion.chunk",
"service_tier": null,
"system_fingerprint": null,
"usage": null
},
{
"id": "202604131600407a1910480f4144af",
"choices": [
{
"delta": {
"content": "、",
"function_call": null,
"refusal": null,
"role": "assistant",
"tool_calls": null
},
"finish_reason": null,
"index": 0,
"logprobs": null
}
],
"created": 1776067240,
"model": "glm-4-flash",
"object": "chat.completion.chunk",
"service_tier": null,
"system_fingerprint": null,
"usage": null
},
{
"id": "202604131600407a1910480f4144af",
"choices": [
{
"delta": {
"content": "有",
"function_call": null,
"refusal": null,
"role": "assistant",
"tool_calls": null
},
"finish_reason": null,
"index": 0,
"logprobs": null
}
],
"created": 1776067240,
"model": "glm-4-flash",
"object": "chat.completion.chunk",
"service_tier": null,
"system_fingerprint": null,
"usage": null
},
{
"id": "202604131600407a1910480f4144af",
"choices": [
{
"delta": {
"content": "创意",
"function_call": null,
"refusal": null,
"role": "assistant",
"tool_calls": null
},
"finish_reason": null,
"index": 0,
"logprobs": null
}
],
"created": 1776067240,
"model": "glm-4-flash",
"object": "chat.completion.chunk",
"service_tier": null,
"system_fingerprint": null,
"usage": null
},
{
"id": "202604131600407a1910480f4144af",
"choices": [
{
"delta": {
"content": "回答",
"function_call": null,
"refusal": null,
"role": "assistant",
"tool_calls": null
},
"finish_reason": null,
"index": 0,
"logprobs": null
}
],
"created": 1776067240,
"model": "glm-4-flash",
"object": "chat.completion.chunk",
"service_tier": null,
"system_fingerprint": null,
"usage": null
},
{
"id": "202604131600407a1910480f4144af",
"choices": [
{
"delta": {
"content": "的人工",
"function_call": null,
"refusal": null,
"role": "assistant",
"tool_calls": null
},
"finish_reason": null,
"index": 0,
"logprobs": null
}
],
"created": 1776067240,
"model": "glm-4-flash",
"object": "chat.completion.chunk",
"service_tier": null,
"system_fingerprint": null,
"usage": null
},
{
"id": "202604131600407a1910480f4144af",
"choices": [
{
"delta": {
"content": "智能",
"function_call": null,
"refusal": null,
"role": "assistant",
"tool_calls": null
},
"finish_reason": null,
"index": 0,
"logprobs": null
}
],
"created": 1776067240,
"model": "glm-4-flash",
"object": "chat.completion.chunk",
"service_tier": null,
"system_fingerprint": null,
"usage": null
},
{
"id": "202604131600407a1910480f4144af",
"choices": [
{
"delta": {
"content": "助手",
"function_call": null,
"refusal": null,
"role": "assistant",
"tool_calls": null
},
"finish_reason": null,
"index": 0,
"logprobs": null
}
],
"created": 1776067240,
"model": "glm-4-flash",
"object": "chat.completion.chunk",
"service_tier": null,
"system_fingerprint": null,
"usage": null
},
{
"id": "202604131600407a1910480f4144af",
"choices": [
{
"delta": {
"content": "。",
"function_call": null,
"refusal": null,
"role": "assistant",
"tool_calls": null
},
"finish_reason": null,
"index": 0,
"logprobs": null
}
],
"created": 1776067240,
"model": "glm-4-flash",
"object": "chat.completion.chunk",
"service_tier": null,
"system_fingerprint": null,
"usage": null
},
{
"id": "202604131600407a1910480f4144af",
"choices": [
{
"delta": {
"content": "",
"function_call": null,
"refusal": null,
"role": "assistant",
"tool_calls": null
},
"finish_reason": "stop",
"index": 0,
"logprobs": null
}
],
"created": 1776067240,
"model": "glm-4-flash",
"object": "chat.completion.chunk",
"service_tier": null,
"system_fingerprint": null,
"usage": {
"completion_tokens": 14,
"prompt_tokens": 9,
"total_tokens": 23,
"completion_tokens_details": null,
"prompt_tokens_details": null
}
}
]
17 changes: 17 additions & 0 deletions scripts/smoke_test/fixtures/glm_streaming_response.json
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
{
"id": "202604131600407a1910480f4144af",
"type": "chat",
"created_at": "2026-04-13 16:00:46.479",
"content": [
{
"type": "text",
"text": "我是一个专注于提供有帮助、有创意回答的人工智能助手。"
}
],
"usage": {
"input_tokens": 9,
"output_tokens": 14,
"time": 1.214836
},
"metadata": null
}
Loading