Skip to content

[fix](iceberg)Use the correct schema for query #48838

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 4 commits into from
Closed

[fix](iceberg)Use the correct schema for query #48838

wants to merge 4 commits into from

Conversation

wuwenchi
Copy link
Contributor

@wuwenchi wuwenchi commented Mar 9, 2025 •
edited
Loading

What problem does this PR solve?

Problem Summary:

When a snapshot is specified in the query, the corresponding schema should be used for parsing, otherwise the latest snapshot should be used for parsing.

  1. When using the HMS type, you also need to initialize the executor pool.
  2. Set the size of the thread pool to be equal to the number of cores of the current machine.
  3. When no snapshot is specified, the latest schema is used.
  4. When specifying a snapshot, you need to use the schema corresponding to the snapshot.
  5. When generating a scannode, save the schema information and no longer obtain it from the cache to prevent the cache from being refreshed.
  6. Add the latest schemaid in IcebergSnapshotCacheValue, because the same snapshot may be read with two different schemas.
  7. When refreshing the schema, you need to refresh all schemas of related tables.

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@wuwenchi wuwenchi marked this pull request as draft March 9, 2025 03:43
@wuwenchi
Copy link
Contributor Author

wuwenchi commented Mar 9, 2025

run buildall

@wuwenchi
Copy link
Contributor Author

wuwenchi commented Mar 9, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32443 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e6c3e306ff73553cd070f918d395bf816bc4337c, data reload: false

------ Round 1 ----------------------------------
q1	17595	5200	5089	5089
q2	2041	290	173	173
q3	10446	1283	711	711
q4	10287	1070	545	545
q5	8684	2332	2355	2332
q6	215	168	136	136
q7	913	759	603	603
q8	9312	1283	1089	1089
q9	4988	4825	4747	4747
q10	6798	2321	1886	1886
q11	468	280	261	261
q12	350	348	214	214
q13	17764	3702	3075	3075
q14	227	221	204	204
q15	544	503	498	498
q16	645	632	585	585
q17	589	861	346	346
q18	7036	6608	6274	6274
q19	1272	946	560	560
q20	323	330	193	193
q21	2877	2146	1953	1953
q22	1046	1016	969	969
Total cold run time: 104420 ms
Total hot run time: 32443 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5156	5134	5149	5134
q2	237	329	238	238
q3	2168	2704	2296	2296
q4	1453	1821	1417	1417
q5	4277	4105	4186	4105
q6	213	160	125	125
q7	1973	1970	1774	1774
q8	2659	2612	2581	2581
q9	7157	7181	7170	7170
q10	3009	3185	2747	2747
q11	582	514	504	504
q12	690	809	592	592
q13	3471	3816	3304	3304
q14	273	294	291	291
q15	540	507	499	499
q16	630	695	642	642
q17	1132	1562	1335	1335
q18	7828	7766	7483	7483
q19	865	835	875	835
q20	1956	2016	1855	1855
q21	5590	5024	4705	4705
q22	1096	1004	972	972
Total cold run time: 52955 ms
Total hot run time: 50604 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186224 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e6c3e306ff73553cd070f918d395bf816bc4337c, data reload: false

query1	965	378	399	378
query2	6528	1918	1898	1898
query3	6796	226	216	216
query4	26428	23544	23415	23415
query5	4312	641	474	474
query6	296	191	186	186
query7	4595	512	294	294
query8	300	244	248	244
query9	8598	2578	2541	2541
query10	483	334	261	261
query11	15820	15092	14910	14910
query12	162	111	109	109
query13	1660	546	412	412
query14	9688	6432	6456	6432
query15	211	195	173	173
query16	7235	607	462	462
query17	1224	736	567	567
query18	1960	418	307	307
query19	198	205	165	165
query20	120	118	114	114
query21	212	122	106	106
query22	4293	4429	4096	4096
query23	34038	33246	33269	33246
query24	7792	2393	2474	2393
query25	577	445	390	390
query26	1229	271	161	161
query27	2206	489	331	331
query28	4011	2441	2377	2377
query29	758	560	427	427
query30	280	212	194	194
query31	962	844	786	786
query32	78	65	64	64
query33	555	357	302	302
query34	795	870	503	503
query35	805	819	748	748
query36	959	976	880	880
query37	120	100	77	77
query38	4183	4151	4114	4114
query39	1463	1410	1373	1373
query40	225	116	108	108
query41	69	53	52	52
query42	118	105	108	105
query43	486	512	485	485
query44	1337	817	794	794
query45	176	171	163	163
query46	852	1049	647	647
query47	1749	1818	1690	1690
query48	376	423	293	293
query49	788	494	416	416
query50	695	742	418	418
query51	4199	4197	4195	4195
query52	104	105	96	96
query53	231	263	190	190
query54	488	492	419	419
query55	85	80	83	80
query56	314	282	260	260
query57	1111	1099	1056	1056
query58	254	237	237	237
query59	2583	2704	2468	2468
query60	277	262	253	253
query61	119	116	138	116
query62	813	760	679	679
query63	247	194	197	194
query64	4417	998	671	671
query65	4411	4373	4342	4342
query66	1134	409	299	299
query67	15752	15472	15488	15472
query68	8041	880	521	521
query69	468	296	275	275
query70	1215	1149	1030	1030
query71	481	294	277	277
query72	5593	3576	3760	3576
query73	757	734	348	348
query74	9016	9205	9027	9027
query75	3785	3214	2765	2765
query76	3700	1178	760	760
query77	785	376	295	295
query78	9996	10035	9403	9403
query79	2806	827	588	588
query80	632	521	448	448
query81	492	261	220	220
query82	683	128	99	99
query83	183	181	164	164
query84	241	101	72	72
query85	781	356	305	305
query86	381	304	275	275
query87	4629	4624	4337	4337
query88	3892	2233	2257	2233
query89	389	319	291	291
query90	1860	230	223	223
query91	140	144	111	111
query92	76	62	58	58
query93	2021	1068	588	588
query94	660	425	308	308
query95	363	275	266	266
query96	483	605	278	278
query97	3290	3454	3302	3302
query98	239	205	202	202
query99	1375	1386	1255	1255
Total cold run time: 275758 ms
Total hot run time: 186224 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.66 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e6c3e306ff73553cd070f918d395bf816bc4337c, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.04	0.03
query3	0.24	0.07	0.06
query4	1.62	0.10	0.11
query5	0.58	0.55	0.56
query6	1.18	0.72	0.71
query7	0.03	0.02	0.02
query8	0.04	0.03	0.03
query9	0.59	0.51	0.51
query10	0.56	0.62	0.58
query11	0.15	0.11	0.10
query12	0.14	0.11	0.11
query13	0.63	0.61	0.60
query14	2.68	2.67	2.82
query15	0.93	0.86	0.86
query16	0.38	0.38	0.38
query17	1.03	1.00	1.04
query18	0.21	0.20	0.20
query19	1.97	1.81	1.97
query20	0.02	0.01	0.01
query21	15.36	0.94	0.54
query22	0.77	1.27	0.65
query23	14.86	1.37	0.67
query24	6.42	1.73	1.79
query25	0.51	0.32	0.07
query26	0.55	0.15	0.15
query27	0.05	0.05	0.05
query28	10.11	0.81	0.42
query29	12.55	3.98	3.30
query30	0.26	0.10	0.06
query31	2.81	0.58	0.38
query32	3.23	0.55	0.46
query33	2.96	2.99	3.09
query34	15.70	5.11	4.51
query35	4.50	4.52	4.51
query36	0.66	0.49	0.48
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.13	0.14
query41	0.07	0.03	0.03
query42	0.03	0.02	0.03
query43	0.03	0.03	0.03
Total cold run time: 104.85 s
Total hot run time: 31.66 s

@wuwenchi
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32602 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9bfeb960e9e9402d2256cd37229d0e2c63f200de, data reload: false

------ Round 1 ----------------------------------
q1	17604	5256	5113	5113
q2	2043	295	163	163
q3	10418	1287	712	712
q4	10212	1019	548	548
q5	7555	2391	2345	2345
q6	196	163	131	131
q7	929	761	599	599
q8	9300	1271	1156	1156
q9	4931	4868	4956	4868
q10	6842	2289	1922	1922
q11	453	268	261	261
q12	342	350	210	210
q13	17766	3696	3108	3108
q14	222	226	218	218
q15	527	475	470	470
q16	629	610	581	581
q17	556	870	336	336
q18	6850	6502	6242	6242
q19	1210	927	540	540
q20	316	326	198	198
q21	2736	2147	1889	1889
q22	1042	1018	992	992
Total cold run time: 102679 ms
Total hot run time: 32602 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5154	5120	5162	5120
q2	237	324	236	236
q3	2152	2653	2287	2287
q4	1466	1815	1378	1378
q5	4265	4132	4126	4126
q6	210	166	123	123
q7	1859	1909	1776	1776
q8	2600	2634	2581	2581
q9	7233	7070	7150	7070
q10	2974	3191	2734	2734
q11	585	504	499	499
q12	680	798	623	623
q13	3454	3973	3221	3221
q14	275	294	267	267
q15	526	473	465	465
q16	652	696	648	648
q17	1153	1580	1341	1341
q18	7725	7684	7465	7465
q19	800	828	896	828
q20	1959	2036	1929	1929
q21	5420	5008	4835	4835
q22	1080	1090	1016	1016
Total cold run time: 52459 ms
Total hot run time: 50568 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185352 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9bfeb960e9e9402d2256cd37229d0e2c63f200de, data reload: false

query1	1053	388	371	371
query2	6524	1950	1958	1950
query3	6784	214	213	213
query4	26672	23229	23380	23229
query5	4307	651	483	483
query6	324	203	187	187
query7	4601	498	289	289
query8	309	248	238	238
query9	8630	2614	2600	2600
query10	497	317	265	265
query11	15758	15032	14869	14869
query12	175	115	105	105
query13	1669	524	432	432
query14	10050	6168	6773	6168
query15	209	190	171	171
query16	7638	620	446	446
query17	1322	708	567	567
query18	1985	407	308	308
query19	191	180	159	159
query20	121	115	113	113
query21	210	126	105	105
query22	4162	4427	4087	4087
query23	33989	32973	33058	32973
query24	7211	2353	2372	2353
query25	519	451	374	374
query26	1220	273	150	150
query27	2415	466	321	321
query28	4319	2449	2424	2424
query29	714	553	419	419
query30	283	216	187	187
query31	969	872	772	772
query32	70	64	65	64
query33	552	377	313	313
query34	787	829	504	504
query35	801	808	742	742
query36	972	983	888	888
query37	119	95	74	74
query38	4191	4189	4073	4073
query39	1463	1450	1403	1403
query40	218	115	104	104
query41	54	53	50	50
query42	118	105	104	104
query43	498	507	493	493
query44	1286	781	776	776
query45	181	171	163	163
query46	830	1035	614	614
query47	1770	1818	1756	1756
query48	371	414	299	299
query49	783	517	431	431
query50	684	743	399	399
query51	4173	4164	4212	4164
query52	104	98	95	95
query53	228	262	188	188
query54	485	487	407	407
query55	87	82	78	78
query56	254	249	254	249
query57	1109	1127	1077	1077
query58	252	240	237	237
query59	2861	2771	2750	2750
query60	283	300	268	268
query61	122	123	125	123
query62	820	720	650	650
query63	227	186	181	181
query64	4291	1038	672	672
query65	4418	4343	4331	4331
query66	1058	406	297	297
query67	15994	15407	15402	15402
query68	8094	884	505	505
query69	460	296	302	296
query70	1204	1133	1107	1107
query71	474	303	262	262
query72	5623	3488	3719	3488
query73	770	721	346	346
query74	8884	9165	8894	8894
query75	3796	3154	2715	2715
query76	3685	1202	770	770
query77	784	375	290	290
query78	10102	10167	9265	9265
query79	2987	817	591	591
query80	613	591	433	433
query81	494	249	223	223
query82	677	131	99	99
query83	175	171	156	156
query84	254	95	76	76
query85	789	356	311	311
query86	396	313	292	292
query87	4377	4583	4313	4313
query88	3593	2266	2266	2266
query89	396	311	291	291
query90	1856	205	212	205
query91	145	137	110	110
query92	79	59	56	56
query93	1683	1057	579	579
query94	657	381	311	311
query95	355	266	263	263
query96	477	562	277	277
query97	3404	3398	3323	3323
query98	229	207	218	207
query99	1600	1382	1285	1285
Total cold run time: 276456 ms
Total hot run time: 185352 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.34 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9bfeb960e9e9402d2256cd37229d0e2c63f200de, data reload: false

query1	0.03	0.03	0.04
query2	0.07	0.03	0.03
query3	0.22	0.07	0.07
query4	1.63	0.10	0.10
query5	0.54	0.55	0.57
query6	1.19	0.73	0.73
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.59	0.52	0.52
query10	0.58	0.60	0.59
query11	0.16	0.11	0.11
query12	0.15	0.11	0.12
query13	0.62	0.61	0.60
query14	2.80	2.69	2.70
query15	0.91	0.84	0.84
query16	0.38	0.38	0.38
query17	1.01	1.05	1.04
query18	0.21	0.19	0.19
query19	1.94	1.83	2.00
query20	0.01	0.01	0.01
query21	15.35	0.93	0.56
query22	0.78	1.17	0.69
query23	14.92	1.36	0.63
query24	6.48	2.14	1.16
query25	0.49	0.34	0.12
query26	0.57	0.16	0.14
query27	0.05	0.05	0.06
query28	9.94	0.81	0.44
query29	12.51	4.03	3.34
query30	0.26	0.08	0.07
query31	2.82	0.58	0.38
query32	3.24	0.55	0.46
query33	2.94	3.01	3.02
query34	15.69	5.14	4.53
query35	4.52	4.49	4.56
query36	0.70	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.02	0.03	0.02
query40	0.18	0.13	0.13
query41	0.08	0.03	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.02
Total cold run time: 104.86 s
Total hot run time: 31.34 s

@wuwenchi
Copy link
Contributor Author

run buildall

@wuwenchi
Copy link
Contributor Author

run buildall

@wuwenchi wuwenchi marked this pull request as ready for review March 13, 2025 03:18
@doris-robot
Copy link

TPC-H: Total hot run time: 32479 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3c84130d84ac3bce3a7f143a02512edfcf1bee83, data reload: false

------ Round 1 ----------------------------------
q1	17615	5176	5049	5049
q2	2040	289	161	161
q3	10424	1248	752	752
q4	10253	1022	525	525
q5	7835	2423	2293	2293
q6	194	162	133	133
q7	904	748	601	601
q8	9289	1275	1114	1114
q9	4926	4788	4867	4788
q10	6840	2303	1879	1879
q11	477	282	257	257
q12	348	351	216	216
q13	17757	3653	3069	3069
q14	221	236	203	203
q15	530	488	478	478
q16	613	636	589	589
q17	587	849	351	351
q18	6914	6503	6297	6297
q19	1470	966	568	568
q20	327	325	196	196
q21	3115	2141	1963	1963
q22	1078	1039	997	997
Total cold run time: 103757 ms
Total hot run time: 32479 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5126	5142	5093	5093
q2	238	331	233	233
q3	2128	2655	2279	2279
q4	1427	1816	1423	1423
q5	4251	4319	4260	4260
q6	212	166	126	126
q7	1919	1954	1795	1795
q8	2660	2652	2565	2565
q9	7480	7365	7201	7201
q10	3046	3236	2768	2768
q11	569	513	491	491
q12	680	740	587	587
q13	3468	3926	3253	3253
q14	273	291	280	280
q15	517	482	480	480
q16	670	672	636	636
q17	1156	1589	1362	1362
q18	7773	7660	7525	7525
q19	840	805	874	805
q20	1948	2032	1906	1906
q21	5528	5074	4768	4768
q22	1141	1052	1049	1049
Total cold run time: 53050 ms
Total hot run time: 50885 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192545 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3c84130d84ac3bce3a7f143a02512edfcf1bee83, data reload: false

query1	1383	1011	987	987
query2	6189	1923	1878	1878
query3	11128	4466	4627	4466
query4	25390	23741	23296	23296
query5	4795	662	473	473
query6	303	200	200	200
query7	3989	495	289	289
query8	323	261	244	244
query9	8508	2594	2597	2594
query10	495	323	257	257
query11	15405	15129	14917	14917
query12	163	111	111	111
query13	1561	529	411	411
query14	10265	6248	6749	6248
query15	196	187	176	176
query16	7634	654	515	515
query17	1432	722	564	564
query18	2030	406	319	319
query19	208	180	153	153
query20	158	122	126	122
query21	202	124	111	111
query22	4587	4695	4693	4693
query23	34485	33674	33508	33508
query24	7469	2425	2453	2425
query25	499	482	411	411
query26	1234	279	162	162
query27	2056	505	348	348
query28	4351	2467	2429	2429
query29	687	568	438	438
query30	277	222	193	193
query31	905	869	801	801
query32	79	64	64	64
query33	536	367	366	366
query34	814	873	507	507
query35	836	843	745	745
query36	959	990	898	898
query37	125	128	75	75
query38	4241	4421	4312	4312
query39	1484	1450	1438	1438
query40	219	121	103	103
query41	53	55	50	50
query42	122	104	110	104
query43	508	515	483	483
query44	1357	798	792	792
query45	178	174	165	165
query46	854	1037	639	639
query47	1849	1879	1801	1801
query48	383	433	316	316
query49	777	516	439	439
query50	749	735	426	426
query51	4335	4370	4237	4237
query52	104	106	97	97
query53	255	272	214	214
query54	505	497	427	427
query55	83	81	83	81
query56	292	287	249	249
query57	1160	1176	1105	1105
query58	247	243	254	243
query59	2768	2646	2640	2640
query60	300	276	255	255
query61	127	162	121	121
query62	792	769	688	688
query63	234	197	197	197
query64	4022	1048	687	687
query65	4547	4486	4447	4447
query66	954	428	297	297
query67	16216	15505	15528	15505
query68	8217	869	496	496
query69	492	298	270	270
query70	1151	1107	1130	1107
query71	430	299	276	276
query72	5189	3644	3780	3644
query73	754	747	356	356
query74	8878	9117	8795	8795
query75	3387	3156	2713	2713
query76	3353	1185	769	769
query77	737	361	278	278
query78	9877	10094	9277	9277
query79	2760	816	582	582
query80	636	521	432	432
query81	479	260	216	216
query82	634	124	95	95
query83	178	170	161	161
query84	245	100	73	73
query85	780	344	303	303
query86	371	292	301	292
query87	4489	4553	4351	4351
query88	3886	2278	2259	2259
query89	425	308	278	278
query90	1906	217	235	217
query91	146	144	109	109
query92	76	58	54	54
query93	2009	1059	569	569
query94	666	409	306	306
query95	360	266	263	263
query96	493	574	277	277
query97	3313	3428	3299	3299
query98	226	209	193	193
query99	1338	1427	1283	1283
Total cold run time: 279252 ms
Total hot run time: 192545 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.82 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3c84130d84ac3bce3a7f143a02512edfcf1bee83, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.04	0.03
query3	0.24	0.06	0.06
query4	1.66	0.10	0.10
query5	0.56	0.53	0.54
query6	1.20	0.72	0.72
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.59	0.51	0.53
query10	0.60	0.60	0.58
query11	0.16	0.10	0.10
query12	0.14	0.11	0.11
query13	0.62	0.58	0.59
query14	2.66	2.69	2.84
query15	0.92	0.85	0.84
query16	0.39	0.38	0.36
query17	1.05	1.03	1.04
query18	0.21	0.20	0.20
query19	1.88	1.79	1.94
query20	0.01	0.02	0.01
query21	15.36	0.89	0.55
query22	0.75	1.20	0.69
query23	14.88	1.38	0.59
query24	7.53	1.43	0.83
query25	0.56	0.25	0.15
query26	0.49	0.15	0.13
query27	0.05	0.05	0.05
query28	9.93	0.88	0.43
query29	12.51	4.02	3.32
query30	0.24	0.08	0.06
query31	2.83	0.58	0.38
query32	3.22	0.54	0.46
query33	2.96	2.96	3.09
query34	15.74	5.12	4.52
query35	4.59	4.58	4.57
query36	0.66	0.49	0.47
query37	0.09	0.07	0.07
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.15	0.13
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.84 s
Total hot run time: 30.82 s

@hello-stephen
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32470 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cf9548e6e24bb58da94d39b9a0cbb18f60a215f7, data reload: false

------ Round 1 ----------------------------------
q1	17623	5182	5035	5035
q2	2043	294	165	165
q3	10423	1262	747	747
q4	10200	1029	542	542
q5	7533	2413	2289	2289
q6	187	160	133	133
q7	937	753	612	612
q8	9316	1276	1118	1118
q9	4806	4601	4825	4601
q10	6810	2314	1876	1876
q11	488	269	249	249
q12	347	351	217	217
q13	17822	3699	3227	3227
q14	230	223	205	205
q15	520	481	480	480
q16	652	612	582	582
q17	574	852	345	345
q18	6706	6496	6395	6395
q19	1253	950	564	564
q20	317	329	199	199
q21	2757	2146	1928	1928
q22	1042	1034	961	961
Total cold run time: 102586 ms
Total hot run time: 32470 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5122	5116	5133	5116
q2	236	322	234	234
q3	2144	2679	2266	2266
q4	1381	1796	1433	1433
q5	4181	4123	4152	4123
q6	201	168	124	124
q7	1896	1821	1756	1756
q8	2616	2625	2489	2489
q9	7151	7191	7182	7182
q10	3011	3251	2782	2782
q11	581	495	497	495
q12	734	796	656	656
q13	3384	3977	3297	3297
q14	281	291	262	262
q15	510	471	494	471
q16	637	728	635	635
q17	1180	1630	1286	1286
q18	7851	7692	7526	7526
q19	855	883	997	883
q20	1966	2041	1914	1914
q21	5403	4966	4757	4757
q22	1063	1038	1037	1037
Total cold run time: 52384 ms
Total hot run time: 50724 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192569 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cf9548e6e24bb58da94d39b9a0cbb18f60a215f7, data reload: false

query1	1379	1011	1018	1011
query2	6325	1907	1905	1905
query3	11005	4636	4511	4511
query4	56864	25752	23535	23535
query5	5072	496	478	478
query6	381	185	181	181
query7	5105	495	291	291
query8	328	247	233	233
query9	6502	2629	2653	2629
query10	457	310	255	255
query11	15310	15222	14915	14915
query12	153	113	108	108
query13	1178	531	406	406
query14	10351	6495	6845	6495
query15	202	211	193	193
query16	7091	656	498	498
query17	1090	745	577	577
query18	1553	414	324	324
query19	197	195	182	182
query20	131	125	135	125
query21	207	127	109	109
query22	4451	4657	4358	4358
query23	33927	33436	33420	33420
query24	5680	2426	2411	2411
query25	461	457	404	404
query26	700	277	163	163
query27	1698	490	336	336
query28	2964	2470	2438	2438
query29	604	602	427	427
query30	296	221	197	197
query31	870	897	796	796
query32	76	60	66	60
query33	445	369	303	303
query34	776	864	538	538
query35	791	832	776	776
query36	966	1014	921	921
query37	121	136	75	75
query38	4136	4230	4325	4230
query39	1469	1489	1445	1445
query40	205	114	103	103
query41	53	50	52	50
query42	132	112	110	110
query43	506	513	496	496
query44	1312	816	813	813
query45	179	179	167	167
query46	848	1064	670	670
query47	1844	1871	1815	1815
query48	380	434	308	308
query49	733	552	470	470
query50	713	764	423	423
query51	4304	4325	4220	4220
query52	113	108	100	100
query53	252	260	187	187
query54	484	512	432	432
query55	85	81	78	78
query56	280	287	255	255
query57	1147	1171	1130	1130
query58	248	239	238	238
query59	2612	2779	2595	2595
query60	285	276	265	265
query61	120	119	125	119
query62	758	750	684	684
query63	234	196	195	195
query64	1506	1022	691	691
query65	4508	4474	4438	4438
query66	723	408	300	300
query67	15962	15473	15221	15221
query68	7846	871	502	502
query69	537	305	259	259
query70	1229	1115	1102	1102
query71	502	305	265	265
query72	5863	3583	3747	3583
query73	1303	741	342	342
query74	9006	9041	8927	8927
query75	3702	3163	2738	2738
query76	4250	1183	757	757
query77	633	369	277	277
query78	10053	10214	9294	9294
query79	2323	882	583	583
query80	722	528	450	450
query81	492	255	215	215
query82	580	126	93	93
query83	330	169	153	153
query84	281	90	71	71
query85	798	360	307	307
query86	394	291	275	275
query87	4481	4575	4480	4480
query88	3426	2259	2308	2259
query89	406	324	274	274
query90	1958	212	209	209
query91	139	151	109	109
query92	70	65	55	55
query93	1266	1064	583	583
query94	692	415	298	298
query95	356	261	271	261
query96	495	570	276	276
query97	3384	3359	3304	3304
query98	230	207	207	207
query99	1427	1397	1229	1229
Total cold run time: 301012 ms
Total hot run time: 192569 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.37 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cf9548e6e24bb58da94d39b9a0cbb18f60a215f7, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.04	0.03
query3	0.23	0.06	0.07
query4	1.63	0.11	0.10
query5	0.56	0.55	0.54
query6	1.21	0.73	0.72
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.61	0.52	0.53
query10	0.59	0.60	0.59
query11	0.16	0.10	0.11
query12	0.14	0.11	0.11
query13	0.63	0.60	0.60
query14	2.82	2.84	2.68
query15	0.94	0.85	0.85
query16	0.36	0.39	0.38
query17	1.05	1.02	1.03
query18	0.21	0.20	0.20
query19	1.95	1.83	1.94
query20	0.02	0.02	0.01
query21	15.36	0.87	0.54
query22	0.77	1.22	0.71
query23	14.82	1.38	0.63
query24	6.98	1.88	1.12
query25	0.55	0.24	0.21
query26	0.55	0.16	0.15
query27	0.05	0.05	0.05
query28	10.25	0.79	0.42
query29	12.53	3.98	3.36
query30	0.26	0.08	0.06
query31	2.81	0.57	0.40
query32	3.23	0.54	0.46
query33	2.92	3.01	3.15
query34	15.80	5.08	4.53
query35	4.52	4.54	4.49
query36	0.68	0.50	0.49
query37	0.09	0.06	0.07
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.14	0.12
query41	0.09	0.03	0.03
query42	0.04	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.85 s
Total hot run time: 31.37 s

@wuwenchi
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32523 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9c6b3a8efbc61927a2faa9d86b9f949826a0be25, data reload: false

------ Round 1 ----------------------------------
q1	17689	5263	5083	5083
q2	2048	304	163	163
q3	10407	1344	705	705
q4	10223	1049	551	551
q5	7888	2464	2370	2370
q6	194	170	135	135
q7	938	759	615	615
q8	9295	1300	1092	1092
q9	4856	4613	4683	4613
q10	6826	2311	1879	1879
q11	467	285	261	261
q12	353	358	225	225
q13	17761	3789	3137	3137
q14	230	232	213	213
q15	538	485	483	483
q16	640	618	587	587
q17	566	888	357	357
q18	6962	6519	6371	6371
q19	1226	968	560	560
q20	322	334	207	207
q21	2932	2190	1941	1941
q22	1058	998	975	975
Total cold run time: 103419 ms
Total hot run time: 32523 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5174	5137	5143	5137
q2	245	332	239	239
q3	2204	2693	2279	2279
q4	1459	1873	1393	1393
q5	4245	4122	4244	4122
q6	211	169	126	126
q7	1911	1969	1775	1775
q8	2655	2666	2533	2533
q9	7183	7175	7215	7175
q10	2975	3220	2722	2722
q11	590	506	485	485
q12	696	790	645	645
q13	3619	3974	3343	3343
q14	278	307	277	277
q15	517	479	473	473
q16	650	695	655	655
q17	1153	1606	1367	1367
q18	7824	7598	7375	7375
q19	807	793	877	793
q20	1960	2011	1859	1859
q21	5452	5254	4974	4974
q22	1112	1062	1018	1018
Total cold run time: 52920 ms
Total hot run time: 50765 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185980 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9c6b3a8efbc61927a2faa9d86b9f949826a0be25, data reload: false

query1	994	401	378	378
query2	6510	1987	1949	1949
query3	6795	209	216	209
query4	26610	23632	23486	23486
query5	4302	652	480	480
query6	302	201	199	199
query7	4604	496	324	324
query8	298	272	245	245
query9	8638	2638	2647	2638
query10	479	309	254	254
query11	15495	15232	14972	14972
query12	163	109	110	109
query13	1661	551	408	408
query14	9125	6518	6400	6400
query15	212	190	170	170
query16	7216	634	501	501
query17	1210	726	563	563
query18	1899	403	312	312
query19	197	190	165	165
query20	120	116	117	116
query21	211	124	107	107
query22	4240	4202	4121	4121
query23	33972	32931	32924	32924
query24	8172	2397	2405	2397
query25	519	454	388	388
query26	1228	271	156	156
query27	2710	483	340	340
query28	4333	2403	2398	2398
query29	742	559	441	441
query30	287	219	188	188
query31	948	880	785	785
query32	79	72	63	63
query33	555	350	293	293
query34	786	813	518	518
query35	780	826	731	731
query36	958	1003	895	895
query37	120	94	76	76
query38	4259	4239	4241	4239
query39	1427	1381	1372	1372
query40	209	112	105	105
query41	53	50	50	50
query42	118	104	98	98
query43	505	516	478	478
query44	1339	776	783	776
query45	174	174	164	164
query46	846	1025	634	634
query47	1734	1757	1711	1711
query48	375	423	298	298
query49	788	500	411	411
query50	694	743	435	435
query51	4146	4179	4173	4173
query52	100	109	100	100
query53	252	263	188	188
query54	488	491	414	414
query55	86	81	85	81
query56	280	269	278	269
query57	1125	1132	1081	1081
query58	249	250	228	228
query59	2624	2755	2615	2615
query60	283	274	259	259
query61	119	122	116	116
query62	818	730	687	687
query63	229	200	202	200
query64	4391	1018	699	699
query65	4466	4324	4355	4324
query66	1136	418	310	310
query67	15742	15634	15271	15271
query68	8337	884	499	499
query69	483	310	261	261
query70	1175	1099	1118	1099
query71	450	311	261	261
query72	5552	3577	3905	3577
query73	804	735	352	352
query74	8967	9135	8764	8764
query75	3756	3183	2660	2660
query76	3655	1179	755	755
query77	786	379	291	291
query78	10067	10047	9286	9286
query79	2951	808	624	624
query80	646	525	458	458
query81	474	253	223	223
query82	561	127	101	101
query83	204	165	160	160
query84	291	90	76	76
query85	779	355	314	314
query86	381	295	294	294
query87	4358	4550	4403	4403
query88	3607	2220	2217	2217
query89	397	312	284	284
query90	1818	211	209	209
query91	142	142	110	110
query92	74	56	63	56
query93	2011	1054	573	573
query94	666	422	305	305
query95	353	263	256	256
query96	487	561	270	270
query97	3313	3334	3281	3281
query98	250	213	202	202
query99	1455	1395	1274	1274
Total cold run time: 275775 ms
Total hot run time: 185980 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.39 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9c6b3a8efbc61927a2faa9d86b9f949826a0be25, data reload: false

query1	0.04	0.03	0.04
query2	0.07	0.03	0.03
query3	0.24	0.06	0.07
query4	1.67	0.10	0.10
query5	0.56	0.54	0.54
query6	1.16	0.72	0.72
query7	0.03	0.01	0.02
query8	0.04	0.03	0.03
query9	0.59	0.52	0.51
query10	0.56	0.63	0.59
query11	0.15	0.11	0.10
query12	0.14	0.12	0.11
query13	0.61	0.61	0.59
query14	2.66	2.71	2.67
query15	0.91	0.85	0.84
query16	0.38	0.37	0.38
query17	1.00	1.03	1.00
query18	0.22	0.20	0.20
query19	1.87	1.79	2.00
query20	0.02	0.02	0.02
query21	15.35	0.88	0.53
query22	0.76	1.24	0.66
query23	14.93	1.37	0.60
query24	6.55	1.57	1.51
query25	0.52	0.24	0.20
query26	0.60	0.16	0.14
query27	0.05	0.05	0.05
query28	10.03	0.82	0.42
query29	12.56	3.87	3.27
query30	0.25	0.09	0.06
query31	2.81	0.59	0.37
query32	3.23	0.55	0.47
query33	3.00	3.02	3.03
query34	15.74	5.11	4.50
query35	4.53	4.58	4.48
query36	0.68	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.03	0.03
query42	0.04	0.03	0.02
query43	0.03	0.04	0.03
Total cold run time: 104.99 s
Total hot run time: 31.39 s

@wuwenchi
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32583 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e70669021b8ad55e8d936a40ae570abc5e991a04, data reload: false

------ Round 1 ----------------------------------
q1	17630	5260	5074	5074
q2	2052	294	161	161
q3	10416	1302	763	763
q4	10200	1017	536	536
q5	7549	2375	2373	2373
q6	188	167	134	134
q7	1006	751	611	611
q8	9299	1362	1097	1097
q9	5032	4595	4905	4595
q10	6799	2301	1913	1913
q11	480	275	273	273
q12	351	364	220	220
q13	17775	3714	3078	3078
q14	234	234	208	208
q15	539	494	479	479
q16	630	603	606	603
q17	605	890	352	352
q18	6910	6510	6375	6375
q19	2000	981	581	581
q20	319	316	193	193
q21	2926	2154	1971	1971
q22	1045	1007	993	993
Total cold run time: 103985 ms
Total hot run time: 32583 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5265	5156	5198	5156
q2	244	327	236	236
q3	2226	2659	2290	2290
q4	1421	1799	1356	1356
q5	4260	4132	4158	4132
q6	206	169	124	124
q7	1946	1949	1745	1745
q8	2651	2707	2636	2636
q9	7272	7293	7228	7228
q10	3018	3269	2790	2790
q11	578	512	502	502
q12	681	738	583	583
q13	3428	3983	3304	3304
q14	278	310	281	281
q15	520	472	478	472
q16	646	711	644	644
q17	1143	1631	1340	1340
q18	7768	7408	7439	7408
q19	840	813	908	813
q20	2011	2045	1925	1925
q21	5589	5039	4700	4700
q22	1095	1054	1033	1033
Total cold run time: 53086 ms
Total hot run time: 50698 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191070 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e70669021b8ad55e8d936a40ae570abc5e991a04, data reload: false

query1	1367	981	973	973
query2	6525	1943	1885	1885
query3	11106	4622	4475	4475
query4	25893	23815	22789	22789
query5	3741	628	463	463
query6	282	199	195	195
query7	3984	512	287	287
query8	309	247	232	232
query9	8489	2602	2600	2600
query10	463	303	268	268
query11	15291	15053	14894	14894
query12	168	108	103	103
query13	1576	528	404	404
query14	9466	6549	6147	6147
query15	219	184	172	172
query16	7659	636	497	497
query17	1188	705	563	563
query18	1995	412	322	322
query19	200	191	147	147
query20	125	121	153	121
query21	215	121	104	104
query22	4675	4669	4679	4669
query23	34391	33338	33417	33338
query24	7980	2439	2420	2420
query25	510	466	395	395
query26	1323	261	153	153
query27	2218	499	322	322
query28	4194	2446	2440	2440
query29	577	534	446	446
query30	280	223	192	192
query31	895	879	806	806
query32	73	66	59	59
query33	568	359	297	297
query34	823	860	502	502
query35	804	848	753	753
query36	1002	1019	923	923
query37	124	103	74	74
query38	4254	4164	4158	4158
query39	1532	1433	1452	1433
query40	207	117	103	103
query41	56	52	48	48
query42	113	104	104	104
query43	495	501	474	474
query44	1351	792	793	792
query45	175	170	167	167
query46	857	1069	652	652
query47	1834	1878	1820	1820
query48	396	419	313	313
query49	742	517	417	417
query50	692	751	408	408
query51	4394	4311	4228	4228
query52	106	99	99	99
query53	238	271	191	191
query54	495	497	406	406
query55	81	79	79	79
query56	278	272	261	261
query57	1140	1195	1084	1084
query58	246	258	235	235
query59	2672	2861	2743	2743
query60	284	275	290	275
query61	129	119	117	117
query62	770	738	701	701
query63	230	190	193	190
query64	4301	1018	687	687
query65	4518	4458	4459	4458
query66	983	397	297	297
query67	16465	15442	15384	15384
query68	8479	866	505	505
query69	462	299	269	269
query70	1215	1128	1140	1128
query71	459	275	264	264
query72	5132	3603	3768	3603
query73	783	742	357	357
query74	8927	8893	8806	8806
query75	3806	3191	2714	2714
query76	3681	1195	736	736
query77	775	359	276	276
query78	9858	10113	9289	9289
query79	1595	825	574	574
query80	585	519	444	444
query81	464	255	224	224
query82	187	124	93	93
query83	199	168	146	146
query84	287	90	74	74
query85	738	407	318	318
query86	324	304	280	280
query87	4457	4515	4229	4229
query88	2866	2249	2230	2230
query89	382	316	275	275
query90	2057	206	211	206
query91	136	144	110	110
query92	81	62	55	55
query93	1166	1019	583	583
query94	657	414	298	298
query95	351	260	252	252
query96	492	566	275	275
query97	3293	3350	3252	3252
query98	221	209	205	205
query99	1408	1404	1246	1246
Total cold run time: 276255 ms
Total hot run time: 191070 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.03 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e70669021b8ad55e8d936a40ae570abc5e991a04, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.04
query3	0.24	0.06	0.06
query4	1.62	0.10	0.11
query5	0.55	0.54	0.53
query6	1.19	0.72	0.72
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.59	0.51	0.52
query10	0.56	0.59	0.58
query11	0.16	0.11	0.11
query12	0.14	0.11	0.11
query13	0.61	0.60	0.60
query14	2.79	2.82	2.67
query15	0.92	0.84	0.85
query16	0.37	0.38	0.37
query17	1.02	1.03	1.01
query18	0.21	0.20	0.19
query19	1.89	1.78	2.02
query20	0.01	0.01	0.01
query21	15.39	0.95	0.55
query22	0.78	1.15	0.76
query23	14.86	1.37	0.63
query24	7.21	1.41	1.00
query25	0.51	0.37	0.06
query26	0.61	0.15	0.13
query27	0.06	0.05	0.05
query28	9.56	0.85	0.42
query29	12.60	4.01	3.36
query30	0.25	0.09	0.06
query31	2.84	0.58	0.40
query32	3.23	0.54	0.45
query33	3.05	3.02	3.02
query34	15.68	5.14	4.52
query35	4.58	4.52	4.52
query36	0.67	0.50	0.48
query37	0.09	0.06	0.06
query38	0.06	0.04	0.04
query39	0.04	0.03	0.02
query40	0.17	0.14	0.13
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.4 s
Total hot run time: 31.03 s

@wuwenchi
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32616 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b4936e396d347d068fbdc65a12d08be1a703cb0f, data reload: false

------ Round 1 ----------------------------------
q1	17595	5252	5063	5063
q2	2050	305	169	169
q3	10403	1291	729	729
q4	10219	1029	529	529
q5	7522	2339	2375	2339
q6	184	159	131	131
q7	916	742	606	606
q8	9308	1376	1163	1163
q9	4916	4633	4685	4633
q10	6801	2317	1926	1926
q11	477	277	278	277
q12	357	358	219	219
q13	17769	3699	3137	3137
q14	227	232	205	205
q15	549	483	490	483
q16	623	619	600	600
q17	587	863	341	341
q18	6771	6409	6444	6409
q19	1882	973	556	556
q20	316	325	196	196
q21	2857	2150	1921	1921
q22	1042	1028	984	984
Total cold run time: 103371 ms
Total hot run time: 32616 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5228	5118	5128	5118
q2	234	331	228	228
q3	2169	2655	2306	2306
q4	1411	1798	1393	1393
q5	4225	4149	4194	4149
q6	202	165	124	124
q7	1865	1895	1777	1777
q8	2619	2594	2593	2593
q9	7295	7312	7170	7170
q10	3002	3218	2764	2764
q11	570	499	494	494
q12	698	772	610	610
q13	3364	3944	3307	3307
q14	274	297	277	277
q15	516	510	477	477
q16	637	681	658	658
q17	1147	1596	1366	1366
q18	7823	7582	7515	7515
q19	841	825	922	825
q20	2000	2010	1884	1884
q21	5505	4944	4785	4785
q22	1064	1072	1025	1025
Total cold run time: 52689 ms
Total hot run time: 50845 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191621 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b4936e396d347d068fbdc65a12d08be1a703cb0f, data reload: false

query1	1389	996	979	979
query2	6214	1937	1890	1890
query3	10987	4457	4380	4380
query4	53765	26240	23152	23152
query5	5038	555	492	492
query6	329	208	196	196
query7	4865	497	293	293
query8	308	244	231	231
query9	5335	2603	2619	2603
query10	439	309	253	253
query11	15138	15099	14873	14873
query12	154	111	114	111
query13	1044	539	422	422
query14	10201	6383	6237	6237
query15	221	197	179	179
query16	7105	684	517	517
query17	1064	716	550	550
query18	1551	412	312	312
query19	205	183	160	160
query20	132	125	115	115
query21	200	128	108	108
query22	4582	4610	4290	4290
query23	34479	33386	33423	33386
query24	6590	2386	2430	2386
query25	463	480	406	406
query26	707	278	155	155
query27	2255	504	336	336
query28	3267	2477	2519	2477
query29	587	558	430	430
query30	280	222	191	191
query31	861	886	781	781
query32	73	63	61	61
query33	445	362	303	303
query34	763	850	499	499
query35	781	823	731	731
query36	957	992	895	895
query37	122	102	74	74
query38	4275	4327	4272	4272
query39	1508	1407	1467	1407
query40	211	122	106	106
query41	52	60	52	52
query42	123	107	117	107
query43	498	508	478	478
query44	1301	814	794	794
query45	178	177	168	168
query46	864	1057	642	642
query47	1862	1886	1817	1817
query48	388	427	312	312
query49	700	490	425	425
query50	724	752	426	426
query51	4260	4270	4258	4258
query52	109	104	92	92
query53	233	264	196	196
query54	485	499	414	414
query55	83	85	82	82
query56	261	264	268	264
query57	1160	1171	1112	1112
query58	247	237	244	237
query59	2617	2957	2677	2677
query60	285	312	267	267
query61	162	149	144	144
query62	754	745	694	694
query63	245	190	196	190
query64	2016	1170	835	835
query65	4592	4438	4382	4382
query66	797	390	297	297
query67	15741	15699	15243	15243
query68	7608	824	502	502
query69	523	300	253	253
query70	1206	1132	1106	1106
query71	486	296	270	270
query72	6013	3564	3823	3564
query73	1516	739	348	348
query74	9309	9088	9119	9088
query75	3740	3162	2723	2723
query76	4232	1194	753	753
query77	599	342	280	280
query78	10073	10154	9230	9230
query79	2535	836	586	586
query80	739	522	439	439
query81	488	261	227	227
query82	455	127	96	96
query83	294	163	160	160
query84	293	91	78	78
query85	790	354	313	313
query86	383	304	291	291
query87	4436	4384	4547	4384
query88	3582	2312	2225	2225
query89	406	317	277	277
query90	1776	207	205	205
query91	140	137	111	111
query92	78	56	60	56
query93	1934	1065	573	573
query94	666	421	296	296
query95	351	267	261	261
query96	484	562	274	274
query97	3312	3385	3326	3326
query98	227	213	205	205
query99	1425	1382	1277	1277
Total cold run time: 299726 ms
Total hot run time: 191621 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.15 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b4936e396d347d068fbdc65a12d08be1a703cb0f, data reload: false

query1	0.04	0.04	0.04
query2	0.06	0.04	0.03
query3	0.24	0.06	0.06
query4	1.62	0.11	0.10
query5	0.56	0.56	0.54
query6	1.19	0.72	0.73
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.58	0.52	0.51
query10	0.57	0.60	0.58
query11	0.16	0.12	0.10
query12	0.14	0.11	0.12
query13	0.61	0.61	0.59
query14	2.68	2.72	2.73
query15	0.92	0.85	0.84
query16	0.37	0.39	0.38
query17	1.04	1.05	1.05
query18	0.20	0.20	0.20
query19	1.98	1.96	1.81
query20	0.01	0.01	0.01
query21	15.35	0.94	0.55
query22	0.74	1.22	0.70
query23	14.91	1.40	0.62
query24	6.76	2.31	1.06
query25	0.48	0.18	0.15
query26	0.68	0.16	0.13
query27	0.06	0.06	0.05
query28	9.40	0.81	0.42
query29	12.52	3.95	3.29
query30	0.25	0.09	0.06
query31	2.83	0.56	0.39
query32	3.23	0.54	0.47
query33	3.07	3.06	3.00
query34	15.68	5.11	4.51
query35	4.53	4.55	4.51
query36	0.67	0.48	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.13	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 104.67 s
Total hot run time: 31.15 s

@wuwenchi
Copy link
Contributor Author

run compile

@wuwenchi
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34035 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d4ab382a4b4f74ebc9542e2abb6bbbf1c57ffebd, data reload: false

------ Round 1 ----------------------------------
q1	24328	5144	4977	4977
q2	2042	338	204	204
q3	10332	1230	666	666
q4	10225	1007	510	510
q5	7514	2396	2286	2286
q6	186	160	128	128
q7	901	738	622	622
q8	9297	1276	1084	1084
q9	6806	5149	5137	5137
q10	6817	2306	1862	1862
q11	463	263	254	254
q12	342	348	216	216
q13	17775	3634	3065	3065
q14	237	233	215	215
q15	519	484	480	480
q16	630	603	557	557
q17	571	845	349	349
q18	7483	7281	7239	7239
q19	1296	966	537	537
q20	316	325	200	200
q21	3961	3362	2481	2481
q22	1034	1018	966	966
Total cold run time: 113075 ms
Total hot run time: 34035 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5144	5082	5097	5082
q2	238	338	227	227
q3	2141	2626	2228	2228
q4	1412	1803	1411	1411
q5	4407	4400	4430	4400
q6	251	169	126	126
q7	2008	1934	1799	1799
q8	2579	2571	2609	2571
q9	7298	7283	7041	7041
q10	3049	3220	2769	2769
q11	577	521	491	491
q12	690	736	617	617
q13	3486	3898	3253	3253
q14	300	302	275	275
q15	546	487	495	487
q16	655	693	631	631
q17	1163	1585	1340	1340
q18	7696	7644	7439	7439
q19	797	765	855	765
q20	2013	1962	1804	1804
q21	5443	5072	5029	5029
q22	1136	1077	1029	1029
Total cold run time: 53029 ms
Total hot run time: 50814 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 194670 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d4ab382a4b4f74ebc9542e2abb6bbbf1c57ffebd, data reload: false

query1	1407	1106	1035	1035
query2	6191	1975	1975	1975
query3	11039	4541	4596	4541
query4	26552	24082	23300	23300
query5	4844	662	497	497
query6	311	209	205	205
query7	4005	499	271	271
query8	341	250	237	237
query9	8532	2565	2558	2558
query10	468	300	265	265
query11	15796	15187	15008	15008
query12	163	116	101	101
query13	1552	515	382	382
query14	9945	6136	7838	6136
query15	206	191	170	170
query16	7673	659	453	453
query17	1073	755	580	580
query18	2091	425	338	338
query19	238	198	159	159
query20	130	132	125	125
query21	205	126	108	108
query22	4794	4915	4617	4617
query23	34363	33478	33245	33245
query24	7711	2384	2435	2384
query25	497	477	408	408
query26	1206	265	147	147
query27	2154	523	342	342
query28	4250	2413	2401	2401
query29	708	572	443	443
query30	295	227	199	199
query31	931	879	805	805
query32	69	66	64	64
query33	537	386	323	323
query34	805	915	520	520
query35	832	862	741	741
query36	1006	1030	926	926
query37	118	100	78	78
query38	4189	4274	4406	4274
query39	1534	1461	1454	1454
query40	218	117	104	104
query41	54	53	52	52
query42	118	101	105	101
query43	504	517	507	507
query44	1328	807	806	806
query45	183	190	173	173
query46	854	1029	642	642
query47	1897	1896	1867	1867
query48	388	426	321	321
query49	824	511	425	425
query50	698	748	411	411
query51	4395	4319	4309	4309
query52	110	105	97	97
query53	230	251	182	182
query54	498	511	435	435
query55	85	82	85	82
query56	272	281	273	273
query57	1206	1194	1136	1136
query58	261	248	257	248
query59	2662	2908	2856	2856
query60	304	302	269	269
query61	138	150	128	128
query62	793	729	718	718
query63	231	188	184	184
query64	4212	1128	797	797
query65	4693	4523	4558	4523
query66	1006	406	308	308
query67	16338	15554	15253	15253
query68	8984	891	490	490
query69	489	313	268	268
query70	1168	1136	1108	1108
query71	480	290	266	266
query72	5760	5280	5252	5252
query73	746	688	348	348
query74	9166	9397	8945	8945
query75	4200	3278	2763	2763
query76	3776	1208	760	760
query77	778	361	321	321
query78	10497	10693	9585	9585
query79	2821	841	560	560
query80	726	534	438	438
query81	478	265	232	232
query82	675	131	101	101
query83	199	169	160	160
query84	279	101	71	71
query85	779	344	309	309
query86	338	298	283	283
query87	4574	4461	4366	4366
query88	2921	2258	2241	2241
query89	426	312	275	275
query90	1975	212	248	212
query91	136	143	115	115
query92	73	58	57	57
query93	1795	1072	576	576
query94	675	425	303	303
query95	351	267	252	252
query96	490	576	275	275
query97	3387	3414	3266	3266
query98	229	212	199	199
query99	1464	1445	1251	1251
Total cold run time: 284096 ms
Total hot run time: 194670 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.32 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d4ab382a4b4f74ebc9542e2abb6bbbf1c57ffebd, data reload: false

query1	0.04	0.03	0.03
query2	0.12	0.10	0.10
query3	0.25	0.19	0.19
query4	1.60	0.20	0.18
query5	0.61	0.58	0.59
query6	1.18	0.72	0.73
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.58	0.51	0.54
query10	0.58	0.56	0.56
query11	0.16	0.11	0.10
query12	0.14	0.12	0.11
query13	0.61	0.60	0.59
query14	2.67	2.69	2.70
query15	0.91	0.86	0.83
query16	0.38	0.39	0.38
query17	1.06	1.02	1.01
query18	0.22	0.20	0.20
query19	1.96	2.03	1.84
query20	0.02	0.01	0.01
query21	15.36	0.87	0.53
query22	0.77	1.20	0.62
query23	14.95	1.35	0.64
query24	6.75	1.68	1.00
query25	0.51	0.28	0.15
query26	0.56	0.16	0.13
query27	0.05	0.05	0.05
query28	9.73	0.87	0.42
query29	12.54	3.91	3.29
query30	0.25	0.09	0.06
query31	2.82	0.58	0.39
query32	3.23	0.56	0.48
query33	2.94	3.09	3.04
query34	15.74	5.12	4.50
query35	4.52	4.52	4.55
query36	0.64	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.03
query40	0.17	0.14	0.13
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 104.99 s
Total hot run time: 31.32 s

@wuwenchi wuwenchi mentioned this pull request Mar 26, 2025
Closed
16 tasks
@wuwenchi wuwenchi mentioned this pull request Apr 24, 2025
Merged
16 tasks
@wuwenchi wuwenchi closed this Apr 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@wuwenchi @hello-stephen @doris-robot