Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[chore](profile) Modify profile structure #48184

Open
wants to merge 11 commits into
base: master
Choose a base branch
from
Open

[chore](profile) Modify profile structure #48184

wants to merge 11 commits into from
+1,220 −741

Conversation

zhiqiang-hhhh
Copy link
Contributor

@zhiqiang-hhhh zhiqiang-hhhh commented Feb 21, 2025 •
edited
Loading

What problem does this PR solve?

Refactor the profile format to make our profile resolvable by profile auxiliary tools.

A demo profile is here

profile_633f84758dc344d3-a2691e92b63a90e8.txt

Problem Summary:

Release note

  • Rename Execution Profile to DetailProfile
  • Add Appendix before DetailProfile
  • Move PhysicalPlan to the end of profile file.
  • Change font of profile in web-ui to 'Menlo, Monaco, 'Courier New', monospace', so that the formatting is more organized.
  • And minor change on some OPERATOR name.

Now
img_v3_02jn_af7dc1b3-6541-4e21-b7d9-3962a248d99g

After
image

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Feb 21, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

1 similar comment
@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31557 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d42e21788c08e19918cf32b36ccbe1016de64b7e, data reload: false

------ Round 1 ----------------------------------
q1	17623	5318	5077	5077
q2	2049	300	176	176
q3	10406	1334	734	734
q4	10222	1057	558	558
q5	7527	2457	2305	2305
q6	190	165	134	134
q7	925	740	603	603
q8	9310	1348	1197	1197
q9	4986	4677	4612	4612
q10	6846	2335	1887	1887
q11	487	289	259	259
q12	358	372	223	223
q13	17763	3721	3075	3075
q14	236	221	213	213
q15	534	464	450	450
q16	617	598	574	574
q17	587	870	336	336
q18	6594	6151	6214	6151
q19	1207	961	547	547
q20	316	331	198	198
q21	2911	2305	1948	1948
q22	351	331	300	300
Total cold run time: 102045 ms
Total hot run time: 31557 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5509	5107	5108	5107
q2	224	333	224	224
q3	2177	2709	2291	2291
q4	1420	1879	1399	1399
q5	4239	4158	4138	4138
q6	210	161	125	125
q7	1868	1892	1737	1737
q8	2646	2623	2580	2580
q9	7250	7075	7089	7075
q10	2990	3202	2751	2751
q11	562	523	496	496
q12	692	800	601	601
q13	3410	3982	3219	3219
q14	284	286	270	270
q15	510	472	454	454
q16	611	674	632	632
q17	1134	1587	1370	1370
q18	7463	7190	7262	7190
q19	836	874	934	874
q20	2034	2035	1915	1915
q21	5511	4991	4804	4804
q22	657	576	525	525
Total cold run time: 52237 ms
Total hot run time: 49777 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183321 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d42e21788c08e19918cf32b36ccbe1016de64b7e, data reload: false

query1	981	385	370	370
query2	6550	1848	1849	1848
query3	6795	216	207	207
query4	26341	23546	23581	23546
query5	4329	659	492	492
query6	303	191	187	187
query7	4623	517	285	285
query8	276	228	219	219
query9	8615	2556	2557	2556
query10	468	307	241	241
query11	15693	15185	14857	14857
query12	158	107	114	107
query13	1653	509	386	386
query14	9574	6482	6182	6182
query15	207	204	177	177
query16	7524	670	499	499
query17	1201	732	554	554
query18	1993	403	301	301
query19	195	187	161	161
query20	123	117	121	117
query21	214	121	102	102
query22	4240	4190	3888	3888
query23	33793	33007	33076	33007
query24	7921	2398	2438	2398
query25	539	475	416	416
query26	1248	279	157	157
query27	2570	488	347	347
query28	4277	2435	2387	2387
query29	730	570	444	444
query30	235	193	162	162
query31	952	870	817	817
query32	76	65	64	64
query33	568	356	318	318
query34	756	859	500	500
query35	786	822	728	728
query36	966	987	891	891
query37	121	94	73	73
query38	4195	4180	4238	4180
query39	1426	1405	1401	1401
query40	207	113	101	101
query41	61	52	50	50
query42	120	105	103	103
query43	509	519	468	468
query44	1281	783	785	783
query45	185	167	160	160
query46	865	1031	638	638
query47	1776	1824	1701	1701
query48	392	433	321	321
query49	783	484	437	437
query50	685	749	421	421
query51	4165	4177	4119	4119
query52	106	102	102	102
query53	223	252	181	181
query54	486	508	408	408
query55	87	77	86	77
query56	265	284	254	254
query57	1154	1129	1063	1063
query58	246	240	244	240
query59	2462	2556	2612	2556
query60	292	270	253	253
query61	118	116	123	116
query62	774	718	677	677
query63	238	190	190	190
query64	4219	1006	659	659
query65	3264	3216	3140	3140
query66	1082	406	297	297
query67	15704	15343	15260	15260
query68	7789	767	508	508
query69	463	290	270	270
query70	1230	1140	1144	1140
query71	416	303	276	276
query72	5621	3585	3630	3585
query73	720	737	351	351
query74	9142	9239	8736	8736
query75	3290	3179	2670	2670
query76	3369	1177	729	729
query77	747	375	279	279
query78	10031	10047	9381	9381
query79	2147	821	613	613
query80	602	586	448	448
query81	516	275	253	253
query82	239	129	100	100
query83	174	174	150	150
query84	241	100	73	73
query85	737	396	302	302
query86	375	306	285	285
query87	4478	4561	4399	4399
query88	4167	2208	2209	2208
query89	409	321	286	286
query90	1992	195	192	192
query91	135	139	107	107
query92	72	62	60	60
query93	1801	1002	578	578
query94	642	413	301	301
query95	361	270	255	255
query96	491	551	285	285
query97	2764	2817	2672	2672
query98	230	205	208	205
query99	1336	1380	1277	1277
Total cold run time: 271691 ms
Total hot run time: 183321 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.55 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d42e21788c08e19918cf32b36ccbe1016de64b7e, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.04
query3	0.23	0.07	0.07
query4	1.61	0.10	0.10
query5	0.40	0.43	0.39
query6	1.14	0.66	0.65
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.60	0.51	0.52
query10	0.57	0.58	0.57
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.62	0.59	0.60
query14	2.66	2.72	2.70
query15	0.90	0.85	0.84
query16	0.37	0.37	0.39
query17	1.04	1.08	1.03
query18	0.22	0.20	0.19
query19	1.85	2.00	1.83
query20	0.01	0.01	0.02
query21	15.35	0.86	0.54
query22	0.76	1.22	0.71
query23	14.84	1.31	0.61
query24	7.15	1.97	0.73
query25	0.48	0.20	0.20
query26	0.65	0.16	0.15
query27	0.05	0.05	0.05
query28	9.20	0.85	0.44
query29	12.54	3.92	3.26
query30	0.25	0.09	0.06
query31	2.81	0.58	0.38
query32	3.23	0.55	0.46
query33	2.99	2.97	3.05
query34	15.82	5.20	4.52
query35	4.57	4.49	4.56
query36	0.66	0.51	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.04	0.03	0.03
query40	0.17	0.13	0.13
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 104.53 s
Total hot run time: 30.55 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 44.50% (11751/26405)
Line Coverage: 34.00% (98226/288940)
Region Coverage: 33.09% (50330/152107)
Branch Coverage: 28.73% (25299/88052)
Coverage Report: http://coverage.selectdb-in.cc/coverage/d42e21788c08e19918cf32b36ccbe1016de64b7e_d42e21788c08e19918cf32b36ccbe1016de64b7e/report/index.html

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31391 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c355cf00b3707e11835c06663b4c91ce8b6835cb, data reload: false

------ Round 1 ----------------------------------
q1	17598	5279	5085	5085
q2	2045	309	179	179
q3	10382	1220	767	767
q4	10207	1005	521	521
q5	7538	2788	2242	2242
q6	186	160	135	135
q7	899	749	605	605
q8	9309	1306	1190	1190
q9	4796	4573	4688	4573
q10	6813	2328	1879	1879
q11	457	280	274	274
q12	352	351	219	219
q13	17752	3676	3095	3095
q14	232	224	204	204
q15	498	465	463	463
q16	644	618	585	585
q17	565	847	342	342
q18	6869	6078	6137	6078
q19	1200	950	528	528
q20	299	323	193	193
q21	2861	2116	1944	1944
q22	359	337	290	290
Total cold run time: 101861 ms
Total hot run time: 31391 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5137	5143	5081	5081
q2	229	321	233	233
q3	2138	2642	2293	2293
q4	1390	1817	1337	1337
q5	4210	4299	4138	4138
q6	211	163	123	123
q7	1842	1819	1663	1663
q8	2549	2578	2590	2578
q9	7189	7221	7340	7221
q10	3020	3292	2815	2815
q11	570	538	496	496
q12	708	807	651	651
q13	3708	3914	3494	3494
q14	306	304	276	276
q15	511	466	470	466
q16	648	682	654	654
q17	1146	1646	1339	1339
q18	7818	7668	7232	7232
q19	795	1067	1067	1067
q20	1958	2011	1842	1842
q21	5409	4962	4636	4636
q22	602	575	530	530
Total cold run time: 52094 ms
Total hot run time: 50165 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189995 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c355cf00b3707e11835c06663b4c91ce8b6835cb, data reload: false

query1	1311	958	929	929
query2	6202	1799	1843	1799
query3	11091	4766	4552	4552
query4	54289	24891	23401	23401
query5	5239	569	503	503
query6	399	194	213	194
query7	5349	516	287	287
query8	316	231	222	222
query9	6705	2555	2556	2555
query10	436	307	257	257
query11	15117	15153	14955	14955
query12	158	107	103	103
query13	1217	518	390	390
query14	10166	6671	6986	6671
query15	215	206	197	197
query16	6972	676	500	500
query17	1092	722	586	586
query18	1532	413	317	317
query19	207	214	169	169
query20	136	124	130	124
query21	208	142	109	109
query22	4264	4507	4222	4222
query23	33938	33230	33120	33120
query24	5616	2559	2417	2417
query25	446	489	407	407
query26	606	275	158	158
query27	1705	511	346	346
query28	2791	2513	2450	2450
query29	560	557	424	424
query30	209	186	162	162
query31	883	895	828	828
query32	74	65	59	59
query33	428	350	314	314
query34	734	853	529	529
query35	843	850	754	754
query36	930	978	914	914
query37	122	96	74	74
query38	4357	4423	4258	4258
query39	1471	1495	1423	1423
query40	216	118	101	101
query41	52	54	49	49
query42	130	107	110	107
query43	500	490	486	486
query44	1305	829	794	794
query45	181	167	174	167
query46	909	1074	689	689
query47	1836	1868	1763	1763
query48	402	416	319	319
query49	723	499	421	421
query50	728	768	425	425
query51	4329	4392	4216	4216
query52	109	102	98	98
query53	233	273	190	190
query54	485	496	419	419
query55	86	79	81	79
query56	275	262	255	255
query57	1170	1187	1118	1118
query58	240	237	239	237
query59	2630	2896	2735	2735
query60	286	284	264	264
query61	121	120	136	120
query62	736	745	697	697
query63	227	198	197	197
query64	1414	1036	681	681
query65	3316	3260	3162	3162
query66	817	387	351	351
query67	15852	15633	15328	15328
query68	5536	769	525	525
query69	527	297	265	265
query70	1223	1122	1113	1113
query71	430	296	273	273
query72	5877	3641	3715	3641
query73	902	743	355	355
query74	9000	9219	8675	8675
query75	3242	3158	2684	2684
query76	3879	1167	728	728
query77	541	363	278	278
query78	10120	10411	9260	9260
query79	1029	921	611	611
query80	710	546	442	442
query81	523	275	240	240
query82	427	136	96	96
query83	189	167	169	167
query84	289	88	75	75
query85	760	352	307	307
query86	363	283	274	274
query87	4590	4595	4359	4359
query88	2870	2218	2226	2218
query89	396	315	289	289
query90	1567	194	194	194
query91	136	136	113	113
query92	61	65	54	54
query93	1156	1013	568	568
query94	638	410	304	304
query95	348	271	252	252
query96	498	534	288	288
query97	2821	2836	2757	2757
query98	283	204	193	193
query99	1283	1397	1250	1250
Total cold run time: 289856 ms
Total hot run time: 189995 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.91 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c355cf00b3707e11835c06663b4c91ce8b6835cb, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.03
query3	0.24	0.06	0.07
query4	1.62	0.11	0.10
query5	0.40	0.41	0.38
query6	1.17	0.66	0.68
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.58	0.52	0.52
query10	0.58	0.59	0.57
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.62	0.61	0.60
query14	2.71	2.71	2.68
query15	0.92	0.86	0.85
query16	0.38	0.38	0.37
query17	1.05	1.02	1.02
query18	0.22	0.19	0.20
query19	1.91	1.84	2.01
query20	0.01	0.02	0.01
query21	15.39	0.89	0.54
query22	0.75	1.16	0.60
query23	15.07	1.36	0.58
query24	7.01	2.14	1.12
query25	0.50	0.14	0.19
query26	0.65	0.16	0.13
query27	0.05	0.05	0.05
query28	9.61	0.78	0.43
query29	12.55	3.97	3.30
query30	0.25	0.11	0.07
query31	2.81	0.60	0.38
query32	3.24	0.54	0.47
query33	3.01	3.01	3.02
query34	15.83	5.15	4.56
query35	4.53	4.56	4.61
query36	0.70	0.50	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.17	0.14	0.14
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.29 s
Total hot run time: 30.91 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 44.50% (11750/26405)
Line Coverage: 34.00% (98255/288945)
Region Coverage: 33.09% (50330/152113)
Branch Coverage: 28.73% (25298/88054)
Coverage Report: http://coverage.selectdb-in.cc/coverage/c355cf00b3707e11835c06663b4c91ce8b6835cb_c355cf00b3707e11835c06663b4c91ce8b6835cb/report/index.html

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

1 similar comment
@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 31237 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 25af7336f03e81a60af146dbf98c2b43d0c01085, data reload: false

------ Round 1 ----------------------------------
q1	17600	5367	5052	5052
q2	2050	309	165	165
q3	10405	1294	707	707
q4	10211	990	516	516
q5	7534	2447	2271	2271
q6	193	174	133	133
q7	906	764	607	607
q8	9293	1328	1109	1109
q9	4917	4570	4631	4570
q10	6818	2317	1882	1882
q11	494	274	263	263
q12	346	352	227	227
q13	17763	3622	3045	3045
q14	239	226	203	203
q15	516	467	456	456
q16	628	609	590	590
q17	587	856	328	328
q18	6799	6258	6140	6140
q19	1356	942	545	545
q20	305	322	195	195
q21	2746	2157	1937	1937
q22	368	324	296	296
Total cold run time: 102074 ms
Total hot run time: 31237 ms

----- Round 2, with runtime_filter_mode=off -----
workload_group			0
============================================
show table status;
Name	Engine	Version	Row_format	Rows	Avg_row_length	Data_length	Max_data_length	Index_length	Data_free	Auto_increment	Create_time	Update_time	Check_time	Collation	Checksum	Create_options	Comment
customer	Doris	NULL	NULL	15000000	92	1381653732	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:27:43	NULL	utf-8	NULL	NULL	
lineitem	Doris	NULL	NULL	600037902	33	19843441616	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:38:59	NULL	utf-8	NULL	NULL	
nation	Doris	NULL	NULL	25	138	3473	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:27:24	NULL	utf-8	NULL	NULL	
orders	Doris	NULL	NULL	150000000	42	6422171781	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL	
part	Doris	NULL	NULL	20000000	37	748811035	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:27:57	NULL	utf-8	NULL	NULL	
partsupp	Doris	NULL	NULL	80000000	56	4534120086	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:44:20	NULL	utf-8	NULL	NULL	
region	Doris	NULL	NULL	5	240	1201	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:27:24	NULL	utf-8	NULL	NULL	
revenue0	View	NULL	NULL	-1	0	0	NULL	NULL	NULL	NULL	2023-12-26 18:27:24	NULL	NULL	utf-8	NULL	NULL	
supplier	Doris	NULL	NULL	1000000	87	87519212	NULL	NULL	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:27:25	NULL	utf-8	NULL	NULL	
============================================
q1	5105	5505	5101	5101
q2	238	337	231	231
q3	2142	2641	2259	2259
q4	1427	1814	1376	1376
q5	4197	4133	4143	4133
q6	202	163	122	122
q7	1858	1821	1651	1651
q8	2651	2702	2510	2510
q9	7266	q10	q11	q12	q13	q14	q15	q16	q17	q18	q19	q20	q21	q22	Total cold run time: 17820 ms
Total hot run time: 17383 ms

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@zhiqiang-hhhh zhiqiang-hhhh force-pushed the profile-spec branch 2 times, most recently from 64c6645 to f371f9a Compare February 26, 2025 10:02
@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32348 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 110613bad4f2705d5a53183ff9c837143d684fb8, data reload: false

------ Round 1 ----------------------------------
q1	17581	5282	5269	5269
q2	2045	295	169	169
q3	10486	1423	727	727
q4	10298	1029	536	536
q5	7636	2486	2385	2385
q6	194	173	138	138
q7	918	741	606	606
q8	9317	1296	1120	1120
q9	5050	4703	4771	4703
q10	6834	2342	1880	1880
q11	507	287	274	274
q12	349	366	225	225
q13	17790	3692	3462	3462
q14	235	226	220	220
q15	520	469	472	469
q16	632	632	575	575
q17	596	897	359	359
q18	6773	6200	6259	6200
q19	1980	971	576	576
q20	306	327	196	196
q21	2847	2160	1953	1953
q22	368	340	306	306
Total cold run time: 103262 ms
Total hot run time: 32348 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5244	5188	5142	5142
q2	231	327	232	232
q3	2161	2696	2323	2323
q4	1438	1850	1377	1377
q5	4268	4128	4147	4128
q6	208	167	125	125
q7	1896	1963	1797	1797
q8	2603	2559	2537	2537
q9	7332	7234	7191	7191
q10	2976	3211	2798	2798
q11	573	496	500	496
q12	693	808	651	651
q13	3574	3879	3214	3214
q14	272	306	267	267
q15	528	468	466	466
q16	643	687	617	617
q17	1170	1643	1321	1321
q18	7766	7498	7312	7312
q19	825	831	873	831
q20	1993	2016	1864	1864
q21	5518	5094	4955	4955
q22	689	582	555	555
Total cold run time: 52601 ms
Total hot run time: 50199 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 183936 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 110613bad4f2705d5a53183ff9c837143d684fb8, data reload: false

query1	997	375	377	375
query2	6527	1986	1918	1918
query3	6792	214	212	212
query4	26021	23221	23245	23221
query5	4374	658	506	506
query6	292	203	182	182
query7	4614	495	288	288
query8	298	246	239	239
query9	8601	2587	2602	2587
query10	488	315	257	257
query11	15897	15172	15076	15076
query12	168	112	108	108
query13	1687	518	400	400
query14	9500	6381	6256	6256
query15	213	195	175	175
query16	7249	659	496	496
query17	1203	729	572	572
query18	1957	415	312	312
query19	198	190	158	158
query20	121	121	113	113
query21	216	127	106	106
query22	4207	4218	4041	4041
query23	34003	33033	32894	32894
query24	8223	2365	2364	2364
query25	529	458	378	378
query26	1244	278	152	152
query27	2661	482	331	331
query28	4362	2444	2388	2388
query29	746	565	411	411
query30	234	189	156	156
query31	941	834	793	793
query32	75	61	64	61
query33	580	376	302	302
query34	788	852	485	485
query35	800	821	779	779
query36	937	978	883	883
query37	118	102	78	78
query38	4228	4171	4076	4076
query39	1435	1436	1419	1419
query40	207	112	102	102
query41	55	52	53	52
query42	134	105	103	103
query43	501	505	483	483
query44	1278	772	769	769
query45	177	166	157	157
query46	855	1053	647	647
query47	1722	1809	1748	1748
query48	369	409	303	303
query49	786	511	452	452
query50	690	731	407	407
query51	4151	4202	4123	4123
query52	106	114	98	98
query53	234	252	187	187
query54	489	474	418	418
query55	83	87	77	77
query56	256	265	245	245
query57	1142	1142	1068	1068
query58	241	237	248	237
query59	2862	2754	2640	2640
query60	272	287	254	254
query61	138	122	121	121
query62	802	731	669	669
query63	228	197	186	186
query64	4328	989	704	704
query65	3254	3140	3141	3140
query66	1114	408	307	307
query67	15714	15554	15302	15302
query68	8025	870	498	498
query69	464	298	313	298
query70	1198	1122	1095	1095
query71	449	282	270	270
query72	5519	3534	3732	3534
query73	790	727	343	343
query74	8867	8859	8792	8792
query75	3746	3204	2717	2717
query76	3667	1183	744	744
query77	784	358	286	286
query78	9977	10259	9264	9264
query79	1928	867	577	577
query80	595	536	431	431
query81	505	272	238	238
query82	473	131	94	94
query83	176	171	152	152
query84	239	94	73	73
query85	798	356	312	312
query86	332	297	280	280
query87	4375	4416	4386	4386
query88	3538	2213	2219	2213
query89	383	315	290	290
query90	1956	206	199	199
query91	140	137	107	107
query92	73	60	58	58
query93	1252	1032	563	563
query94	683	427	302	302
query95	357	266	258	258
query96	491	557	267	267
query97	3407	3388	3292	3292
query98	222	223	204	204
query99	1322	1417	1252	1252
Total cold run time: 272443 ms
Total hot run time: 183936 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.12 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 110613bad4f2705d5a53183ff9c837143d684fb8, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.61	0.10	0.10
query5	0.56	0.54	0.55
query6	1.17	0.73	0.72
query7	0.02	0.01	0.02
query8	0.04	0.04	0.03
query9	0.59	0.55	0.53
query10	0.57	0.57	0.58
query11	0.16	0.11	0.10
query12	0.14	0.11	0.12
query13	0.63	0.61	0.59
query14	2.66	2.69	2.66
query15	0.92	0.85	0.84
query16	0.38	0.39	0.38
query17	1.01	1.01	1.06
query18	0.22	0.20	0.20
query19	1.92	1.79	2.02
query20	0.01	0.02	0.01
query21	15.37	0.93	0.54
query22	0.75	1.15	0.70
query23	14.94	1.40	0.59
query24	7.52	1.54	1.06
query25	0.54	0.29	0.07
query26	0.55	0.15	0.12
query27	0.04	0.05	0.05
query28	9.57	0.90	0.43
query29	12.55	4.05	3.34
query30	0.25	0.09	0.07
query31	2.82	0.59	0.39
query32	3.23	0.56	0.46
query33	3.08	3.07	3.08
query34	15.82	5.26	4.56
query35	4.56	4.55	4.60
query36	0.66	0.50	0.50
query37	0.09	0.07	0.06
query38	0.04	0.04	0.04
query39	0.02	0.02	0.02
query40	0.17	0.14	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.03
query43	0.04	0.03	0.03
Total cold run time: 105.66 s
Total hot run time: 31.12 s

@doris-robot
Copy link

BE UT Coverage Report

Increment line coverage 34.88% (15/43) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 44.80% (11941/26654)
Line Coverage 34.24% (99959/291921)
Region Coverage 33.39% (51146/153198)
Branch Coverage 28.94% (25687/88764)

@zhiqiang-hhhh zhiqiang-hhhh force-pushed the profile-spec branch 2 times, most recently from 529d7e3 to 54a204e Compare February 27, 2025 12:32
@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

1 similar comment
@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

1 similar comment
@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32678 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e4cd960ebf74a9cc8be7fdfe92c5afb6c4ac6485, data reload: false

------ Round 1 ----------------------------------
q1	17607	5157	5117	5117
q2	2048	299	171	171
q3	10563	1364	715	715
q4	10259	1029	540	540
q5	8053	2393	2372	2372
q6	195	169	142	142
q7	934	751	605	605
q8	9309	1316	1105	1105
q9	5032	4623	4748	4623
q10	6816	2301	1947	1947
q11	473	280	265	265
q12	354	355	214	214
q13	17768	3675	3098	3098
q14	227	236	215	215
q15	543	499	489	489
q16	639	601	603	601
q17	578	873	348	348
q18	7366	6363	6478	6363
q19	1617	967	550	550
q20	317	323	199	199
q21	2761	2203	2009	2009
q22	1076	1027	990	990
Total cold run time: 104535 ms
Total hot run time: 32678 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5203	5224	5135	5135
q2	238	332	242	242
q3	2113	2651	2265	2265
q4	1432	1774	1362	1362
q5	4190	4163	4161	4161
q6	206	168	124	124
q7	1967	1963	1751	1751
q8	2670	2595	2552	2552
q9	7170	7069	7187	7069
q10	3008	3245	2760	2760
q11	574	529	496	496
q12	688	794	606	606
q13	3494	3868	3273	3273
q14	286	287	265	265
q15	522	479	491	479
q16	645	707	636	636
q17	1124	1617	1366	1366
q18	7789	7596	7595	7595
q19	807	836	989	836
q20	1965	2056	1850	1850
q21	5465	4980	4868	4868
q22	1084	1034	1000	1000
Total cold run time: 52640 ms
Total hot run time: 50691 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186364 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e4cd960ebf74a9cc8be7fdfe92c5afb6c4ac6485, data reload: false

query1	984	386	379	379
query2	6551	1903	1890	1890
query3	6790	244	221	221
query4	26615	23210	23365	23210
query5	4407	661	485	485
query6	310	204	198	198
query7	4604	500	293	293
query8	291	251	236	236
query9	8622	2512	2521	2512
query10	466	333	261	261
query11	15381	15163	14988	14988
query12	155	111	104	104
query13	1641	508	389	389
query14	8781	6520	6620	6520
query15	213	185	178	178
query16	7136	647	458	458
query17	901	702	546	546
query18	1952	429	299	299
query19	186	179	152	152
query20	117	112	113	112
query21	209	118	104	104
query22	4484	4295	4442	4295
query23	33902	33006	33065	33006
query24	7714	2376	2392	2376
query25	548	466	435	435
query26	1230	279	158	158
query27	2121	497	332	332
query28	3929	2391	2391	2391
query29	810	579	455	455
query30	286	221	196	196
query31	923	834	758	758
query32	80	69	68	68
query33	578	366	318	318
query34	780	864	504	504
query35	810	834	732	732
query36	959	995	884	884
query37	122	98	81	81
query38	4315	4232	4178	4178
query39	1457	1410	1382	1382
query40	217	120	114	114
query41	60	61	56	56
query42	122	112	111	111
query43	499	519	486	486
query44	1279	797	789	789
query45	177	175	169	169
query46	831	1025	641	641
query47	1761	1887	1747	1747
query48	375	399	297	297
query49	798	499	433	433
query50	722	746	420	420
query51	4179	4243	4129	4129
query52	107	108	100	100
query53	241	260	186	186
query54	484	488	426	426
query55	85	84	80	80
query56	269	267	252	252
query57	1123	1190	1076	1076
query58	244	228	231	228
query59	2477	2700	2543	2543
query60	289	269	260	260
query61	121	116	121	116
query62	843	770	687	687
query63	227	193	187	187
query64	4471	1018	717	717
query65	4416	4336	4324	4324
query66	1149	408	298	298
query67	15841	15652	15422	15422
query68	9538	884	510	510
query69	483	296	260	260
query70	1202	1116	1113	1113
query71	461	287	255	255
query72	5778	3563	3801	3563
query73	788	735	340	340
query74	9443	9161	9283	9161
query75	4201	3155	2692	2692
query76	3617	1197	755	755
query77	997	384	284	284
query78	10178	10393	9404	9404
query79	1986	826	590	590
query80	598	527	434	434
query81	469	271	221	221
query82	494	128	102	102
query83	173	250	151	151
query84	289	90	72	72
query85	777	348	304	304
query86	383	297	303	297
query87	4492	4607	4394	4394
query88	3611	2203	2237	2203
query89	392	309	286	286
query90	1838	210	204	204
query91	145	136	108	108
query92	75	57	55	55
query93	1630	1057	584	584
query94	650	425	306	306
query95	356	268	263	263
query96	478	556	281	281
query97	3328	3364	3322	3322
query98	223	205	200	200
query99	1331	1405	1272	1272
Total cold run time: 275171 ms
Total hot run time: 186364 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.58 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e4cd960ebf74a9cc8be7fdfe92c5afb6c4ac6485, data reload: false

query1	0.04	0.04	0.04
query2	0.06	0.04	0.04
query3	0.23	0.07	0.06
query4	1.64	0.10	0.10
query5	0.55	0.54	0.55
query6	1.20	0.71	0.72
query7	0.03	0.03	0.02
query8	0.04	0.04	0.03
query9	0.59	0.52	0.50
query10	0.57	0.61	0.60
query11	0.16	0.11	0.11
query12	0.14	0.11	0.11
query13	0.61	0.61	0.60
query14	2.67	2.69	2.69
query15	0.92	0.83	0.86
query16	0.37	0.38	0.38
query17	1.02	1.03	1.00
query18	0.21	0.20	0.20
query19	1.86	1.82	1.97
query20	0.01	0.01	0.01
query21	15.35	0.91	0.55
query22	0.74	1.15	0.64
query23	15.04	1.38	0.63
query24	6.81	2.01	0.68
query25	0.54	0.16	0.14
query26	0.71	0.15	0.13
query27	0.06	0.05	0.04
query28	9.94	0.86	0.43
query29	12.57	3.99	3.30
query30	0.25	0.08	0.06
query31	2.82	0.58	0.38
query32	3.22	0.55	0.48
query33	2.98	2.97	3.11
query34	15.69	5.14	4.48
query35	4.52	4.59	4.49
query36	0.66	0.49	0.47
query37	0.09	0.06	0.06
query38	0.06	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.14	0.13
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.33 s
Total hot run time: 30.58 s

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32515 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 192e5dc099633db85401ada4f8792d98627fe337, data reload: false

------ Round 1 ----------------------------------
q1	17579	5449	5090	5090
q2	2044	287	166	166
q3	10447	1239	762	762
q4	10298	1011	523	523
q5	8416	2369	2312	2312
q6	193	165	135	135
q7	884	742	606	606
q8	9312	1263	1044	1044
q9	4890	4923	4645	4645
q10	6816	2311	1870	1870
q11	495	284	260	260
q12	341	345	230	230
q13	17770	3670	3107	3107
q14	243	219	213	213
q15	542	513	476	476
q16	634	615	604	604
q17	570	835	336	336
q18	6757	6563	6463	6463
q19	1588	926	531	531
q20	320	314	191	191
q21	2861	2157	1973	1973
q22	1077	1007	978	978
Total cold run time: 104077 ms
Total hot run time: 32515 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5163	5111	5096	5096
q2	236	331	229	229
q3	2154	2683	2301	2301
q4	1432	1832	1399	1399
q5	4348	4210	4237	4210
q6	208	171	135	135
q7	1984	1965	1836	1836
q8	2671	2547	2619	2547
q9	7262	7138	7169	7138
q10	3032	3216	2813	2813
q11	586	496	481	481
q12	657	744	585	585
q13	3574	3892	3270	3270
q14	290	309	272	272
q15	521	486	489	486
q16	691	715	660	660
q17	1121	1620	1327	1327
q18	7798	7617	7471	7471
q19	825	802	913	802
q20	1972	2012	1898	1898
q21	5416	4983	4659	4659
q22	1086	1076	1021	1021
Total cold run time: 53027 ms
Total hot run time: 50636 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192263 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 192e5dc099633db85401ada4f8792d98627fe337, data reload: false

query1	1362	998	1007	998
query2	6199	1886	1871	1871
query3	11112	4675	4561	4561
query4	25564	23715	23612	23612
query5	5622	647	478	478
query6	303	202	190	190
query7	3985	492	284	284
query8	280	240	241	240
query9	8498	2505	2512	2505
query10	520	314	270	270
query11	15252	15102	14766	14766
query12	170	112	105	105
query13	1566	526	397	397
query14	9025	6575	6669	6575
query15	205	189	170	170
query16	7630	640	483	483
query17	1267	738	578	578
query18	1998	420	305	305
query19	192	186	162	162
query20	123	126	120	120
query21	209	121	108	108
query22	4430	4658	4315	4315
query23	34409	33449	33569	33449
query24	7730	2411	2434	2411
query25	502	469	428	428
query26	1158	277	162	162
query27	2290	497	339	339
query28	4569	2419	2386	2386
query29	686	564	420	420
query30	317	221	197	197
query31	932	856	781	781
query32	72	63	62	62
query33	544	351	298	298
query34	795	877	512	512
query35	833	837	788	788
query36	1028	1026	902	902
query37	116	96	70	70
query38	4374	4271	4333	4271
query39	1463	1417	1430	1417
query40	213	121	108	108
query41	52	50	50	50
query42	122	112	106	106
query43	505	520	478	478
query44	1300	803	800	800
query45	187	212	176	176
query46	855	1030	633	633
query47	1847	1875	1794	1794
query48	383	411	306	306
query49	778	506	428	428
query50	708	745	417	417
query51	4289	4309	4290	4290
query52	109	102	96	96
query53	230	258	184	184
query54	499	486	413	413
query55	91	85	78	78
query56	291	262	260	260
query57	1191	1194	1094	1094
query58	246	245	238	238
query59	2694	2973	2731	2731
query60	281	285	257	257
query61	130	134	119	119
query62	744	756	673	673
query63	230	189	191	189
query64	4434	1059	709	709
query65	4479	4431	4447	4431
query66	913	399	310	310
query67	15914	15511	15276	15276
query68	7529	872	519	519
query69	469	314	262	262
query70	1205	1053	1002	1002
query71	415	289	265	265
query72	5662	3647	3921	3647
query73	741	737	343	343
query74	9003	9110	8834	8834
query75	3185	3155	2707	2707
query76	3087	1192	851	851
query77	466	378	284	284
query78	9984	10117	9372	9372
query79	2874	826	582	582
query80	625	509	449	449
query81	489	267	222	222
query82	682	130	92	92
query83	170	169	148	148
query84	245	102	73	73
query85	734	350	305	305
query86	351	297	296	296
query87	4471	4406	4334	4334
query88	3818	2201	2234	2201
query89	417	403	286	286
query90	2071	202	204	202
query91	134	133	107	107
query92	72	58	59	58
query93	2148	1041	577	577
query94	696	404	309	309
query95	346	265	250	250
query96	472	572	270	270
query97	3300	3417	3279	3279
query98	240	208	201	201
query99	1334	1395	1306	1306
Total cold run time: 278480 ms
Total hot run time: 192263 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.08 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 192e5dc099633db85401ada4f8792d98627fe337, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.04	0.03
query3	0.23	0.06	0.07
query4	1.62	0.10	0.10
query5	0.56	0.56	0.55
query6	1.16	0.73	0.72
query7	0.03	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.52	0.52
query10	0.58	0.60	0.60
query11	0.16	0.11	0.10
query12	0.15	0.12	0.11
query13	0.61	0.61	0.60
query14	2.66	2.74	2.72
query15	0.91	0.86	0.85
query16	0.39	0.38	0.37
query17	1.01	1.01	1.02
query18	0.21	0.19	0.19
query19	1.91	1.78	1.97
query20	0.01	0.01	0.01
query21	15.38	0.91	0.55
query22	0.76	1.14	0.74
query23	14.90	1.36	0.67
query24	7.03	1.72	0.96
query25	0.52	0.24	0.09
query26	0.61	0.17	0.14
query27	0.05	0.05	0.05
query28	9.61	0.85	0.43
query29	12.64	3.96	3.30
query30	0.24	0.10	0.07
query31	2.81	0.57	0.38
query32	3.23	0.54	0.46
query33	3.01	3.01	3.03
query34	15.77	5.16	4.49
query35	4.66	4.56	4.58
query36	0.66	0.49	0.49
query37	0.09	0.07	0.06
query38	0.05	0.04	0.03
query39	0.04	0.03	0.02
query40	0.17	0.13	0.12
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.02
Total cold run time: 105.3 s
Total hot run time: 31.08 s

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32462 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0da25cea7b4ac38059007ce545a2f0918f622f21, data reload: false

------ Round 1 ----------------------------------
q1	17589	5241	5044	5044
q2	2039	310	168	168
q3	10397	1357	706	706
q4	10210	1057	533	533
q5	7537	2365	2436	2365
q6	189	173	133	133
q7	912	736	597	597
q8	9303	1307	1164	1164
q9	4979	4713	4726	4713
q10	6816	2334	1881	1881
q11	478	278	277	277
q12	339	360	224	224
q13	17765	3672	3096	3096
q14	250	240	207	207
q15	536	483	495	483
q16	639	620	592	592
q17	569	867	340	340
q18	6797	6533	6242	6242
q19	1220	956	534	534
q20	301	337	203	203
q21	2799	2169	1959	1959
q22	1088	1016	1001	1001
Total cold run time: 102752 ms
Total hot run time: 32462 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5165	5140	5121	5121
q2	245	337	233	233
q3	2169	2677	2362	2362
q4	1421	1817	1350	1350
q5	4267	4139	4186	4139
q6	210	164	123	123
q7	1891	1952	1814	1814
q8	2641	2617	2606	2606
q9	7257	7137	7235	7137
q10	3027	3252	2756	2756
q11	574	502	490	490
q12	726	765	617	617
q13	3515	3881	3240	3240
q14	273	291	272	272
q15	534	477	475	475
q16	629	690	632	632
q17	1134	1579	1377	1377
q18	7823	7701	7431	7431
q19	802	773	842	773
q20	1983	1986	1884	1884
q21	5463	5063	4802	4802
q22	1105	1031	1036	1031
Total cold run time: 52854 ms
Total hot run time: 50665 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185117 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0da25cea7b4ac38059007ce545a2f0918f622f21, data reload: false

query1	964	404	374	374
query2	6533	1875	1871	1871
query3	6806	225	224	224
query4	26945	23742	23403	23403
query5	4312	679	489	489
query6	293	213	183	183
query7	4605	499	293	293
query8	297	243	236	236
query9	8618	2509	2520	2509
query10	446	328	252	252
query11	15776	15084	15032	15032
query12	158	107	109	107
query13	1688	518	412	412
query14	10137	6498	6215	6215
query15	210	192	173	173
query16	7508	640	467	467
query17	1175	703	542	542
query18	1970	402	303	303
query19	182	179	152	152
query20	118	114	114	114
query21	213	118	101	101
query22	4167	4345	4095	4095
query23	33774	32964	33056	32964
query24	7772	2359	2388	2359
query25	539	476	385	385
query26	1230	269	154	154
query27	2125	493	332	332
query28	3909	2407	2414	2407
query29	746	543	424	424
query30	281	221	189	189
query31	942	852	769	769
query32	79	62	63	62
query33	557	352	306	306
query34	782	846	497	497
query35	802	814	721	721
query36	966	1005	896	896
query37	118	100	82	82
query38	4130	4145	4133	4133
query39	1451	1385	1405	1385
query40	207	117	104	104
query41	56	53	53	53
query42	123	103	105	103
query43	506	504	480	480
query44	1277	782	777	777
query45	173	170	168	168
query46	842	1024	614	614
query47	1795	1796	1757	1757
query48	376	406	314	314
query49	794	522	431	431
query50	674	735	401	401
query51	4203	4200	4112	4112
query52	110	100	91	91
query53	223	252	195	195
query54	530	494	414	414
query55	89	77	83	77
query56	279	281	263	263
query57	1134	1141	1067	1067
query58	251	223	261	223
query59	2528	2709	2612	2612
query60	283	284	258	258
query61	122	116	116	116
query62	776	758	672	672
query63	234	185	191	185
query64	4397	1004	690	690
query65	4415	4306	4322	4306
query66	1114	412	294	294
query67	15880	15438	15224	15224
query68	8048	870	506	506
query69	465	293	262	262
query70	1196	1107	1105	1105
query71	394	284	262	262
query72	5508	3603	3965	3603
query73	824	735	344	344
query74	8973	8838	8660	8660
query75	3464	3172	2684	2684
query76	3401	1178	759	759
query77	766	368	287	287
query78	9873	10187	9334	9334
query79	1750	872	595	595
query80	603	518	440	440
query81	485	254	235	235
query82	208	125	99	99
query83	180	170	164	164
query84	242	97	76	76
query85	754	354	311	311
query86	331	297	302	297
query87	4579	4655	4343	4343
query88	3022	2193	2226	2193
query89	381	318	282	282
query90	2032	210	215	210
query91	144	141	111	111
query92	73	60	58	58
query93	1121	1047	604	604
query94	663	428	284	284
query95	362	275	263	263
query96	477	550	277	277
query97	3282	3394	3336	3336
query98	227	221	205	205
query99	1356	1425	1315	1315
Total cold run time: 271899 ms
Total hot run time: 185117 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.78 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0da25cea7b4ac38059007ce545a2f0918f622f21, data reload: false

query1	0.05	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.06	0.06
query4	1.61	0.10	0.11
query5	0.56	0.54	0.54
query6	1.21	0.72	0.72
query7	0.03	0.02	0.01
query8	0.04	0.03	0.03
query9	0.58	0.53	0.52
query10	0.57	0.60	0.57
query11	0.16	0.11	0.10
query12	0.15	0.12	0.10
query13	0.61	0.60	0.61
query14	2.83	2.77	2.80
query15	0.92	0.87	0.86
query16	0.38	0.38	0.37
query17	1.01	1.03	1.04
query18	0.22	0.19	0.20
query19	1.93	1.79	1.93
query20	0.01	0.02	0.01
query21	15.36	0.90	0.55
query22	0.73	1.17	0.76
query23	14.82	1.40	0.61
query24	6.94	2.42	0.58
query25	0.49	0.18	0.11
query26	0.55	0.17	0.14
query27	0.05	0.05	0.05
query28	9.53	0.87	0.43
query29	12.53	4.02	3.38
query30	0.26	0.09	0.06
query31	2.83	0.61	0.39
query32	3.22	0.56	0.47
query33	2.97	2.99	3.02
query34	15.89	5.23	4.49
query35	4.55	4.53	4.59
query36	0.66	0.49	0.49
query37	0.10	0.06	0.07
query38	0.05	0.05	0.04
query39	0.03	0.03	0.02
query40	0.16	0.13	0.14
query41	0.09	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.06 s
Total hot run time: 30.78 s

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32478 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f175e0ad024111328d23dd728bc58b4c938b53eb, data reload: false

------ Round 1 ----------------------------------
q1	17604	5180	5370	5180
q2	2040	287	164	164
q3	10430	1250	731	731
q4	10207	1007	522	522
q5	7537	2337	2396	2337
q6	185	171	132	132
q7	921	767	606	606
q8	9306	1282	1028	1028
q9	4978	4932	4752	4752
q10	6802	2287	1889	1889
q11	491	266	267	266
q12	361	359	217	217
q13	17769	3666	3067	3067
q14	211	224	210	210
q15	528	489	484	484
q16	605	622	600	600
q17	583	864	345	345
q18	6786	6494	6355	6355
q19	1216	967	536	536
q20	312	322	193	193
q21	2851	2167	1885	1885
q22	988	1027	979	979
Total cold run time: 102711 ms
Total hot run time: 32478 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5129	5099	5130	5099
q2	230	330	237	237
q3	2120	2711	2291	2291
q4	1424	1844	1388	1388
q5	4207	4134	4154	4134
q6	200	164	123	123
q7	1908	1892	1805	1805
q8	2622	2651	2576	2576
q9	7286	7261	7154	7154
q10	3009	3264	2783	2783
q11	577	524	498	498
q12	697	740	594	594
q13	3571	3923	3264	3264
q14	300	300	267	267
q15	527	494	495	494
q16	651	705	655	655
q17	1154	1603	1375	1375
q18	7921	7738	7499	7499
q19	825	770	820	770
q20	2000	2029	1903	1903
q21	5475	4849	4872	4849
q22	1106	1064	1023	1023
Total cold run time: 52939 ms
Total hot run time: 50781 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191602 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f175e0ad024111328d23dd728bc58b4c938b53eb, data reload: false

query1	1364	1045	986	986
query2	6226	1951	1912	1912
query3	11028	4486	4476	4476
query4	57173	26123	23022	23022
query5	4920	515	472	472
query6	326	192	173	173
query7	4879	505	292	292
query8	320	249	236	236
query9	5527	2523	2547	2523
query10	430	320	247	247
query11	15085	14954	14860	14860
query12	154	109	103	103
query13	1036	511	394	394
query14	10667	6373	6452	6373
query15	199	214	190	190
query16	7156	674	475	475
query17	1092	749	587	587
query18	1571	426	325	325
query19	200	208	176	176
query20	129	130	129	129
query21	260	128	101	101
query22	4535	4593	4462	4462
query23	34115	33529	33282	33282
query24	5840	2393	2415	2393
query25	448	448	396	396
query26	696	274	186	186
query27	1990	483	333	333
query28	2881	2470	2455	2455
query29	597	578	419	419
query30	269	226	188	188
query31	893	859	796	796
query32	70	59	63	59
query33	434	360	294	294
query34	753	850	504	504
query35	808	837	756	756
query36	937	1014	903	903
query37	116	102	77	77
query38	4127	4409	4276	4276
query39	1518	1572	1456	1456
query40	212	118	102	102
query41	71	55	54	54
query42	119	108	105	105
query43	511	515	495	495
query44	1303	796	813	796
query45	180	181	165	165
query46	951	1040	644	644
query47	1848	1877	1805	1805
query48	406	427	311	311
query49	707	512	439	439
query50	709	762	421	421
query51	4320	4346	4312	4312
query52	113	109	100	100
query53	229	266	183	183
query54	480	499	421	421
query55	85	82	82	82
query56	278	256	272	256
query57	1204	1201	1109	1109
query58	256	249	246	246
query59	2788	2814	2762	2762
query60	294	276	281	276
query61	139	120	140	120
query62	769	748	729	729
query63	236	189	197	189
query64	1509	1036	698	698
query65	4533	4430	4567	4430
query66	740	392	304	304
query67	15963	15631	15297	15297
query68	8355	880	506	506
query69	536	304	254	254
query70	1273	1116	1130	1116
query71	490	283	263	263
query72	5790	3551	3800	3551
query73	1456	741	344	344
query74	8979	9415	8697	8697
query75	3671	3118	2750	2750
query76	4188	1185	746	746
query77	599	367	275	275
query78	9995	10145	9325	9325
query79	3135	875	583	583
query80	676	558	451	451
query81	488	266	218	218
query82	490	126	100	100
query83	347	176	162	162
query84	286	87	70	70
query85	814	368	311	311
query86	381	330	279	279
query87	4478	4647	4394	4394
query88	2971	2233	2243	2233
query89	414	316	293	293
query90	1980	221	219	219
query91	140	143	109	109
query92	73	58	55	55
query93	1670	1100	578	578
query94	698	424	306	306
query95	354	275	264	264
query96	491	573	273	273
query97	3425	3433	3265	3265
query98	222	205	197	197
query99	1435	1392	1277	1277
Total cold run time: 302022 ms
Total hot run time: 191602 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.87 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f175e0ad024111328d23dd728bc58b4c938b53eb, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.04
query3	0.23	0.06	0.07
query4	1.62	0.10	0.10
query5	0.55	0.57	0.55
query6	1.18	0.72	0.71
query7	0.03	0.01	0.02
query8	0.05	0.04	0.03
query9	0.58	0.53	0.51
query10	0.56	0.60	0.59
query11	0.15	0.11	0.11
query12	0.15	0.11	0.12
query13	0.62	0.60	0.61
query14	2.67	2.68	2.81
query15	0.94	0.86	0.85
query16	0.36	0.39	0.38
query17	1.00	1.01	1.02
query18	0.21	0.20	0.20
query19	1.94	1.76	1.98
query20	0.02	0.02	0.01
query21	15.36	0.91	0.53
query22	0.75	1.14	0.68
query23	14.97	1.38	0.61
query24	7.24	0.87	1.93
query25	0.49	0.27	0.10
query26	0.52	0.16	0.14
query27	0.05	0.05	0.04
query28	9.87	0.81	0.43
query29	12.55	4.18	3.36
query30	0.25	0.08	0.06
query31	2.82	0.59	0.40
query32	3.23	0.54	0.47
query33	2.98	3.10	3.06
query34	15.92	5.08	4.49
query35	4.50	4.51	4.51
query36	0.66	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.17	0.13	0.12
query41	0.08	0.02	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 105.62 s
Total hot run time: 30.87 s

@zhiqiang-hhhh
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32337 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1d9f82d72db6ab82756e7c2b8d069e4d58b7aa9b, data reload: false

------ Round 1 ----------------------------------
q1	17620	5802	5055	5055
q2	2046	292	162	162
q3	10420	1247	694	694
q4	10217	982	535	535
q5	7544	2316	2343	2316
q6	190	171	136	136
q7	885	750	626	626
q8	9322	1269	1104	1104
q9	4916	4751	4566	4566
q10	6811	2306	1886	1886
q11	467	271	262	262
q12	344	349	215	215
q13	17784	3666	3123	3123
q14	225	226	213	213
q15	520	477	478	477
q16	642	620	596	596
q17	578	879	341	341
q18	6947	6564	6350	6350
q19	2018	940	551	551
q20	306	323	192	192
q21	2753	2149	1927	1927
q22	1017	1028	1010	1010
Total cold run time: 103572 ms
Total hot run time: 32337 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5264	5142	5125	5125
q2	231	323	229	229
q3	2153	2691	2284	2284
q4	1418	1789	1426	1426
q5	4208	4111	4168	4111
q6	207	165	130	130
q7	2062	1903	1788	1788
q8	2595	2597	2545	2545
q9	7222	7129	7191	7129
q10	3008	3417	2742	2742
q11	570	515	489	489
q12	681	815	638	638
q13	3467	4400	3225	3225
q14	279	311	287	287
q15	523	474	480	474
q16	659	691	669	669
q17	1126	1614	1341	1341
q18	7810	7688	7577	7577
q19	792	804	922	804
q20	1971	2024	1865	1865
q21	5267	5044	4749	4749
q22	1089	1040	1005	1005
Total cold run time: 52602 ms
Total hot run time: 50632 ms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@zhiqiang-hhhh @Thearas @doris-robot @hello-stephen