Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[test](vault) Add more regression test about storage vault #47449

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from
Draft

[test](vault) Add more regression test about storage vault #47449

wants to merge 1 commit into from

Conversation

SWJTU-ZhangLei
Copy link
Contributor

  • Add case sensitive test
  • Add kerberos test

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@SWJTU-ZhangLei
[test](vault) Add more regression test about storage vault
bdf98c5 
* Add case sensitive test
* Add kerberos test
@Thearas
Copy link
Contributor

Thearas commented Jan 26, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@SWJTU-ZhangLei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32038 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bdf98c573665dfe69c0e2f60d8b551aedf12af92, data reload: false

------ Round 1 ----------------------------------
q1	17579	5386	5358	5358
q2	2042	294	162	162
q3	10439	1220	734	734
q4	10233	950	518	518
q5	7801	2388	2154	2154
q6	204	165	134	134
q7	898	757	612	612
q8	9222	1359	1196	1196
q9	5145	4895	4900	4895
q10	6841	2345	1889	1889
q11	472	278	246	246
q12	334	349	213	213
q13	17780	3672	3075	3075
q14	222	235	204	204
q15	519	467	458	458
q16	630	635	593	593
q17	570	859	324	324
q18	7042	6306	6378	6306
q19	1726	966	530	530
q20	311	316	191	191
q21	2772	2191	1945	1945
q22	372	329	301	301
Total cold run time: 103154 ms
Total hot run time: 32038 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5556	5507	5516	5507
q2	239	329	233	233
q3	2277	2684	2355	2355
q4	1448	1886	1442	1442
q5	4411	4759	4638	4638
q6	168	158	125	125
q7	1997	1952	1796	1796
q8	2710	2770	2740	2740
q9	7333	7284	7286	7284
q10	3061	3287	2768	2768
q11	595	521	492	492
q12	647	720	577	577
q13	3510	3935	3258	3258
q14	282	292	271	271
q15	504	470	466	466
q16	637	702	635	635
q17	1212	1725	1251	1251
q18	7584	7479	7289	7289
q19	820	1180	1052	1052
q20	1977	2053	1883	1883
q21	5686	5069	4975	4975
q22	607	615	571	571
Total cold run time: 53261 ms
Total hot run time: 51608 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191104 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bdf98c573665dfe69c0e2f60d8b551aedf12af92, data reload: false

query1	1309	923	915	915
query2	6261	2010	2011	2010
query3	10959	4423	4396	4396
query4	60523	34189	23170	23170
query5	5583	612	462	462
query6	348	206	191	191
query7	5042	491	302	302
query8	297	227	227	227
query9	6384	2681	2673	2673
query10	433	295	245	245
query11	15426	15009	15445	15009
query12	161	105	106	105
query13	1042	563	439	439
query14	11511	6478	7314	6478
query15	202	220	200	200
query16	7466	604	513	513
query17	1153	769	585	585
query18	1944	407	326	326
query19	199	179	167	167
query20	123	116	114	114
query21	210	121	106	106
query22	4620	5009	4328	4328
query23	34036	33636	33569	33569
query24	5567	2309	2285	2285
query25	467	468	377	377
query26	711	286	155	155
query27	1738	476	334	334
query28	4084	2491	2507	2491
query29	533	556	438	438
query30	213	188	155	155
query31	914	889	819	819
query32	69	60	58	58
query33	431	388	300	300
query34	762	869	510	510
query35	798	860	754	754
query36	1028	1024	952	952
query37	116	98	76	76
query38	4232	4361	4165	4165
query39	1474	1419	1435	1419
query40	212	110	100	100
query41	54	49	50	49
query42	123	103	101	101
query43	502	525	501	501
query44	1388	840	851	840
query45	189	169	163	163
query46	900	1073	670	670
query47	1877	1899	1857	1857
query48	397	410	332	332
query49	712	476	396	396
query50	654	671	393	393
query51	4362	4294	4366	4294
query52	110	107	90	90
query53	231	259	197	197
query54	493	532	410	410
query55	86	78	85	78
query56	266	256	242	242
query57	1232	1166	1148	1148
query58	241	227	230	227
query59	3220	3145	3130	3130
query60	273	261	248	248
query61	114	118	114	114
query62	725	697	662	662
query63	223	191	184	184
query64	1372	1035	648	648
query65	3247	3181	3157	3157
query66	719	391	287	287
query67	15983	15561	15554	15554
query68	4997	832	534	534
query69	494	307	249	249
query70	1165	1149	1046	1046
query71	413	281	257	257
query72	6100	3858	3786	3786
query73	809	755	358	358
query74	10146	9007	8905	8905
query75	3198	3143	2692	2692
query76	3783	1130	797	797
query77	471	365	272	272
query78	10044	9997	9385	9385
query79	3574	821	593	593
query80	1560	532	452	452
query81	553	276	237	237
query82	676	151	117	117
query83	273	163	155	155
query84	289	95	78	78
query85	796	361	295	295
query86	446	315	303	303
query87	4438	4335	4363	4335
query88	4443	2162	2178	2162
query89	393	333	281	281
query90	1548	189	186	186
query91	137	131	105	105
query92	63	58	51	51
query93	2485	888	539	539
query94	834	410	303	303
query95	341	260	254	254
query96	490	610	287	287
query97	2838	2824	2765	2765
query98	225	195	201	195
query99	1285	1371	1240	1240
Total cold run time: 307581 ms
Total hot run time: 191104 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.66 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bdf98c573665dfe69c0e2f60d8b551aedf12af92, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.04	0.04
query3	0.23	0.07	0.06
query4	1.63	0.11	0.11
query5	0.45	0.44	0.46
query6	1.17	0.65	0.67
query7	0.03	0.02	0.01
query8	0.04	0.03	0.03
query9	0.57	0.52	0.50
query10	0.56	0.57	0.54
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.60	0.59	0.60
query14	2.81	2.75	2.74
query15	0.90	0.81	0.82
query16	0.38	0.39	0.39
query17	1.08	1.00	1.00
query18	0.23	0.20	0.21
query19	1.93	1.78	2.00
query20	0.02	0.01	0.02
query21	15.38	0.88	0.59
query22	0.74	0.89	0.73
query23	15.15	1.49	0.58
query24	2.95	1.00	1.78
query25	0.30	0.18	0.14
query26	0.28	0.15	0.13
query27	0.07	0.05	0.04
query28	13.60	0.94	0.41
query29	12.61	4.00	3.28
query30	0.25	0.09	0.06
query31	2.84	0.61	0.37
query32	3.23	0.55	0.45
query33	2.97	3.00	3.01
query34	16.59	5.06	4.49
query35	4.51	4.45	4.47
query36	0.66	0.50	0.49
query37	0.10	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.13	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.03
query43	0.04	0.04	0.03
Total cold run time: 105.66 s
Total hot run time: 30.66 s

MoanasDaddyXu
MoanasDaddyXu reviewed Feb 7, 2025
View reviewed changes
regression-test/suites/vault_p0/privilege/test_vault_privilege_with_multi_roles.groovy
connect(userName, userPassword, context.config.jdbcUrl) {
sql """
insert into ${dbName}.${tableName2} values(1, 1);
select * from ${dbName}.${tableName2};
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

need to add result check

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@MoanasDaddyXu MoanasDaddyXu MoanasDaddyXu left review comments

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@SWJTU-ZhangLei @Thearas @doris-robot @MoanasDaddyXu