Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Test](nereids) add UT for dropCached/Expired/StatsCommand in nereids #49308

Open
wants to merge 6 commits into
base: master
Choose a base branch
from

Conversation

yx-keith
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@yx-keith
Copy link
Contributor Author

run buildall

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32777 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f8e2b0b1c0f4c03b39b2f62952208a13dff476e9, data reload: false

------ Round 1 ----------------------------------
q1	24212	5169	5063	5063
q2	2048	309	183	183
q3	10366	1243	691	691
q4	10214	1010	514	514
q5	7549	2398	2381	2381
q6	195	169	135	135
q7	935	760	608	608
q8	9305	1265	1159	1159
q9	4965	4895	4899	4895
q10	7253	2318	1880	1880
q11	501	287	271	271
q12	366	367	213	213
q13	17789	3690	3114	3114
q14	231	230	208	208
q15	525	481	486	481
q16	612	607	606	606
q17	568	855	350	350
q18	6807	6416	6298	6298
q19	1781	978	578	578
q20	351	335	192	192
q21	2806	2118	1965	1965
q22	993	1009	992	992
Total cold run time: 110372 ms
Total hot run time: 32777 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5285	5187	5163	5163
q2	238	324	240	240
q3	2166	2678	2287	2287
q4	1413	1808	1420	1420
q5	4254	4192	4404	4192
q6	213	171	134	134
q7	2006	1931	1817	1817
q8	2639	2674	2641	2641
q9	7262	7116	7195	7116
q10	3016	3112	2789	2789
q11	615	509	521	509
q12	689	806	632	632
q13	3573	3892	3336	3336
q14	280	298	287	287
q15	542	470	476	470
q16	639	652	626	626
q17	1134	1618	1328	1328
q18	7782	7599	7538	7538
q19	853	832	843	832
q20	1979	2045	1873	1873
q21	5385	4855	4920	4855
q22	1125	1077	1034	1034
Total cold run time: 53088 ms
Total hot run time: 51119 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192150 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f8e2b0b1c0f4c03b39b2f62952208a13dff476e9, data reload: false

query1	1429	1062	1042	1042
query2	6150	1934	1896	1896
query3	11020	4552	4526	4526
query4	54134	24860	23413	23413
query5	5328	525	479	479
query6	432	206	190	190
query7	5361	500	299	299
query8	340	249	235	235
query9	7016	2587	2595	2587
query10	418	320	258	258
query11	15432	15053	14939	14939
query12	168	110	103	103
query13	1229	501	409	409
query14	10040	6945	6384	6384
query15	193	206	193	193
query16	6848	651	469	469
query17	1049	748	552	552
query18	1592	389	325	325
query19	191	202	166	166
query20	126	124	121	121
query21	218	123	102	102
query22	4620	4558	4410	4410
query23	33842	33373	33242	33242
query24	5630	2413	2427	2413
query25	463	481	403	403
query26	873	284	154	154
query27	2038	502	328	328
query28	2788	2474	2460	2460
query29	585	551	424	424
query30	277	224	189	189
query31	883	876	767	767
query32	74	59	64	59
query33	439	345	308	308
query34	762	904	507	507
query35	803	835	755	755
query36	956	1034	917	917
query37	122	99	79	79
query38	4262	4412	4303	4303
query39	1500	1445	1461	1445
query40	206	119	102	102
query41	52	54	57	54
query42	131	107	100	100
query43	495	509	491	491
query44	1301	805	815	805
query45	181	174	171	171
query46	843	1053	636	636
query47	1846	1911	1844	1844
query48	406	446	308	308
query49	705	498	422	422
query50	726	747	424	424
query51	4350	4324	4241	4241
query52	109	109	95	95
query53	253	260	203	203
query54	479	501	437	437
query55	86	80	80	80
query56	269	277	271	271
query57	1159	1199	1130	1130
query58	245	241	236	236
query59	2908	2760	2853	2760
query60	283	286	260	260
query61	119	115	121	115
query62	736	767	685	685
query63	228	189	188	188
query64	1768	1043	704	704
query65	4548	4393	4327	4327
query66	727	398	315	315
query67	16034	15664	15368	15368
query68	8411	875	506	506
query69	560	311	271	271
query70	1207	1132	1124	1124
query71	474	346	257	257
query72	5792	3513	3719	3513
query73	909	718	347	347
query74	9039	9201	8948	8948
query75	3307	3161	2723	2723
query76	3982	1201	763	763
query77	546	356	270	270
query78	10000	10163	9239	9239
query79	2435	821	581	581
query80	622	530	435	435
query81	496	255	222	222
query82	593	124	97	97
query83	175	172	155	155
query84	288	100	72	72
query85	776	407	304	304
query86	407	294	301	294
query87	4495	4389	4443	4389
query88	3670	2232	2246	2232
query89	412	314	278	278
query90	1808	211	215	211
query91	151	137	107	107
query92	74	60	56	56
query93	2029	1031	579	579
query94	708	415	311	311
query95	337	259	262	259
query96	488	555	272	272
query97	3350	3439	3280	3280
query98	227	207	199	199
query99	1316	1413	1233	1233
Total cold run time: 299908 ms
Total hot run time: 192150 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.29 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f8e2b0b1c0f4c03b39b2f62952208a13dff476e9, data reload: false

query1	0.04	0.03	0.03
query2	0.12	0.10	0.11
query3	0.24	0.19	0.19
query4	1.59	0.19	0.19
query5	0.59	0.58	0.61
query6	1.19	0.71	0.72
query7	0.03	0.02	0.01
query8	0.04	0.03	0.04
query9	0.58	0.52	0.54
query10	0.60	0.59	0.58
query11	0.16	0.10	0.10
query12	0.14	0.12	0.11
query13	0.62	0.59	0.61
query14	2.67	2.70	2.83
query15	0.92	0.85	0.86
query16	0.39	0.38	0.39
query17	1.09	1.03	1.02
query18	0.21	0.19	0.19
query19	1.89	1.95	1.79
query20	0.02	0.01	0.01
query21	15.37	0.91	0.55
query22	0.74	1.16	0.59
query23	15.04	1.35	0.60
query24	7.02	1.05	1.60
query25	0.53	0.34	0.10
query26	0.59	0.16	0.14
query27	0.05	0.05	0.06
query28	9.87	0.88	0.42
query29	12.56	3.98	3.33
query30	0.24	0.09	0.06
query31	2.81	0.58	0.39
query32	3.22	0.57	0.47
query33	3.01	3.04	3.03
query34	15.82	5.11	4.51
query35	4.49	4.59	4.49
query36	0.67	0.50	0.51
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.13	0.13
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 105.64 s
Total hot run time: 31.29 s

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34337 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit abf344f2edf33356b9c4f0831ba7f528cc091f9a, data reload: false

------ Round 1 ----------------------------------
q1	24033	5126	5084	5084
q2	2070	305	168	168
q3	10403	1303	709	709
q4	10224	1034	538	538
q5	7546	2375	2384	2375
q6	185	161	133	133
q7	926	750	627	627
q8	9332	1349	1163	1163
q9	6754	5152	5160	5152
q10	6860	2317	1910	1910
q11	482	282	263	263
q12	361	370	222	222
q13	17806	3784	3071	3071
q14	237	248	211	211
q15	529	487	483	483
q16	630	607	593	593
q17	593	884	344	344
q18	7540	7086	7135	7086
q19	1894	968	575	575
q20	315	322	188	188
q21	4063	3452	2508	2508
q22	1037	1035	934	934
Total cold run time: 113820 ms
Total hot run time: 34337 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5307	5172	5258	5172
q2	238	333	232	232
q3	2140	2668	2291	2291
q4	1496	1844	1399	1399
q5	4484	4468	4477	4468
q6	217	171	130	130
q7	1995	1965	1773	1773
q8	2626	2617	2639	2617
q9	7346	7186	7027	7027
q10	3017	3223	2768	2768
q11	583	504	487	487
q12	693	787	639	639
q13	3511	3934	3269	3269
q14	294	312	291	291
q15	520	465	483	465
q16	660	673	641	641
q17	1164	1560	1404	1404
q18	7958	7607	7607	7607
q19	832	842	972	842
q20	1907	1972	1851	1851
q21	5418	4944	4880	4880
q22	1092	1045	1022	1022
Total cold run time: 53498 ms
Total hot run time: 51275 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193934 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit abf344f2edf33356b9c4f0831ba7f528cc091f9a, data reload: false

query1	1389	1086	1047	1047
query2	6315	1950	1912	1912
query3	10994	4598	4603	4598
query4	25524	23691	23338	23338
query5	4767	667	481	481
query6	301	193	182	182
query7	3985	503	274	274
query8	294	230	239	230
query9	8530	2612	2606	2606
query10	479	321	268	268
query11	15328	15231	14924	14924
query12	158	112	105	105
query13	1556	535	395	395
query14	9813	8336	6615	6615
query15	207	191	176	176
query16	7025	635	493	493
query17	1276	741	599	599
query18	1354	386	314	314
query19	219	199	170	170
query20	129	132	127	127
query21	209	128	105	105
query22	4415	4463	4314	4314
query23	34638	33516	33498	33498
query24	8226	2429	2416	2416
query25	538	462	408	408
query26	1195	277	154	154
query27	2097	506	323	323
query28	4055	2476	2461	2461
query29	669	559	430	430
query30	273	219	192	192
query31	949	886	797	797
query32	70	61	62	61
query33	573	367	344	344
query34	812	863	534	534
query35	805	820	793	793
query36	981	1003	910	910
query37	123	101	76	76
query38	4151	4369	4184	4184
query39	1496	1448	1418	1418
query40	214	116	116	116
query41	53	51	49	49
query42	126	108	112	108
query43	470	521	495	495
query44	1361	818	810	810
query45	214	175	165	165
query46	844	1047	653	653
query47	1856	1877	1779	1779
query48	394	414	304	304
query49	802	514	422	422
query50	727	754	423	423
query51	4300	4307	4313	4307
query52	105	110	100	100
query53	232	260	178	178
query54	495	514	412	412
query55	80	93	90	90
query56	275	279	267	267
query57	1184	1176	1083	1083
query58	252	245	247	245
query59	2702	2758	2625	2625
query60	281	284	257	257
query61	127	125	123	123
query62	755	771	685	685
query63	234	191	185	185
query64	4113	1057	739	739
query65	4612	4468	4473	4468
query66	1247	398	302	302
query67	15866	15442	15291	15291
query68	9737	879	501	501
query69	478	302	261	261
query70	1193	1038	1098	1038
query71	498	287	264	264
query72	5609	5098	5168	5098
query73	733	652	344	344
query74	9017	8944	8808	8808
query75	4329	3220	2708	2708
query76	3748	1205	748	748
query77	996	368	282	282
query78	10051	10192	9271	9271
query79	2402	860	591	591
query80	647	521	449	449
query81	472	258	222	222
query82	716	127	93	93
query83	172	171	156	156
query84	244	89	71	71
query85	786	358	317	317
query86	370	302	298	298
query87	4755	4394	4399	4394
query88	3634	2240	2249	2240
query89	419	314	273	273
query90	1862	211	217	211
query91	137	136	110	110
query92	78	59	56	56
query93	1887	1061	566	566
query94	655	395	286	286
query95	365	285	257	257
query96	493	553	280	280
query97	3266	3448	3319	3319
query98	226	211	200	200
query99	1347	1414	1269	1269
Total cold run time: 281161 ms
Total hot run time: 193934 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.25 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit abf344f2edf33356b9c4f0831ba7f528cc091f9a, data reload: false

query1	0.04	0.04	0.03
query2	0.13	0.10	0.10
query3	0.24	0.19	0.19
query4	1.59	0.19	0.20
query5	0.58	0.56	0.59
query6	1.20	0.73	0.72
query7	0.02	0.02	0.02
query8	0.05	0.03	0.03
query9	0.58	0.53	0.50
query10	0.57	0.60	0.55
query11	0.16	0.10	0.11
query12	0.14	0.11	0.11
query13	0.62	0.60	0.60
query14	2.82	2.70	2.80
query15	0.93	0.85	0.85
query16	0.39	0.38	0.38
query17	0.99	1.02	1.07
query18	0.21	0.19	0.20
query19	1.90	1.95	1.86
query20	0.02	0.02	0.01
query21	15.34	0.92	0.53
query22	0.76	1.23	0.67
query23	14.95	1.33	0.63
query24	6.76	1.86	0.91
query25	0.49	0.22	0.10
query26	0.61	0.15	0.13
query27	0.05	0.05	0.05
query28	10.10	0.87	0.44
query29	12.63	3.99	3.36
query30	0.25	0.10	0.06
query31	2.83	0.59	0.39
query32	3.28	0.55	0.46
query33	2.96	3.02	3.06
query34	15.83	5.17	4.51
query35	4.52	4.55	4.47
query36	0.69	0.52	0.49
query37	0.08	0.06	0.06
query38	0.04	0.04	0.04
query39	0.03	0.03	0.03
query40	0.18	0.13	0.14
query41	0.09	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 105.72 s
Total hot run time: 31.25 s

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34049 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3d3b0e319a817047dbac4628b8d4811e4e513a0b, data reload: false

------ Round 1 ----------------------------------
q1	24403	5002	4992	4992
q2	2047	294	178	178
q3	10402	1249	732	732
q4	10228	1050	534	534
q5	7537	2431	2301	2301
q6	185	166	131	131
q7	924	731	614	614
q8	9323	1313	1009	1009
q9	6796	5173	5164	5164
q10	6804	2294	1890	1890
q11	488	280	246	246
q12	353	367	212	212
q13	17771	3617	3062	3062
q14	232	220	210	210
q15	537	486	481	481
q16	632	610	602	602
q17	582	858	332	332
q18	7687	7150	7126	7126
q19	1215	953	551	551
q20	319	329	199	199
q21	3977	2732	2519	2519
q22	1048	1046	964	964
Total cold run time: 113490 ms
Total hot run time: 34049 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5091	5075	5093	5075
q2	243	330	222	222
q3	2155	2691	2295	2295
q4	1494	1838	1413	1413
q5	4440	4470	4413	4413
q6	215	169	128	128
q7	1987	1899	1816	1816
q8	2667	2581	2569	2569
q9	7333	7092	7083	7083
q10	2973	3209	2762	2762
q11	572	506	495	495
q12	707	809	664	664
q13	3427	3970	3304	3304
q14	300	301	282	282
q15	524	490	465	465
q16	650	697	660	660
q17	1138	1561	1386	1386
q18	7721	7572	7301	7301
q19	809	859	1113	859
q20	1974	2038	1958	1958
q21	5448	4953	4792	4792
q22	1090	1071	1015	1015
Total cold run time: 52958 ms
Total hot run time: 50957 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 170152 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3d3b0e319a817047dbac4628b8d4811e4e513a0b, data reload: false

============================================
query1	1373	1088	1062	1062
query2	6174	1916	1911	1911
query3	10992	4660	4689	4660
query4	query5	6036	523	508	508
query6	448	214	187	187
query7	5731	274	284	274
query8	333	266	227	227
query9	9635	2563	2599	2563
query10	571	307	257	257
query11	15823	15168	14946	14946
query12	164	109	102	102
query13	1544	525	383	383
query14	11658	7085	6243	6243
query15	206	195	172	172
query16	7256	655	449	449
query17	1019	724	576	576
query18	1629	393	312	312
query19	320	181	159	159
query20	127	114	115	114
query21	208	122	100	100
query22	4296	4226	4417	4226
query23	34198	33528	33791	33528
query24	5582	2425	2452	2425
query25	498	464	409	409
query26	721	268	145	145
query27	2154	500	328	328
query28	2989	2496	2429	2429
query29	710	577	431	431
query30	271	221	194	194
query31	929	883	775	775
query32	75	63	63	63
query33	448	370	314	314
query34	739	837	502	502
query35	789	860	773	773
query36	954	994	893	893
query37	165	100	76	76
query38	4229	4352	4148	4148
query39	1468	1434	1452	1434
query40	219	121	110	110
query41	56	51	51	51
query42	130	108	101	101
query43	509	518	479	479
query44	1316	818	806	806
query45	181	173	196	173
query46	836	1033	659	659
query47	1831	1884	1771	1771
query48	397	405	316	316
query49	737	541	440	440
query50	713	755	407	407
query51	4268	4301	4330	4301
query52	115	105	102	102
query53	229	255	184	184
query54	487	512	418	418
query55	88	79	77	77
query56	275	288	269	269
query57	1166	1168	1108	1108
query58	273	260	261	260
query59	2725	2759	2588	2588
query60	315	288	299	288
query61	192	130	152	130
query62	728	702	655	655
query63	213	180	175	175
query64	2095	1017	671	671
query65	4376	4310	4305	4305
query66	736	391	295	295
query67	15620	15381	15282	15282
query68	5201	872	512	512
query69	481	297	266	266
query70	1180	1082	1113	1082
query71	420	279	261	261
query72	5909	5367	5347	5347
query73	846	663	439	439
query74	8998	8937	8845	8845
query75	3498	3225	2728	2728
query76	3415	1178	735	735
query77	556	358	283	283
query78	10149	10152	9226	9226
query79	2245	801	566	566
query80	781	512	417	417
query81	505	258	226	226
query82	1210	130	96	96
query83	295	177	164	164
query84	291	89	78	78
query85	782	367	310	310
query86	426	306	289	289
query87	4471	4573	4417	4417
query88	3565	2294	2374	2294
query89	437	316	272	272
query90	2110	209	218	209
query91	151	145	112	112
query92	71	63	55	55
query93	3184	1053	578	578
query94	679	409	314	314
query95	353	271	264	264
query96	490	562	276	276
query97	3414	3423	3289	3289
query98	247	200	203	200
query99	1475	1412	1283	1283
Total cold run time: 251123 ms
Total hot run time: 170152 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.75 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3d3b0e319a817047dbac4628b8d4811e4e513a0b, data reload: false

query1	0.03	0.03	0.03
query2	0.12	0.10	0.10
query3	0.25	0.19	0.20
query4	1.60	0.20	0.20
query5	0.59	0.59	0.59
query6	1.21	0.72	0.73
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.57	0.53	0.51
query10	0.58	0.58	0.58
query11	0.16	0.11	0.11
query12	0.14	0.11	0.12
query13	0.62	0.60	0.60
query14	2.81	2.72	2.69
query15	0.92	0.85	0.85
query16	0.39	0.36	0.36
query17	0.99	1.02	1.00
query18	0.21	0.19	0.19
query19	1.89	1.91	1.89
query20	0.01	0.01	0.02
query21	15.35	0.88	0.53
query22	0.77	1.13	0.65
query23	15.00	1.37	0.63
query24	6.87	1.88	0.37
query25	0.29	0.18	0.13
query26	0.69	0.16	0.14
query27	0.06	0.05	0.04
query28	8.43	0.88	0.41
query29	12.52	4.00	3.33
query30	0.26	0.09	0.06
query31	2.83	0.57	0.38
query32	3.23	0.55	0.46
query33	3.00	3.00	3.02
query34	15.79	5.12	4.52
query35	4.56	4.53	4.51
query36	0.66	0.49	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.14	0.13
query41	0.09	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 103.96 s
Total hot run time: 30.75 s

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34273 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6a7ee374eef198ddbed7892173dda377696ba8cb, data reload: false

------ Round 1 ----------------------------------
q1	24131	5093	5052	5052
q2	2042	292	190	190
q3	10396	1244	684	684
q4	10225	1019	518	518
q5	7532	2441	2311	2311
q6	190	171	135	135
q7	928	725	613	613
q8	9324	1327	1159	1159
q9	6928	5129	5120	5120
q10	6807	2295	1898	1898
q11	495	274	265	265
q12	354	348	212	212
q13	17763	3689	3076	3076
q14	223	217	206	206
q15	539	482	475	475
q16	637	615	592	592
q17	591	873	359	359
q18	7567	7282	7131	7131
q19	1220	944	596	596
q20	322	327	202	202
q21	4178	2718	2514	2514
q22	1027	1000	965	965
Total cold run time: 113419 ms
Total hot run time: 34273 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5153	5158	5120	5120
q2	244	332	233	233
q3	2220	2673	2272	2272
q4	1408	1821	1400	1400
q5	4371	4368	4411	4368
q6	214	176	130	130
q7	2025	1937	1783	1783
q8	2621	2601	2584	2584
q9	7194	7224	7061	7061
q10	2947	3246	2730	2730
q11	581	509	503	503
q12	677	735	684	684
q13	3508	3902	3274	3274
q14	286	290	300	290
q15	534	466	481	466
q16	697	696	631	631
q17	1169	1567	1366	1366
q18	7813	7700	7551	7551
q19	821	840	948	840
q20	1949	2083	1837	1837
q21	5320	4920	4948	4920
q22	1091	1027	1018	1018
Total cold run time: 52843 ms
Total hot run time: 51061 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193267 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6a7ee374eef198ddbed7892173dda377696ba8cb, data reload: false

query1	1395	1060	1050	1050
query2	6200	1897	1867	1867
query3	11018	4578	4570	4570
query4	52572	26105	22949	22949
query5	5107	599	487	487
query6	331	195	191	191
query7	4853	486	267	267
query8	301	238	222	222
query9	5518	2573	2582	2573
query10	421	325	264	264
query11	15210	15202	14846	14846
query12	169	115	102	102
query13	1035	531	419	419
query14	10474	6563	7301	6563
query15	205	214	184	184
query16	7073	677	495	495
query17	1100	748	585	585
query18	1370	421	326	326
query19	203	208	169	169
query20	127	126	125	125
query21	220	127	102	102
query22	4508	4477	4389	4389
query23	34531	33263	33378	33263
query24	5833	2457	2457	2457
query25	473	450	393	393
query26	706	247	142	142
query27	1864	491	326	326
query28	3107	2482	2439	2439
query29	559	547	437	437
query30	277	224	189	189
query31	840	893	772	772
query32	71	58	62	58
query33	485	387	316	316
query34	791	859	513	513
query35	802	843	757	757
query36	955	996	917	917
query37	166	102	75	75
query38	4208	4332	4314	4314
query39	1489	1418	1432	1418
query40	206	125	108	108
query41	52	52	51	51
query42	127	107	107	107
query43	490	494	481	481
query44	1352	850	816	816
query45	187	179	168	168
query46	873	1039	657	657
query47	1856	1849	1798	1798
query48	395	417	306	306
query49	715	521	433	433
query50	690	744	423	423
query51	4321	4289	4269	4269
query52	106	106	107	106
query53	232	262	174	174
query54	486	519	425	425
query55	85	89	84	84
query56	311	282	271	271
query57	1214	1202	1122	1122
query58	249	242	238	238
query59	2680	2933	2551	2551
query60	295	266	267	266
query61	136	126	123	123
query62	739	751	725	725
query63	239	190	184	184
query64	2394	1056	720	720
query65	4538	4450	4446	4446
query66	788	406	339	339
query67	15946	15658	15279	15279
query68	6957	873	515	515
query69	537	306	261	261
query70	1163	1140	1112	1112
query71	513	295	256	256
query72	5907	5196	5288	5196
query73	1504	690	343	343
query74	8952	9210	8787	8787
query75	3926	3250	2735	2735
query76	4171	1183	752	752
query77	669	361	277	277
query78	10009	10176	9256	9256
query79	2452	781	566	566
query80	610	521	429	429
query81	480	253	219	219
query82	576	124	95	95
query83	173	172	218	172
query84	288	92	70	70
query85	763	362	311	311
query86	365	297	284	284
query87	4630	4502	4391	4391
query88	3810	2242	2210	2210
query89	404	307	275	275
query90	1807	201	204	201
query91	140	140	110	110
query92	71	56	60	56
query93	1787	1052	573	573
query94	663	418	294	294
query95	343	272	260	260
query96	488	564	270	270
query97	3317	3394	3300	3300
query98	233	203	206	203
query99	1406	1386	1287	1287
Total cold run time: 297383 ms
Total hot run time: 193267 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.98 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6a7ee374eef198ddbed7892173dda377696ba8cb, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.11	0.10
query3	0.25	0.19	0.19
query4	1.59	0.18	0.20
query5	0.56	0.55	0.55
query6	1.18	0.72	0.74
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.58	0.52	0.52
query10	0.59	0.59	0.56
query11	0.16	0.11	0.11
query12	0.14	0.11	0.11
query13	0.62	0.60	0.61
query14	2.67	2.67	2.71
query15	0.91	0.85	0.85
query16	0.38	0.37	0.38
query17	1.00	1.00	1.03
query18	0.21	0.19	0.19
query19	2.02	1.88	1.83
query20	0.01	0.02	0.01
query21	15.35	0.95	0.55
query22	0.74	1.32	0.77
query23	15.09	1.40	0.66
query24	8.23	0.74	0.66
query25	0.50	0.14	0.17
query26	0.81	0.16	0.13
query27	0.05	0.04	0.04
query28	8.44	0.85	0.42
query29	12.60	3.95	3.31
query30	0.24	0.09	0.06
query31	2.83	0.58	0.39
query32	3.23	0.57	0.46
query33	3.03	3.04	3.05
query34	15.72	5.11	4.43
query35	4.50	4.51	4.49
query36	0.70	0.49	0.48
query37	0.08	0.06	0.07
query38	0.05	0.04	0.04
query39	0.04	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.03	0.02
Total cold run time: 105.63 s
Total hot run time: 30.98 s

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34210 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9a7f00b1d722e89d22c695c5e3ed3a2d1db36f1f, data reload: false

------ Round 1 ----------------------------------
q1	24394	5060	5045	5045
q2	2041	351	212	212
q3	10320	1253	673	673
q4	10228	997	521	521
q5	7523	2307	2351	2307
q6	183	158	130	130
q7	916	784	601	601
q8	9331	1274	1116	1116
q9	7025	5113	5303	5113
q10	6847	2303	1924	1924
q11	471	284	271	271
q12	379	364	228	228
q13	17787	3676	3080	3080
q14	223	233	205	205
q15	546	494	478	478
q16	630	609	582	582
q17	603	851	344	344
q18	7672	7265	7212	7212
q19	1429	960	570	570
q20	313	321	194	194
q21	3951	2739	2458	2458
q22	1035	1015	946	946
Total cold run time: 113847 ms
Total hot run time: 34210 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5195	5139	5101	5101
q2	242	331	238	238
q3	2128	2661	2273	2273
q4	1444	1773	1413	1413
q5	4400	4401	4457	4401
q6	214	168	128	128
q7	1971	1922	1776	1776
q8	2608	2544	2507	2507
q9	7248	7278	6934	6934
q10	3072	3193	2785	2785
q11	584	496	490	490
q12	700	751	610	610
q13	3509	3879	3256	3256
q14	282	299	269	269
q15	529	491	483	483
q16	683	681	657	657
q17	1142	1631	1341	1341
q18	7716	7675	7566	7566
q19	834	847	960	847
q20	2023	2044	1849	1849
q21	5225	4932	4873	4873
q22	1132	1038	1025	1025
Total cold run time: 52881 ms
Total hot run time: 50822 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195192 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9a7f00b1d722e89d22c695c5e3ed3a2d1db36f1f, data reload: false

query1	1450	1061	1062	1061
query2	6155	1936	1894	1894
query3	11048	4484	4472	4472
query4	54295	25909	23147	23147
query5	5088	633	469	469
query6	326	203	190	190
query7	4889	493	283	283
query8	321	270	238	238
query9	5667	2599	2602	2599
query10	457	303	258	258
query11	15320	15187	15184	15184
query12	167	114	105	105
query13	1047	529	401	401
query14	10879	7254	7902	7254
query15	204	201	177	177
query16	6996	673	482	482
query17	1117	721	600	600
query18	1474	384	318	318
query19	211	188	182	182
query20	138	119	128	119
query21	211	123	109	109
query22	4274	4386	4221	4221
query23	34278	33452	33539	33452
query24	5674	2551	2458	2458
query25	476	476	387	387
query26	676	279	153	153
query27	1870	512	326	326
query28	2824	2459	2454	2454
query29	585	643	457	457
query30	272	220	192	192
query31	892	854	800	800
query32	72	65	66	65
query33	465	353	329	329
query34	772	874	512	512
query35	827	858	780	780
query36	979	1005	913	913
query37	125	99	80	80
query38	4188	4454	4172	4172
query39	1500	1476	1432	1432
query40	207	120	107	107
query41	50	51	55	51
query42	119	114	104	104
query43	497	517	468	468
query44	1375	850	829	829
query45	185	175	175	175
query46	897	1054	664	664
query47	1816	1882	1796	1796
query48	390	436	330	330
query49	719	552	444	444
query50	738	796	440	440
query51	4286	4315	4258	4258
query52	113	119	105	105
query53	235	269	187	187
query54	534	521	445	445
query55	89	92	84	84
query56	301	291	290	290
query57	1249	1235	1147	1147
query58	256	249	263	249
query59	2610	2759	2809	2759
query60	285	309	263	263
query61	133	132	126	126
query62	784	734	656	656
query63	224	197	189	189
query64	1473	1064	703	703
query65	4593	4487	4438	4438
query66	743	392	300	300
query67	15769	15596	15448	15448
query68	7140	831	512	512
query69	538	311	271	271
query70	1216	1144	1098	1098
query71	522	305	269	269
query72	5512	5262	5371	5262
query73	1440	686	346	346
query74	9016	9176	8844	8844
query75	4245	3267	2771	2771
query76	4283	1190	765	765
query77	737	384	283	283
query78	10084	10253	9259	9259
query79	2670	839	572	572
query80	706	524	471	471
query81	493	261	223	223
query82	667	130	94	94
query83	239	169	152	152
query84	279	105	71	71
query85	815	363	313	313
query86	368	312	293	293
query87	4589	4599	4462	4462
query88	3450	2252	2243	2243
query89	413	321	275	275
query90	1942	214	215	214
query91	146	150	113	113
query92	75	58	55	55
query93	1666	1078	586	586
query94	667	411	305	305
query95	359	277	263	263
query96	494	566	277	277
query97	3383	3415	3273	3273
query98	235	202	204	202
query99	1456	1393	1275	1275
Total cold run time: 298724 ms
Total hot run time: 195192 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.94 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9a7f00b1d722e89d22c695c5e3ed3a2d1db36f1f, data reload: false

query1	0.04	0.04	0.03
query2	0.12	0.11	0.10
query3	0.25	0.18	0.20
query4	1.59	0.19	0.19
query5	0.60	0.59	0.59
query6	1.18	0.73	0.72
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.61	0.55	0.55
query10	0.60	0.61	0.60
query11	0.16	0.11	0.11
query12	0.15	0.11	0.11
query13	0.61	0.61	0.61
query14	2.69	2.83	2.81
query15	0.94	0.86	0.86
query16	0.38	0.37	0.38
query17	1.06	1.05	1.05
query18	0.21	0.19	0.19
query19	1.92	1.98	1.86
query20	0.01	0.02	0.01
query21	15.36	0.91	0.56
query22	0.77	1.21	0.71
query23	14.85	1.40	0.59
query24	7.07	1.14	1.75
query25	0.55	0.19	0.22
query26	0.56	0.16	0.14
query27	0.05	0.05	0.05
query28	9.84	0.91	0.43
query29	12.59	3.92	3.26
query30	0.25	0.08	0.06
query31	2.83	0.60	0.38
query32	3.23	0.54	0.46
query33	2.98	3.11	3.11
query34	16.14	5.12	4.53
query35	4.53	4.54	4.56
query36	0.66	0.50	0.48
query37	0.09	0.06	0.06
query38	0.06	0.04	0.04
query39	0.04	0.02	0.02
query40	0.18	0.13	0.13
query41	0.08	0.03	0.02
query42	0.03	0.03	0.02
query43	0.03	0.04	0.03
Total cold run time: 105.95 s
Total hot run time: 31.94 s

@yx-keith
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34327 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9a7f00b1d722e89d22c695c5e3ed3a2d1db36f1f, data reload: false

------ Round 1 ----------------------------------
q1	24008	5084	5250	5084
q2	2041	305	193	193
q3	10363	1208	667	667
q4	10245	990	549	549
q5	7547	2388	2375	2375
q6	184	161	130	130
q7	934	736	598	598
q8	9319	1291	1150	1150
q9	6891	5183	5157	5157
q10	6864	2295	1873	1873
q11	466	280	258	258
q12	360	354	224	224
q13	17780	3697	3097	3097
q14	222	222	213	213
q15	526	485	468	468
q16	637	624	588	588
q17	587	849	354	354
q18	7527	7233	7193	7193
q19	1447	942	541	541
q20	315	315	191	191
q21	4081	3438	2452	2452
q22	1073	983	972	972
Total cold run time: 113417 ms
Total hot run time: 34327 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5180	5201	5158	5158
q2	237	322	224	224
q3	2168	2668	2285	2285
q4	1397	1877	1383	1383
q5	4423	4328	4405	4328
q6	227	170	123	123
q7	1975	1906	1825	1825
q8	2580	2744	2636	2636
q9	7179	7192	6964	6964
q10	3040	3176	2752	2752
q11	584	522	490	490
q12	672	740	610	610
q13	3544	3882	3277	3277
q14	294	298	267	267
q15	526	486	496	486
q16	667	681	666	666
q17	1136	1632	1341	1341
q18	7818	7567	7559	7559
q19	843	828	856	828
q20	1974	1990	1841	1841
q21	5301	4961	4925	4925
q22	1107	1092	1024	1024
Total cold run time: 52872 ms
Total hot run time: 50992 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192658 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9a7f00b1d722e89d22c695c5e3ed3a2d1db36f1f, data reload: false

query1	1380	1054	1067	1054
query2	6185	1896	1870	1870
query3	11001	4444	4500	4444
query4	26010	23792	22890	22890
query5	4867	661	466	466
query6	295	187	186	186
query7	3990	494	273	273
query8	284	245	226	226
query9	8509	2588	2567	2567
query10	469	307	234	234
query11	15529	15149	14777	14777
query12	153	107	104	104
query13	1535	509	403	403
query14	9771	6598	7787	6598
query15	201	188	167	167
query16	7709	656	518	518
query17	1152	782	599	599
query18	2034	431	329	329
query19	204	205	174	174
query20	127	125	128	125
query21	215	122	105	105
query22	4384	4559	4341	4341
query23	34285	33317	33222	33222
query24	8048	2383	2485	2383
query25	502	462	395	395
query26	1157	272	143	143
query27	2225	496	319	319
query28	4490	2442	2410	2410
query29	696	581	521	521
query30	285	225	199	199
query31	938	874	815	815
query32	73	61	65	61
query33	534	363	324	324
query34	798	869	508	508
query35	864	858	788	788
query36	994	993	914	914
query37	122	105	79	79
query38	4153	4318	4186	4186
query39	1500	1430	1432	1430
query40	206	119	100	100
query41	56	53	52	52
query42	121	102	123	102
query43	517	501	483	483
query44	1347	804	820	804
query45	188	185	165	165
query46	850	1026	649	649
query47	1781	1866	1762	1762
query48	394	415	307	307
query49	773	530	403	403
query50	706	756	426	426
query51	4303	4347	4265	4265
query52	115	108	98	98
query53	234	262	178	178
query54	513	514	427	427
query55	80	79	78	78
query56	269	293	258	258
query57	1184	1176	1119	1119
query58	260	243	231	231
query59	2674	2870	2593	2593
query60	294	293	262	262
query61	130	144	128	128
query62	786	722	681	681
query63	221	179	184	179
query64	3994	1076	695	695
query65	4518	4470	4437	4437
query66	953	400	297	297
query67	16336	15478	15293	15293
query68	9686	884	502	502
query69	483	300	262	262
query70	1206	1145	1107	1107
query71	467	291	262	262
query72	5191	4928	4908	4908
query73	702	543	354	354
query74	9007	9184	8977	8977
query75	4325	3237	2737	2737
query76	4153	1193	755	755
query77	1014	364	342	342
query78	9788	10116	9305	9305
query79	4633	800	548	548
query80	603	516	461	461
query81	463	250	218	218
query82	251	123	95	95
query83	160	167	163	163
query84	284	98	75	75
query85	847	357	310	310
query86	327	306	279	279
query87	4487	4497	4281	4281
query88	2826	2259	2232	2232
query89	432	305	278	278
query90	2110	209	207	207
query91	132	137	115	115
query92	74	57	56	56
query93	2705	1023	591	591
query94	681	420	291	291
query95	357	267	267	267
query96	500	558	271	271
query97	3256	3426	3308	3308
query98	230	206	201	201
query99	1367	1386	1281	1281
Total cold run time: 284218 ms
Total hot run time: 192658 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.84 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9a7f00b1d722e89d22c695c5e3ed3a2d1db36f1f, data reload: false

query1	0.04	0.04	0.04
query2	0.13	0.10	0.11
query3	0.24	0.19	0.19
query4	1.59	0.19	0.19
query5	0.60	0.58	0.59
query6	1.20	0.71	0.73
query7	0.02	0.02	0.02
query8	0.04	0.04	0.04
query9	0.59	0.52	0.50
query10	0.57	0.57	0.57
query11	0.16	0.11	0.11
query12	0.14	0.11	0.11
query13	0.61	0.60	0.61
query14	2.80	2.70	2.72
query15	0.93	0.84	0.84
query16	0.39	0.37	0.38
query17	1.01	1.01	1.05
query18	0.21	0.19	0.20
query19	1.90	1.89	1.86
query20	0.01	0.01	0.02
query21	15.35	0.88	0.55
query22	0.75	1.20	0.74
query23	14.87	1.37	0.60
query24	6.76	1.52	1.49
query25	0.50	0.27	0.11
query26	0.54	0.16	0.12
query27	0.05	0.05	0.05
query28	10.09	0.85	0.42
query29	12.56	3.98	3.32
query30	0.24	0.09	0.06
query31	2.84	0.59	0.39
query32	3.24	0.56	0.46
query33	2.98	3.05	3.01
query34	15.90	5.11	4.52
query35	4.49	4.47	4.50
query36	0.67	0.48	0.49
query37	0.08	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.17	0.13	0.12
query41	0.08	0.03	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.49 s
Total hot run time: 31.84 s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Mar 21, 2025
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants