Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[improvement](statistics)Skip auto analyze when table row count is not fully reported. (return -1) (#42209) #42409

Merged
merged 1 commit into from
Oct 24, 2024

Conversation

Jibing-Li
Copy link
Contributor

backport: #42209

…t fully reported. (return -1) (apache#42209)

Skip auto analyze when table row count is not fully reported. Not fully
reported means row count is -1.
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@Jibing-Li Jibing-Li marked this pull request as ready for review October 24, 2024 09:26
@Jibing-Li
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40853 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6d4af2e5b4329ee0a4c4fceb1e4565d3613c6532, data reload: false

------ Round 1 ----------------------------------
q1	18067	7566	7385	7385
q2	2426	165	167	165
q3	11693	1134	1165	1134
q4	10294	786	766	766
q5	7722	2852	2774	2774
q6	240	155	154	154
q7	973	636	632	632
q8	9385	1908	2013	1908
q9	6577	6445	6414	6414
q10	7019	2270	2289	2270
q11	432	246	254	246
q12	404	221	223	221
q13	17773	2978	2999	2978
q14	240	224	217	217
q15	565	521	518	518
q16	666	607	604	604
q17	979	577	567	567
q18	7455	6646	6725	6646
q19	2723	951	998	951
q20	484	204	205	204
q21	3899	3135	3240	3135
q22	1093	989	964	964
Total cold run time: 111109 ms
Total hot run time: 40853 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7318	7300	7258	7258
q2	322	232	227	227
q3	2928	2738	2733	2733
q4	1890	1703	1653	1653
q5	5365	5437	5441	5437
q6	234	142	143	142
q7	2068	1683	1664	1664
q8	3221	3373	3383	3373
q9	8533	8501	8508	8501
q10	3449	3421	3384	3384
q11	573	467	486	467
q12	775	564	590	564
q13	16903	3006	2987	2987
q14	285	262	257	257
q15	556	534	515	515
q16	697	652	667	652
q17	1827	1585	1559	1559
q18	7858	7477	7288	7288
q19	1659	1569	1542	1542
q20	1985	1800	1820	1800
q21	5102	5098	4992	4992
q22	1068	987	969	969
Total cold run time: 74616 ms
Total hot run time: 57964 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189541 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6d4af2e5b4329ee0a4c4fceb1e4565d3613c6532, data reload: false

query1	993	371	369	369
query2	6518	2117	2024	2024
query3	6700	210	213	210
query4	33992	23354	23467	23354
query5	4336	462	469	462
query6	260	166	177	166
query7	4629	308	319	308
query8	249	210	212	210
query9	9530	2664	2645	2645
query10	490	277	288	277
query11	18037	15240	15335	15240
query12	151	100	96	96
query13	1622	406	405	405
query14	9687	7120	6711	6711
query15	244	174	171	171
query16	7989	476	515	476
query17	1629	574	560	560
query18	2083	307	310	307
query19	222	155	151	151
query20	120	106	105	105
query21	213	102	106	102
query22	4489	4316	4366	4316
query23	34527	33698	34403	33698
query24	12001	2805	2815	2805
query25	684	384	407	384
query26	1634	172	169	169
query27	2827	304	300	300
query28	8194	2468	2452	2452
query29	998	469	438	438
query30	324	163	154	154
query31	1037	786	793	786
query32	96	54	57	54
query33	770	296	295	295
query34	957	497	517	497
query35	842	742	749	742
query36	1110	936	939	936
query37	156	87	86	86
query38	3968	3840	3835	3835
query39	1466	1431	1411	1411
query40	296	101	103	101
query41	52	49	50	49
query42	116	93	97	93
query43	528	499	490	490
query44	1203	783	794	783
query45	198	167	167	167
query46	1114	704	694	694
query47	1890	1803	1806	1803
query48	466	362	359	359
query49	1172	389	379	379
query50	802	429	407	407
query51	6966	6982	6885	6885
query52	110	93	95	93
query53	254	185	181	181
query54	1179	480	458	458
query55	76	78	79	78
query56	277	260	259	259
query57	1185	1088	1105	1088
query58	245	252	238	238
query59	3138	2841	2868	2841
query60	309	282	273	273
query61	124	120	174	120
query62	815	651	664	651
query63	214	178	180	178
query64	5232	638	607	607
query65	3272	3188	3141	3141
query66	1218	305	299	299
query67	15817	15359	15292	15292
query68	4850	547	552	547
query69	547	280	296	280
query70	1136	1110	1128	1110
query71	416	297	267	267
query72	7711	3899	3951	3899
query73	751	352	346	346
query74	10276	8879	8869	8869
query75	3866	2678	2607	2607
query76	3821	866	856	856
query77	653	276	283	276
query78	10504	9747	9494	9494
query79	7537	570	584	570
query80	3251	447	443	443
query81	583	246	244	244
query82	1113	140	137	137
query83	333	134	135	134
query84	296	86	87	86
query85	2509	300	276	276
query86	497	286	303	286
query87	4427	4187	4256	4187
query88	5410	2356	2379	2356
query89	451	283	288	283
query90	2273	184	183	183
query91	199	141	144	141
query92	68	49	46	46
query93	5607	551	542	542
query94	1378	295	287	287
query95	355	248	248	248
query96	629	279	274	274
query97	3332	3059	3189	3059
query98	213	202	193	193
query99	1568	1325	1301	1301
Total cold run time: 320602 ms
Total hot run time: 189541 ms

@Jibing-Li Jibing-Li merged commit a233bea into apache:branch-3.0 Oct 24, 2024
22 of 24 checks passed
@Jibing-Li Jibing-Li deleted the nosample3.0 branch October 31, 2024 06:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants