Skip to content

brach-3.1: [Fix](SIMDJson) manually selecting the implementation for different CPU architecture#53894

Merged
morrySnow merged 1 commit intoapache:branch-3.1from
eldenmoon:3.1-pick-7d15c93
Jul 28, 2025
Merged

brach-3.1: [Fix](SIMDJson) manually selecting the implementation for different CPU architecture#53894
morrySnow merged 1 commit intoapache:branch-3.1from
eldenmoon:3.1-pick-7d15c93

Conversation

@eldenmoon
Copy link
Member

cherry-pick #52732

@eldenmoon eldenmoon requested a review from morrySnow as a code owner July 25, 2025 06:38
@Thearas
Copy link
Contributor

Thearas commented Jul 25, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@eldenmoon
Copy link
Member Author

run buildall

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 0.00% (0/17) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 45.26% (12572/27778)
Line Coverage 36.15% (111949/309701)
Region Coverage 35.21% (57879/164404)
Branch Coverage 32.37% (31456/97186)

@eldenmoon
Copy link
Member Author

run performance

@doris-robot
Copy link

TPC-H: Total hot run time: 32371 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8f450529f314e50eb9c5cdc556ef63267744d168, data reload: false

------ Round 1 ----------------------------------
q1	17621	5490	5416	5416
q2	2057	275	166	166
q3	10703	1241	765	765
q4	10230	872	447	447
q5	8212	2358	2096	2096
q6	185	164	135	135
q7	906	735	603	603
q8	9316	1376	1135	1135
q9	5321	4908	4875	4875
q10	6779	2256	1822	1822
q11	476	275	266	266
q12	331	349	205	205
q13	17778	3618	3021	3021
q14	234	233	209	209
q15	528	476	474	474
q16	425	439	376	376
q17	594	835	349	349
q18	6809	6263	6400	6263
q19	1256	1079	556	556
q20	327	347	205	205
q21	2832	2239	2018	2018
q22	1038	1002	969	969
Total cold run time: 103958 ms
Total hot run time: 32371 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5534	5448	5514	5448
q2	232	335	233	233
q3	2203	2671	2335	2335
q4	1312	1810	1325	1325
q5	4398	4794	4951	4794
q6	171	163	130	130
q7	2070	1965	1849	1849
q8	2694	2786	2701	2701
q9	7240	7126	7261	7126
q10	3074	3294	2828	2828
q11	578	513	500	500
q12	670	706	592	592
q13	3415	3820	3188	3188
q14	277	304	284	284
q15	507	471	460	460
q16	448	499	445	445
q17	1200	1728	1255	1255
q18	7644	7711	7652	7652
q19	828	1180	1134	1134
q20	2055	2110	1886	1886
q21	5460	5003	4693	4693
q22	1058	1050	1004	1004
Total cold run time: 53068 ms
Total hot run time: 51862 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197052 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8f450529f314e50eb9c5cdc556ef63267744d168, data reload: false

query1	1318	913	899	899
query2	6225	2000	1984	1984
query3	10923	4380	4608	4380
query4	33146	23694	23352	23352
query5	3707	604	465	465
query6	274	186	170	170
query7	3993	477	309	309
query8	296	242	234	234
query9	9420	2604	2587	2587
query10	461	325	259	259
query11	18020	15473	15175	15175
query12	158	108	102	102
query13	1552	529	414	414
query14	9658	6646	7699	6646
query15	223	199	187	187
query16	7863	674	472	472
query17	1649	762	619	619
query18	2114	431	329	329
query19	222	194	178	178
query20	127	124	118	118
query21	205	124	105	105
query22	4587	4486	4349	4349
query23	35203	34556	34505	34505
query24	7424	2705	2731	2705
query25	490	488	430	430
query26	1049	253	176	176
query27	2172	472	364	364
query28	5341	2207	2189	2189
query29	605	556	475	475
query30	253	196	170	170
query31	991	918	839	839
query32	72	63	57	57
query33	570	373	311	311
query34	741	867	530	530
query35	789	827	749	749
query36	1013	1082	976	976
query37	104	86	65	65
query38	4084	3960	3992	3960
query39	1513	1473	1471	1471
query40	203	120	115	115
query41	50	50	49	49
query42	127	109	105	105
query43	521	536	498	498
query44	1314	846	829	829
query45	181	175	172	172
query46	882	1045	671	671
query47	1948	2002	1896	1896
query48	407	436	335	335
query49	768	489	444	444
query50	659	727	423	423
query51	7410	7340	7310	7310
query52	98	98	89	89
query53	230	261	188	188
query54	538	546	471	471
query55	77	78	80	78
query56	282	275	261	261
query57	1259	1253	1224	1224
query58	243	219	229	219
query59	3093	3280	3102	3102
query60	290	290	274	274
query61	136	113	113	113
query62	814	760	705	705
query63	245	201	190	190
query64	3801	1021	651	651
query65	3379	3324	3271	3271
query66	973	426	313	313
query67	16007	15782	15681	15681
query68	7054	856	572	572
query69	489	297	271	271
query70	1201	1186	1085	1085
query71	407	296	276	276
query72	5904	3683	3783	3683
query73	635	737	354	354
query74	10543	9152	8981	8981
query75	3200	3151	2677	2677
query76	3120	1178	773	773
query77	513	370	275	275
query78	10382	10404	9630	9630
query79	3636	841	575	575
query80	694	513	451	451
query81	509	273	216	216
query82	638	121	88	88
query83	157	160	146	146
query84	245	100	80	80
query85	783	377	296	296
query86	394	317	300	300
query87	4447	4364	4226	4226
query88	4944	2435	2413	2413
query89	417	330	290	290
query90	1748	191	187	187
query91	133	147	109	109
query92	70	57	54	54
query93	2229	893	543	543
query94	681	418	307	307
query95	339	271	265	265
query96	484	607	279	279
query97	3199	3257	3158	3158
query98	235	222	203	203
query99	1568	1382	1307	1307
Total cold run time: 295488 ms
Total hot run time: 197052 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.9 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8f450529f314e50eb9c5cdc556ef63267744d168, data reload: false

query1	0.04	0.03	0.02
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.62	0.11	0.10
query5	0.53	0.51	0.52
query6	1.13	0.73	0.72
query7	0.02	0.02	0.02
query8	0.05	0.03	0.03
query9	0.58	0.52	0.52
query10	0.56	0.55	0.55
query11	0.14	0.11	0.10
query12	0.14	0.11	0.11
query13	0.62	0.60	0.60
query14	0.78	0.80	0.81
query15	0.85	0.82	0.82
query16	0.38	0.38	0.41
query17	1.03	1.00	1.05
query18	0.24	0.22	0.21
query19	1.99	1.86	1.87
query20	0.02	0.01	0.01
query21	15.37	0.96	0.57
query22	0.74	0.90	0.59
query23	15.08	1.39	0.55
query24	3.59	1.02	1.97
query25	0.21	0.18	0.06
query26	0.29	0.16	0.13
query27	0.06	0.05	0.05
query28	13.71	0.95	0.43
query29	12.57	4.02	3.32
query30	0.24	0.08	0.06
query31	2.83	0.60	0.38
query32	3.23	0.54	0.45
query33	2.98	3.01	3.06
query34	16.45	5.17	4.51
query35	4.56	4.55	4.57
query36	0.62	0.48	0.47
query37	0.09	0.06	0.06
query38	0.05	0.03	0.03
query39	0.04	0.02	0.03
query40	0.17	0.13	0.12
query41	0.08	0.03	0.02
query42	0.03	0.03	0.02
query43	0.03	0.03	0.02
Total cold run time: 104.04 s
Total hot run time: 28.9 s

@morrySnow morrySnow merged commit 6e85737 into apache:branch-3.1 Jul 28, 2025
21 of 22 checks passed
eldenmoon added a commit to eldenmoon/incubator-doris that referenced this pull request Jul 30, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

Comments