Skip to content

[fix](jni)Add hadoop-mapreduce-client-core dependencies#58217

Merged
CalvinKirs merged 15 commits intoapache:masterfrom
CalvinKirs:master-paimon-mr
Nov 24, 2025
Merged

[fix](jni)Add hadoop-mapreduce-client-core dependencies#58217
CalvinKirs merged 15 commits intoapache:masterfrom
CalvinKirs:master-paimon-mr

Conversation

@CalvinKirs
Copy link
Member

Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.JobConf
	at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:445)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:587)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:520)
W 2025-11-20 18:43:57,798 67719 status.h:439] meet error status: [JNI_ERROR]NoClassDefFoundError: org/apache/hadoop/mapred/JobConf | CAUSED BY: ClassNotFoundException: org.apache.hadoop.mapred.JobConf

@Thearas
Copy link
Contributor

Thearas commented Nov 21, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@CalvinKirs
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 34080 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a85f0ab095201ea34fbed4cb317915cf6ecd2863, data reload: false

------ Round 1 ----------------------------------
q1	17684	5082	4878	4878
q2	2202	301	198	198
q3	10299	1274	722	722
q4	10242	884	353	353
q5	7449	2309	2317	2309
q6	183	172	139	139
q7	914	765	615	615
q8	9350	1262	1106	1106
q9	7014	5355	5343	5343
q10	7407	2219	1798	1798
q11	481	305	286	286
q12	336	362	234	234
q13	17818	3632	3030	3030
q14	225	235	215	215
q15	580	505	499	499
q16	1027	975	927	927
q17	574	859	359	359
q18	7848	7049	7097	7049
q19	1119	947	538	538
q20	358	337	231	231
q21	3779	2494	2297	2297
q22	1057	1015	954	954
Total cold run time: 107946 ms
Total hot run time: 34080 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4921	4931	4894	4894
q2	323	375	321	321
q3	2133	2670	2264	2264
q4	1320	1738	1282	1282
q5	4149	4392	4395	4392
q6	206	175	130	130
q7	2023	1885	1820	1820
q8	2565	2552	2509	2509
q9	7670	7519	7585	7519
q10	3071	3191	2894	2894
q11	569	613	498	498
q12	636	732	626	626
q13	3491	3776	3329	3329
q14	279	290	289	289
q15	559	521	521	521
q16	1121	1099	1075	1075
q17	1128	1517	1421	1421
q18	7887	7597	7623	7597
q19	795	851	999	851
q20	1922	1970	1806	1806
q21	4729	4378	4222	4222
q22	1049	1032	994	994
Total cold run time: 52546 ms
Total hot run time: 51254 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 185984 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a85f0ab095201ea34fbed4cb317915cf6ecd2863, data reload: false

query1	1270	405	396	396
query2	6727	1646	1657	1646
query3	6906	236	223	223
query4	26080	23222	22692	22692
query5	4456	638	474	474
query6	383	246	226	226
query7	4680	491	302	302
query8	379	264	253	253
query9	8713	2556	2580	2556
query10	517	334	288	288
query11	15544	14965	14857	14857
query12	179	120	112	112
query13	1690	599	455	455
query14	10826	8992	8983	8983
query15	194	182	164	164
query16	7424	673	489	489
query17	1228	755	608	608
query18	1989	412	318	318
query19	215	194	173	173
query20	129	123	117	117
query21	260	132	116	116
query22	4056	4078	3944	3944
query23	33660	32929	33072	32929
query24	8403	2390	2355	2355
query25	589	523	475	475
query26	1243	270	162	162
query27	2763	496	363	363
query28	4371	2175	2161	2161
query29	843	621	507	507
query30	314	224	201	201
query31	914	792	720	720
query32	90	74	77	74
query33	609	391	331	331
query34	782	852	531	531
query35	781	839	735	735
query36	927	985	904	904
query37	139	116	89	89
query38	3469	3511	3476	3476
query39	1482	1397	1395	1395
query40	268	126	117	117
query41	64	63	67	63
query42	129	112	105	105
query43	453	487	473	473
query44	1228	756	754	754
query45	182	181	172	172
query46	877	986	636	636
query47	1784	1769	1729	1729
query48	394	421	320	320
query49	794	500	403	403
query50	648	676	413	413
query51	3975	3951	3833	3833
query52	109	112	107	107
query53	243	267	196	196
query54	313	283	271	271
query55	86	81	84	81
query56	323	314	304	304
query57	1186	1193	1115	1115
query58	279	269	271	269
query59	2474	2626	2504	2504
query60	339	340	340	340
query61	164	158	158	158
query62	771	700	669	669
query63	229	194	196	194
query64	4508	1167	875	875
query65	4043	3950	3927	3927
query66	1139	419	325	325
query67	15030	14881	14783	14783
query68	7647	935	634	634
query69	483	313	284	284
query70	1307	1270	1223	1223
query71	422	341	314	314
query72	5640	4904	4873	4873
query73	631	571	357	357
query74	9208	9051	8650	8650
query75	3333	3333	2782	2782
query76	3313	1152	718	718
query77	505	407	333	333
query78	9473	9653	8834	8834
query79	1035	842	583	583
query80	787	573	497	497
query81	500	256	225	225
query82	410	159	135	135
query83	266	262	249	249
query84	260	118	93	93
query85	895	494	443	443
query86	324	315	288	288
query87	3691	3696	3593	3593
query88	2824	2234	2236	2234
query89	372	333	284	284
query90	1809	212	211	211
query91	166	164	137	137
query92	70	69	62	62
query93	1188	1038	692	692
query94	732	440	324	324
query95	409	322	312	312
query96	493	552	275	275
query97	2893	2925	2885	2885
query98	220	215	214	214
query99	1306	1392	1310	1310
Total cold run time: 269868 ms
Total hot run time: 185984 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 27.37 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a85f0ab095201ea34fbed4cb317915cf6ecd2863, data reload: false

query1	0.05	0.05	0.06
query2	0.09	0.05	0.05
query3	0.26	0.08	0.08
query4	1.61	0.11	0.11
query5	0.26	0.26	0.25
query6	1.20	0.65	0.65
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.58	0.52	0.50
query10	0.57	0.57	0.57
query11	0.17	0.11	0.11
query12	0.14	0.12	0.11
query13	0.63	0.61	0.60
query14	1.00	1.00	1.00
query15	0.83	0.82	0.84
query16	0.39	0.38	0.39
query17	1.02	1.03	1.01
query18	0.22	0.19	0.20
query19	1.92	1.81	1.81
query20	0.02	0.01	0.01
query21	15.43	0.19	0.13
query22	5.11	0.07	0.05
query23	15.67	0.26	0.09
query24	2.72	0.70	0.43
query25	0.09	0.06	0.06
query26	0.14	0.14	0.13
query27	0.06	0.06	0.05
query28	4.58	1.22	0.94
query29	12.59	3.88	3.22
query30	0.28	0.13	0.12
query31	2.82	0.58	0.38
query32	3.22	0.54	0.46
query33	3.08	3.01	3.09
query34	15.76	5.12	4.53
query35	4.54	4.56	4.57
query36	0.70	0.50	0.49
query37	0.10	0.07	0.07
query38	0.06	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.15	0.13
query41	0.09	0.03	0.03
query42	0.04	0.03	0.03
query43	0.05	0.04	0.03
Total cold run time: 98.38 s
Total hot run time: 27.37 s

morningman
morningman previously approved these changes Nov 21, 2025
Copy link
Contributor

@morningman morningman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Nov 21, 2025
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage `` 🎉
Increment coverage report
Complete coverage report

zy-kkk
zy-kkk previously approved these changes Nov 21, 2025
@CalvinKirs CalvinKirs dismissed stale reviews from zy-kkk and morningman via 9f792ba November 21, 2025 10:49
@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Nov 21, 2025
@morningman
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 35199 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9f792ba753451a0af84fc2b186b6bb8db5e29129, data reload: false

------ Round 1 ----------------------------------
q1	17635	5120	4959	4959
q2	2106	307	198	198
q3	10225	1343	746	746
q4	10242	970	370	370
q5	7490	2401	2355	2355
q6	181	171	135	135
q7	891	768	633	633
q8	9341	1346	1156	1156
q9	7169	5431	5429	5429
q10	6814	2224	1823	1823
q11	493	309	292	292
q12	335	367	225	225
q13	17759	3674	3074	3074
q14	230	242	217	217
q15	565	517	498	498
q16	1022	995	937	937
q17	570	870	363	363
q18	7570	7109	7090	7090
q19	1093	968	561	561
q20	355	349	241	241
q21	3791	3263	2915	2915
q22	1046	1030	982	982
Total cold run time: 106923 ms
Total hot run time: 35199 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4991	5037	5022	5022
q2	329	409	306	306
q3	2196	2689	2255	2255
q4	1382	1781	1328	1328
q5	4242	4660	4608	4608
q6	219	173	131	131
q7	2103	1979	1792	1792
q8	2606	2531	2566	2531
q9	7584	7686	7638	7638
q10	3055	3303	2771	2771
q11	586	519	574	519
q12	720	761	692	692
q13	3569	3972	3416	3416
q14	286	287	263	263
q15	586	521	511	511
q16	1086	1125	1070	1070
q17	1212	1602	1406	1406
q18	8017	7779	7720	7720
q19	769	806	872	806
q20	2080	2067	1964	1964
q21	5045	4420	4340	4340
q22	1061	1050	978	978
Total cold run time: 53724 ms
Total hot run time: 52067 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187499 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9f792ba753451a0af84fc2b186b6bb8db5e29129, data reload: false

query1	1032	427	389	389
query2	6564	1699	1716	1699
query3	6755	229	227	227
query4	26174	23007	22767	22767
query5	4471	607	463	463
query6	353	248	220	220
query7	4652	485	297	297
query8	325	270	245	245
query9	8706	2584	2599	2584
query10	518	353	292	292
query11	15683	15119	14807	14807
query12	188	123	116	116
query13	1692	584	459	459
query14	10998	9106	9230	9106
query15	219	187	182	182
query16	7621	688	483	483
query17	1266	793	660	660
query18	2033	456	333	333
query19	221	214	184	184
query20	134	126	122	122
query21	217	145	118	118
query22	4054	4101	3937	3937
query23	34199	33222	33158	33158
query24	8421	2385	2410	2385
query25	626	541	477	477
query26	1245	286	167	167
query27	2722	501	371	371
query28	4390	2201	2185	2185
query29	813	646	522	522
query30	307	222	204	204
query31	935	794	724	724
query32	87	74	73	73
query33	605	397	380	380
query34	792	871	535	535
query35	821	818	711	711
query36	928	1019	868	868
query37	117	114	83	83
query38	3554	3468	3462	3462
query39	1466	1413	1400	1400
query40	217	124	119	119
query41	64	63	61	61
query42	122	113	112	112
query43	491	499	470	470
query44	1243	785	786	785
query45	187	183	174	174
query46	880	987	644	644
query47	1783	1795	1741	1741
query48	395	415	344	344
query49	765	495	416	416
query50	639	670	408	408
query51	3987	3941	3896	3896
query52	111	114	111	111
query53	247	265	197	197
query54	305	302	272	272
query55	97	87	83	83
query56	329	299	337	299
query57	1172	1196	1122	1122
query58	285	269	278	269
query59	2585	2600	2556	2556
query60	346	345	317	317
query61	158	165	164	164
query62	803	723	638	638
query63	230	194	197	194
query64	4503	1177	906	906
query65	4008	3938	3940	3938
query66	1124	433	338	338
query67	15170	15138	14985	14985
query68	8263	954	635	635
query69	483	322	292	292
query70	1378	1243	1277	1243
query71	480	341	314	314
query72	5908	4993	5141	4993
query73	673	578	370	370
query74	9161	8863	8920	8863
query75	4025	3307	2808	2808
query76	3783	1142	741	741
query77	801	397	324	324
query78	9520	9595	8834	8834
query79	3168	828	600	600
query80	703	561	509	509
query81	488	265	239	239
query82	457	168	131	131
query83	299	263	255	255
query84	302	112	96	96
query85	902	486	446	446
query86	339	336	287	287
query87	3727	3669	3654	3654
query88	3076	2230	2214	2214
query89	441	318	286	286
query90	1954	222	220	220
query91	168	171	137	137
query92	83	71	60	60
query93	2130	1013	682	682
query94	725	436	332	332
query95	396	325	314	314
query96	484	579	277	277
query97	2948	2975	2888	2888
query98	259	229	217	217
query99	1450	1409	1284	1284
Total cold run time: 277124 ms
Total hot run time: 187499 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 27.67 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9f792ba753451a0af84fc2b186b6bb8db5e29129, data reload: false

query1	0.06	0.04	0.05
query2	0.09	0.05	0.05
query3	0.26	0.08	0.08
query4	1.61	0.12	0.10
query5	0.28	0.25	0.25
query6	1.18	0.65	0.65
query7	0.03	0.03	0.02
query8	0.06	0.04	0.05
query9	0.58	0.55	0.53
query10	0.58	0.57	0.58
query11	0.16	0.11	0.11
query12	0.15	0.12	0.12
query13	0.62	0.61	0.60
query14	1.01	0.99	1.00
query15	0.88	0.84	0.84
query16	0.40	0.40	0.39
query17	1.00	1.04	1.05
query18	0.21	0.20	0.20
query19	1.96	1.79	1.81
query20	0.02	0.01	0.01
query21	15.43	0.18	0.13
query22	5.10	0.07	0.05
query23	15.63	0.27	0.10
query24	2.35	0.52	0.42
query25	0.07	0.06	0.07
query26	0.15	0.13	0.13
query27	0.06	0.06	0.06
query28	3.68	1.16	0.93
query29	12.55	3.90	3.26
query30	0.28	0.14	0.11
query31	2.82	0.59	0.40
query32	3.23	0.55	0.47
query33	3.02	3.10	3.09
query34	15.91	5.21	4.61
query35	4.54	4.56	4.67
query36	0.68	0.51	0.50
query37	0.10	0.07	0.07
query38	0.07	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.14
query41	0.08	0.04	0.03
query42	0.04	0.03	0.03
query43	0.05	0.04	0.03
Total cold run time: 97.19 s
Total hot run time: 27.67 s

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage `` 🎉
Increment coverage report
Complete coverage report

@CalvinKirs
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 35179 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cd7122521e2c9b3caa99447878a080a76bc96804, data reload: false

------ Round 1 ----------------------------------
q1	17586	5101	4885	4885
q2	2013	314	199	199
q3	10263	1285	712	712
q4	10244	937	363	363
q5	7568	2368	2367	2367
q6	191	167	135	135
q7	936	778	634	634
q8	9361	1319	1056	1056
q9	7033	5370	5412	5370
q10	7045	2221	1787	1787
q11	501	293	277	277
q12	337	367	226	226
q13	17837	3717	3135	3135
q14	233	235	228	228
q15	567	519	516	516
q16	1039	1032	950	950
q17	633	857	385	385
q18	7588	7681	7860	7681
q19	1319	1023	549	549
q20	395	350	229	229
q21	4321	3377	2438	2438
q22	1165	1152	1057	1057
Total cold run time: 108175 ms
Total hot run time: 35179 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5277	5170	5154	5154
q2	319	400	351	351
q3	2399	2836	2621	2621
q4	1403	1822	1352	1352
q5	4560	4425	4491	4425
q6	206	170	130	130
q7	2001	1955	1755	1755
q8	2621	2714	2545	2545
q9	7477	7592	7285	7285
q10	2885	3092	2637	2637
q11	553	511	484	484
q12	608	723	539	539
q13	3199	3656	3020	3020
q14	282	284	254	254
q15	534	488	487	487
q16	1008	1049	1000	1000
q17	1093	1483	1297	1297
q18	7275	7016	7149	7016
q19	756	745	913	745
q20	1890	1947	1816	1816
q21	4726	4339	4298	4298
q22	1117	1038	973	973
Total cold run time: 52189 ms
Total hot run time: 50184 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186988 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cd7122521e2c9b3caa99447878a080a76bc96804, data reload: false

query1	1018	400	397	397
query2	6588	1657	1681	1657
query3	6749	224	227	224
query4	26213	23553	22754	22754
query5	4405	636	499	499
query6	350	255	232	232
query7	4649	502	299	299
query8	312	269	254	254
query9	8718	2601	2615	2601
query10	497	335	284	284
query11	15685	15359	14874	14874
query12	184	120	112	112
query13	1668	568	436	436
query14	11593	9032	9017	9017
query15	198	185	178	178
query16	7678	697	535	535
query17	1264	752	622	622
query18	2028	414	310	310
query19	206	200	177	177
query20	127	122	117	117
query21	212	136	118	118
query22	4125	4231	4087	4087
query23	33873	33118	32918	32918
query24	8358	2408	2416	2408
query25	636	544	481	481
query26	1261	282	165	165
query27	2722	496	363	363
query28	4416	2183	2164	2164
query29	802	642	511	511
query30	309	226	197	197
query31	929	791	726	726
query32	80	78	76	76
query33	619	390	340	340
query34	791	852	516	516
query35	800	824	750	750
query36	950	988	924	924
query37	132	115	92	92
query38	3526	3494	3423	3423
query39	1515	1421	1434	1421
query40	229	132	121	121
query41	69	69	65	65
query42	132	117	114	114
query43	491	490	466	466
query44	1245	778	779	778
query45	189	181	175	175
query46	885	995	651	651
query47	1800	1796	1740	1740
query48	398	426	339	339
query49	807	520	423	423
query50	656	699	411	411
query51	3921	3936	3877	3877
query52	115	112	108	108
query53	239	276	209	209
query54	333	306	292	292
query55	137	89	93	89
query56	348	321	333	321
query57	1180	1169	1116	1116
query58	279	281	259	259
query59	2497	2612	2551	2551
query60	351	342	358	342
query61	164	153	155	153
query62	793	707	627	627
query63	236	196	195	195
query64	4435	1155	859	859
query65	4027	3935	3928	3928
query66	1086	434	346	346
query67	15300	15019	14898	14898
query68	8500	957	624	624
query69	553	320	306	306
query70	1283	1276	1279	1276
query71	497	346	324	324
query72	5888	4891	4816	4816
query73	692	580	358	358
query74	8836	8970	8812	8812
query75	3972	3311	2784	2784
query76	3782	1148	732	732
query77	834	395	324	324
query78	9575	9678	8865	8865
query79	1994	879	609	609
query80	654	589	502	502
query81	481	255	229	229
query82	424	170	135	135
query83	269	266	255	255
query84	259	117	93	93
query85	927	487	448	448
query86	347	301	297	297
query87	3720	3705	3591	3591
query88	3318	2256	2237	2237
query89	397	323	301	301
query90	1994	221	220	220
query91	171	191	143	143
query92	85	78	70	70
query93	1355	1021	687	687
query94	719	454	334	334
query95	411	328	320	320
query96	488	569	279	279
query97	2955	2977	2838	2838
query98	243	219	231	219
query99	1413	1369	1248	1248
Total cold run time: 275564 ms
Total hot run time: 186988 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 27.41 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cd7122521e2c9b3caa99447878a080a76bc96804, data reload: false

query1	0.05	0.05	0.05
query2	0.09	0.05	0.05
query3	0.26	0.08	0.08
query4	1.60	0.11	0.11
query5	0.27	0.26	0.25
query6	1.15	0.64	0.63
query7	0.03	0.02	0.02
query8	0.06	0.04	0.04
query9	0.57	0.51	0.52
query10	0.58	0.58	0.57
query11	0.16	0.11	0.11
query12	0.15	0.11	0.12
query13	0.62	0.61	0.61
query14	1.01	0.99	0.99
query15	0.85	0.83	0.84
query16	0.39	0.41	0.39
query17	1.02	1.02	1.05
query18	0.22	0.20	0.20
query19	1.90	1.88	1.82
query20	0.02	0.01	0.01
query21	15.44	0.19	0.12
query22	4.99	0.06	0.04
query23	15.67	0.25	0.11
query24	2.19	0.58	0.45
query25	0.07	0.06	0.05
query26	0.15	0.13	0.12
query27	0.07	0.06	0.05
query28	4.06	1.13	0.92
query29	12.54	3.85	3.21
query30	0.27	0.13	0.11
query31	2.83	0.59	0.39
query32	3.23	0.54	0.48
query33	2.96	3.04	3.05
query34	15.85	5.19	4.57
query35	4.50	4.56	4.54
query36	0.68	0.51	0.48
query37	0.11	0.07	0.06
query38	0.06	0.04	0.03
query39	0.04	0.03	0.02
query40	0.17	0.15	0.14
query41	0.08	0.03	0.03
query42	0.04	0.03	0.02
query43	0.04	0.04	0.03
Total cold run time: 97.04 s
Total hot run time: 27.41 s

@CalvinKirs
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 35707 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 81b1fafb4445016f81806ca15b738efa20460fa0, data reload: false

------ Round 1 ----------------------------------
q1	17650	5080	4900	4900
q2	2016	314	201	201
q3	10244	1255	692	692
q4	10227	888	371	371
q5	7588	2387	2344	2344
q6	189	171	139	139
q7	935	770	637	637
q8	9374	1339	1082	1082
q9	7209	5470	5504	5470
q10	6884	2225	1809	1809
q11	499	301	291	291
q12	351	364	222	222
q13	17788	3635	3014	3014
q14	232	234	216	216
q15	568	501	513	501
q16	1027	996	937	937
q17	594	865	383	383
q18	7347	7413	7637	7413
q19	1500	992	594	594
q20	377	365	228	228
q21	4223	3418	3227	3227
q22	1120	1075	1036	1036
Total cold run time: 107942 ms
Total hot run time: 35707 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5216	5169	5255	5169
q2	338	388	311	311
q3	2401	2865	2502	2502
q4	1437	1893	1427	1427
q5	4584	4445	4329	4329
q6	207	163	131	131
q7	2183	1869	1842	1842
q8	2536	2699	2550	2550
q9	7767	7572	7245	7245
q10	2910	3105	2656	2656
q11	570	498	502	498
q12	605	724	555	555
q13	3307	3678	3000	3000
q14	276	287	269	269
q15	544	497	484	484
q16	1009	1037	996	996
q17	1093	1512	1303	1303
q18	7216	7030	6911	6911
q19	789	867	888	867
q20	1946	1953	1811	1811
q21	4641	4287	4207	4207
q22	1061	1030	1008	1008
Total cold run time: 52636 ms
Total hot run time: 50071 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 186934 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 81b1fafb4445016f81806ca15b738efa20460fa0, data reload: false

query1	1031	430	399	399
query2	6547	1703	1655	1655
query3	6762	233	219	219
query4	25870	23018	23019	23018
query5	4556	620	465	465
query6	354	249	236	236
query7	4644	499	305	305
query8	323	270	267	267
query9	8762	2598	2582	2582
query10	487	334	297	297
query11	15599	15046	15004	15004
query12	193	117	112	112
query13	1672	571	470	470
query14	11174	9079	9243	9079
query15	199	196	174	174
query16	7695	702	534	534
query17	1251	772	641	641
query18	2036	428	347	347
query19	212	199	179	179
query20	142	132	123	123
query21	219	133	117	117
query22	4153	4030	3957	3957
query23	33805	32948	32932	32932
query24	8533	2364	2389	2364
query25	635	551	488	488
query26	1237	281	166	166
query27	2755	500	369	369
query28	4370	2199	2168	2168
query29	818	644	524	524
query30	292	224	197	197
query31	921	810	717	717
query32	86	71	69	69
query33	593	369	334	334
query34	801	852	514	514
query35	809	839	740	740
query36	942	996	878	878
query37	117	105	87	87
query38	3524	3580	3440	3440
query39	1495	1415	1491	1415
query40	221	127	117	117
query41	65	62	61	61
query42	124	110	108	108
query43	492	486	454	454
query44	1222	771	760	760
query45	178	180	172	172
query46	879	978	633	633
query47	1725	1774	1708	1708
query48	397	415	329	329
query49	754	508	458	458
query50	649	685	393	393
query51	3841	3884	3804	3804
query52	105	113	106	106
query53	241	267	197	197
query54	307	292	285	285
query55	88	89	83	83
query56	332	312	307	307
query57	1194	1190	1100	1100
query58	284	273	282	273
query59	2562	2606	2519	2519
query60	338	342	320	320
query61	165	166	167	166
query62	782	750	671	671
query63	220	192	194	192
query64	4469	1179	897	897
query65	4059	3921	3943	3921
query66	1093	430	334	334
query67	15180	15047	14779	14779
query68	8178	923	633	633
query69	482	326	278	278
query70	1296	1308	1276	1276
query71	443	328	316	316
query72	5857	4942	4940	4940
query73	647	593	364	364
query74	8968	9079	8650	8650
query75	3588	3311	2800	2800
query76	3510	1124	715	715
query77	776	413	331	331
query78	9450	9498	8800	8800
query79	2485	859	605	605
query80	768	597	513	513
query81	512	259	228	228
query82	478	169	132	132
query83	265	260	250	250
query84	250	113	91	91
query85	954	490	441	441
query86	389	303	297	297
query87	3760	3757	3668	3668
query88	3840	2253	2263	2253
query89	394	339	297	297
query90	1945	226	219	219
query91	175	159	137	137
query92	80	70	65	65
query93	2141	1005	678	678
query94	746	424	344	344
query95	409	329	312	312
query96	479	581	280	280
query97	2908	2962	2835	2835
query98	233	226	205	205
query99	1679	1407	1252	1252
Total cold run time: 275665 ms
Total hot run time: 186934 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 27.52 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 81b1fafb4445016f81806ca15b738efa20460fa0, data reload: false

query1	0.05	0.04	0.05
query2	0.09	0.05	0.05
query3	0.25	0.08	0.08
query4	1.61	0.12	0.11
query5	0.28	0.25	0.26
query6	1.18	0.64	0.65
query7	0.03	0.02	0.03
query8	0.06	0.04	0.04
query9	0.58	0.52	0.52
query10	0.57	0.58	0.57
query11	0.16	0.11	0.11
query12	0.15	0.11	0.12
query13	0.63	0.60	0.60
query14	1.01	1.00	1.00
query15	0.85	0.84	0.84
query16	0.40	0.40	0.39
query17	1.03	1.00	1.03
query18	0.23	0.20	0.20
query19	1.91	1.88	1.90
query20	0.02	0.01	0.01
query21	15.46	0.20	0.13
query22	5.09	0.07	0.05
query23	15.65	0.25	0.10
query24	3.29	1.22	0.31
query25	0.08	0.06	0.06
query26	0.14	0.13	0.14
query27	0.07	0.05	0.05
query28	3.94	1.13	0.96
query29	12.60	3.88	3.18
query30	0.27	0.15	0.12
query31	2.82	0.57	0.39
query32	3.23	0.56	0.47
query33	3.01	3.11	3.14
query34	15.82	5.20	4.60
query35	4.64	4.59	4.55
query36	0.67	0.52	0.50
query37	0.10	0.07	0.07
query38	0.06	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.15	0.13
query41	0.08	0.03	0.03
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 98.39 s
Total hot run time: 27.52 s

@CalvinKirs
Copy link
Member Author

run buildall

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Nov 22, 2025
@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 34070 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bd8ac540dcae410e2f6e244f483067b317190051, data reload: false

------ Round 1 ----------------------------------
q1	17583	5034	4924	4924
q2	2022	299	210	210
q3	10268	1249	701	701
q4	10226	874	368	368
q5	7481	2368	2328	2328
q6	177	169	133	133
q7	904	766	623	623
q8	9337	1315	1090	1090
q9	7023	5350	5284	5284
q10	6880	2204	1817	1817
q11	509	299	294	294
q12	355	371	215	215
q13	17855	3642	2979	2979
q14	218	242	216	216
q15	593	515	505	505
q16	973	1003	942	942
q17	585	849	355	355
q18	7375	7080	7059	7059
q19	1221	930	534	534
q20	340	329	230	230
q21	3631	2506	2277	2277
q22	1066	1030	986	986
Total cold run time: 106622 ms
Total hot run time: 34070 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4894	4914	4882	4882
q2	305	402	326	326
q3	2197	2678	2273	2273
q4	1356	1742	1325	1325
q5	4146	4133	4547	4133
q6	222	185	131	131
q7	2036	1902	1792	1792
q8	2630	2506	2606	2506
q9	7689	7504	7729	7504
q10	3105	3185	2788	2788
q11	588	525	514	514
q12	678	1062	598	598
q13	3476	3925	3317	3317
q14	280	305	277	277
q15	536	494	500	494
q16	1052	1088	1025	1025
q17	1191	1524	1370	1370
q18	8035	7642	7467	7467
q19	788	847	957	847
q20	2068	2019	1806	1806
q21	4673	4364	4298	4298
q22	1073	1070	989	989
Total cold run time: 53018 ms
Total hot run time: 50662 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 184523 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bd8ac540dcae410e2f6e244f483067b317190051, data reload: false

query1	1012	442	390	390
query2	6557	1682	1668	1668
query3	6761	216	222	216
query4	26045	23149	22799	22799
query5	4416	649	465	465
query6	330	231	224	224
query7	4654	495	294	294
query8	325	259	249	249
query9	8728	2553	2534	2534
query10	518	337	278	278
query11	15790	14938	14783	14783
query12	183	117	114	114
query13	1678	583	464	464
query14	10952	9171	9087	9087
query15	201	180	173	173
query16	7413	656	534	534
query17	1257	761	658	658
query18	2013	433	337	337
query19	225	208	185	185
query20	130	130	123	123
query21	218	132	117	117
query22	4100	4180	4178	4178
query23	33728	33185	33225	33185
query24	8412	2386	2398	2386
query25	645	548	480	480
query26	1237	286	160	160
query27	2737	498	359	359
query28	4406	2169	2165	2165
query29	845	640	524	524
query30	303	228	200	200
query31	924	811	709	709
query32	83	72	73	72
query33	615	377	333	333
query34	786	845	532	532
query35	856	819	748	748
query36	955	996	879	879
query37	119	114	91	91
query38	3512	3496	3421	3421
query39	1480	1405	1405	1405
query40	225	126	113	113
query41	64	60	63	60
query42	126	111	108	108
query43	480	476	449	449
query44	1234	783	764	764
query45	186	179	173	173
query46	882	985	632	632
query47	1741	1806	1725	1725
query48	382	430	321	321
query49	772	469	417	417
query50	650	680	425	425
query51	3939	3942	3869	3869
query52	106	110	111	110
query53	235	267	193	193
query54	308	291	272	272
query55	89	82	87	82
query56	295	331	302	302
query57	1192	1178	1131	1131
query58	281	268	287	268
query59	2502	2755	2462	2462
query60	335	368	324	324
query61	159	152	157	152
query62	773	710	666	666
query63	224	194	189	189
query64	4471	1171	877	877
query65	4032	3952	3917	3917
query66	1152	443	320	320
query67	15248	15206	14839	14839
query68	8335	950	633	633
query69	475	319	296	296
query70	1274	1234	1236	1234
query71	467	340	317	317
query72	5885	4967	2654	2654
query73	710	590	368	368
query74	8765	9172	8754	8754
query75	4033	3287	2831	2831
query76	3765	1116	728	728
query77	800	409	311	311
query78	9650	9510	8818	8818
query79	2400	840	600	600
query80	673	570	507	507
query81	481	254	223	223
query82	463	161	135	135
query83	299	259	247	247
query84	301	108	97	97
query85	951	472	429	429
query86	353	312	282	282
query87	3744	3692	3559	3559
query88	3399	2216	2207	2207
query89	376	325	298	298
query90	1992	215	215	215
query91	165	157	137	137
query92	85	68	63	63
query93	1885	1020	683	683
query94	708	442	332	332
query95	401	315	317	315
query96	482	564	277	277
query97	2920	2994	2824	2824
query98	234	212	209	209
query99	1412	1381	1261	1261
Total cold run time: 275115 ms
Total hot run time: 184523 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 27.29 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bd8ac540dcae410e2f6e244f483067b317190051, data reload: false

query1	0.06	0.06	0.05
query2	0.09	0.05	0.04
query3	0.25	0.08	0.08
query4	1.61	0.12	0.11
query5	0.27	0.26	0.25
query6	1.18	0.65	0.63
query7	0.03	0.02	0.02
query8	0.05	0.04	0.04
query9	0.58	0.52	0.52
query10	0.58	0.57	0.57
query11	0.17	0.11	0.12
query12	0.15	0.11	0.11
query13	0.61	0.59	0.59
query14	1.01	0.99	0.99
query15	0.85	0.83	0.83
query16	0.42	0.38	0.37
query17	1.01	1.01	0.99
query18	0.21	0.19	0.20
query19	1.87	1.81	1.78
query20	0.02	0.01	0.01
query21	15.46	0.17	0.13
query22	5.14	0.07	0.05
query23	15.67	0.25	0.10
query24	2.52	1.04	0.42
query25	0.06	0.06	0.07
query26	0.14	0.13	0.13
query27	0.07	0.06	0.05
query28	3.96	1.14	0.93
query29	12.54	3.90	3.28
query30	0.28	0.13	0.12
query31	2.82	0.58	0.38
query32	3.23	0.54	0.46
query33	3.04	3.08	2.99
query34	15.92	5.16	4.51
query35	4.53	4.53	4.55
query36	0.67	0.52	0.49
query37	0.12	0.07	0.06
query38	0.07	0.04	0.04
query39	0.03	0.03	0.03
query40	0.17	0.16	0.15
query41	0.08	0.04	0.03
query42	0.04	0.04	0.03
query43	0.04	0.04	0.04
Total cold run time: 97.62 s
Total hot run time: 27.29 s

@CalvinKirs CalvinKirs merged commit 67d6fa9 into apache:master Nov 24, 2025
26 of 28 checks passed
@CalvinKirs CalvinKirs deleted the master-paimon-mr branch November 24, 2025 02:16
github-actions bot pushed a commit that referenced this pull request Nov 24, 2025
```
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.JobConf
	at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:445)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:587)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:520)
W 2025-11-20 18:43:57,798 67719 status.h:439] meet error status: [JNI_ERROR]NoClassDefFoundError: org/apache/hadoop/mapred/JobConf | CAUSED BY: ClassNotFoundException: org.apache.hadoop.mapred.JobConf

```
github-actions bot pushed a commit that referenced this pull request Nov 24, 2025
```
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.JobConf
	at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:445)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:587)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:520)
W 2025-11-20 18:43:57,798 67719 status.h:439] meet error status: [JNI_ERROR]NoClassDefFoundError: org/apache/hadoop/mapred/JobConf | CAUSED BY: ClassNotFoundException: org.apache.hadoop.mapred.JobConf

```
yiguolei pushed a commit that referenced this pull request Nov 24, 2025
…58217 (#58267)

Cherry-picked from #58217

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
morningman pushed a commit that referenced this pull request Nov 24, 2025
…58217 (#58265)

Cherry-picked from #58217

Co-authored-by: Calvin Kirs <guoqiang@selectdb.com>
nagisa-kunhah pushed a commit to nagisa-kunhah/doris that referenced this pull request Dec 14, 2025
```
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapred.JobConf
	at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:445)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:587)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:520)
W 2025-11-20 18:43:57,798 67719 status.h:439] meet error status: [JNI_ERROR]NoClassDefFoundError: org/apache/hadoop/mapred/JobConf | CAUSED BY: ClassNotFoundException: org.apache.hadoop.mapred.JobConf

```
seawinde pushed a commit to seawinde/doris that referenced this pull request Jan 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. dev/3.1.3-merged dev/4.0.2-merged reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants

Comments