Skip to content

branch-3.1: [fix](iceberg) Add missing iceberg-aws dependency to metadata scanner #55741#55743

Merged
morrySnow merged 1 commit intobranch-3.1from
auto-pick-55741-branch-3.1
Sep 8, 2025
Merged

branch-3.1: [fix](iceberg) Add missing iceberg-aws dependency to metadata scanner #55741#55743
morrySnow merged 1 commit intobranch-3.1from
auto-pick-55741-branch-3.1

Conversation

@github-actions
Copy link
Contributor

@github-actions github-actions bot commented Sep 6, 2025

Cherry-picked from #55741

…#55741)

## Issue
  Fixed `NoSuchMethodException` when accessing S3-based Iceberg tables:
- `Cannot create org.apache.iceberg.aws.ApacheHttpClientConfigurations`
  - Missing `ApacheHttpClientConfigurations.create` method
@github-actions github-actions bot requested a review from morrySnow as a code owner September 6, 2025 17:10
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring closed this Sep 6, 2025
@dataroaring dataroaring reopened this Sep 6, 2025
@hello-stephen
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32662 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 18a660a34f3fb080b20aa534ccb4cc2153cde7d3, data reload: false

------ Round 1 ----------------------------------
q1	17605	5461	5601	5461
q2	2018	387	278	278
q3	11700	1215	743	743
q4	10365	862	465	465
q5	9642	2401	2133	2133
q6	192	163	133	133
q7	898	733	619	619
q8	9339	1423	1194	1194
q9	5379	4948	4844	4844
q10	6758	2267	1806	1806
q11	472	292	265	265
q12	343	364	208	208
q13	17790	3565	2975	2975
q14	228	217	214	214
q15	526	460	456	456
q16	415	428	369	369
q17	609	863	368	368
q18	6724	6342	6349	6342
q19	1209	947	564	564
q20	331	348	204	204
q21	2862	2161	2026	2026
q22	1045	995	1006	995
Total cold run time: 106450 ms
Total hot run time: 32662 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5523	5552	5538	5538
q2	237	328	231	231
q3	2352	2653	2287	2287
q4	1370	1768	1351	1351
q5	4395	4939	4960	4939
q6	169	165	127	127
q7	2021	1982	1808	1808
q8	2660	2826	2680	2680
q9	7169	7174	7216	7174
q10	3001	3330	2670	2670
q11	566	518	495	495
q12	681	771	604	604
q13	3392	3768	3147	3147
q14	269	296	260	260
q15	523	498	473	473
q16	439	476	427	427
q17	1252	1714	1263	1263
q18	7635	7397	7564	7397
q19	867	1171	1130	1130
q20	2050	2089	1931	1931
q21	5421	5005	4666	4666
q22	1107	1073	1038	1038
Total cold run time: 53099 ms
Total hot run time: 51636 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191937 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 18a660a34f3fb080b20aa534ccb4cc2153cde7d3, data reload: false

query1	951	405	410	405
query2	6201	1939	1931	1931
query3	8684	196	196	196
query4	33450	24377	23280	23280
query5	4477	618	450	450
query6	305	198	173	173
query7	4241	511	320	320
query8	298	235	225	225
query9	9499	2615	2596	2596
query10	512	327	264	264
query11	18063	15138	15250	15138
query12	157	110	105	105
query13	1542	576	416	416
query14	9226	7310	7186	7186
query15	246	190	179	179
query16	8092	655	527	527
query17	1595	797	598	598
query18	2151	419	333	333
query19	238	193	176	176
query20	126	124	118	118
query21	208	131	111	111
query22	4475	4511	4336	4336
query23	35195	33873	33799	33799
query24	7668	2695	2721	2695
query25	532	498	446	446
query26	919	315	174	174
query27	2019	485	371	371
query28	5258	2237	2204	2204
query29	703	615	477	477
query30	247	194	171	171
query31	1021	964	856	856
query32	87	65	73	65
query33	529	390	316	316
query34	805	867	520	520
query35	804	809	722	722
query36	1008	1069	936	936
query37	106	95	68	68
query38	4069	4049	3965	3965
query39	1541	1485	1508	1485
query40	234	126	118	118
query41	52	49	46	46
query42	129	110	109	109
query43	533	521	482	482
query44	1387	833	824	824
query45	194	180	179	179
query46	937	1097	696	696
query47	1932	1958	1917	1917
query48	414	460	360	360
query49	737	500	425	425
query50	704	712	437	437
query51	7405	7317	7134	7134
query52	103	104	88	88
query53	235	265	199	199
query54	544	558	477	477
query55	78	85	88	85
query56	268	273	254	254
query57	1279	1271	1207	1207
query58	233	223	225	223
query59	3067	3337	3008	3008
query60	298	282	281	281
query61	127	121	117	117
query62	808	754	688	688
query63	251	202	195	195
query64	3657	1015	649	649
query65	3365	3309	3343	3309
query66	867	437	314	314
query67	16652	16064	15587	15587
query68	7715	846	548	548
query69	498	305	267	267
query70	1203	1154	1112	1112
query71	425	308	278	278
query72	5204	3736	3802	3736
query73	668	773	352	352
query74	10332	9181	8969	8969
query75	3965	3147	2682	2682
query76	3566	1180	769	769
query77	777	385	282	282
query78	10225	10458	9687	9687
query79	4585	896	601	601
query80	714	540	443	443
query81	502	255	223	223
query82	242	113	86	86
query83	158	161	151	151
query84	285	104	92	92
query85	742	365	309	309
query86	355	318	305	305
query87	4326	4364	4200	4200
query88	3870	2390	2413	2390
query89	445	337	293	293
query90	2066	196	192	192
query91	133	153	107	107
query92	62	54	53	53
query93	2812	907	539	539
query94	676	416	264	264
query95	342	286	278	278
query96	492	619	283	283
query97	3135	3251	3157	3157
query98	225	214	196	196
query99	1487	1397	1352	1352
Total cold run time: 295970 ms
Total hot run time: 191937 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.23 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 18a660a34f3fb080b20aa534ccb4cc2153cde7d3, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.03	0.03
query3	0.23	0.07	0.07
query4	1.63	0.11	0.10
query5	0.51	0.50	0.53
query6	1.14	0.73	0.73
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.58	0.51	0.50
query10	0.55	0.56	0.55
query11	0.15	0.11	0.11
query12	0.14	0.11	0.11
query13	0.62	0.60	0.60
query14	0.78	0.79	0.79
query15	0.84	0.84	0.82
query16	0.40	0.41	0.38
query17	1.06	0.99	1.00
query18	0.25	0.22	0.22
query19	1.97	1.82	1.86
query20	0.02	0.01	0.01
query21	15.39	0.90	0.60
query22	0.74	0.80	0.67
query23	15.06	1.42	0.59
query24	3.87	0.95	0.20
query25	0.08	0.13	0.07
query26	0.37	0.16	0.15
query27	0.05	0.05	0.05
query28	13.21	1.06	0.44
query29	12.58	3.96	3.32
query30	0.25	0.10	0.06
query31	2.83	0.61	0.38
query32	3.22	0.54	0.46
query33	2.99	3.04	3.00
query34	16.43	5.13	4.53
query35	4.62	4.56	4.52
query36	0.62	0.49	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.14	0.14
query41	0.08	0.03	0.02
query42	0.04	0.02	0.03
query43	0.04	0.03	0.02
Total cold run time: 103.82 s
Total hot run time: 28.23 s

@morrySnow morrySnow merged commit 9251979 into branch-3.1 Sep 8, 2025
23 checks passed
@github-actions github-actions bot deleted the auto-pick-55741-branch-3.1 branch September 8, 2025 02:56
@morrySnow morrySnow mentioned this pull request Sep 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

Comments