[feat](outfile) support compression type for csv format in outfile and export#55392

morningman · 2025-08-27T17:51:47Z

What problem does this PR solve?

Outfile:

select * from tbl1
into outfile "file:///tmp/my_file_"
FORMAT AS CSV
PROPERTIES
(
    "compress_type" = "gz"
);

Export:

EXPORT TABLE test_export_csv TO "file:///tmp/test_"
PROPERTIES(
    "label" = "l4",
    "format" = "csv",
    "column_separator"=",",
    "compress_type" = "gz"
);

Now support "plain", "gz", "bz2", "snappyblock", "lz4block", "zstd"

Release note

None

Check List (For Author)

Test
- Regression test
- Unit Test
- Manual test (add detailed scripts or steps below)
- No need to test or manual test. Explain why:
  - This is a refactor/code format and no logic has been changed.
  - Previous test can cover this change.
  - No code files have been changed.
  - Other reason
Behavior changed:
- No.
- Yes.
Does this need documentation?
- No.
- Yes. [Glue]Add Iam role example doris-website#2912

Check List (For Reviewer who merge this PR)

Confirm the release note
Confirm test cases
Confirm document
Add branch pick label

Thearas · 2025-08-27T17:51:52Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

What problem was fixed (it's best to include specific error reporting information). How it was fixed.
Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
What features were added. Why was this function added?
Which code was refactored and why was this part of the code refactored?
Which functions were optimized and what is the difference before and after the optimization?

morningman · 2025-08-27T19:09:05Z

run buildall

hello-stephen · 2025-08-27T19:38:04Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	83.63% (1430/1710)
Line Coverage	67.22% (25429/37827)
Region Coverage	68.36% (12684/18556)
Branch Coverage	58.06% (6714/11564)

hello-stephen · 2025-08-27T20:20:52Z

FE UT Coverage Report

Increment line coverage 86.67% (13/15) 🎉
Increment coverage report
Complete coverage report

doris-robot · 2025-08-27T20:58:29Z

TPC-H: Total hot run time: 34035 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1b57ba39b34406f0790d9eba50dffd9b814b279c, data reload: false

------ Round 1 ----------------------------------
q1	17029	5291	5054	5054
q2	2008	362	211	211
q3	10001	1282	737	737
q4	10222	1029	539	539
q5	7656	2443	2358	2358
q6	195	166	138	138
q7	944	776	644	644
q8	9379	1342	1084	1084
q9	7173	5125	5157	5125
q10	6948	2403	1957	1957
q11	490	306	278	278
q12	353	369	230	230
q13	17787	3691	3031	3031
q14	247	248	224	224
q15	582	514	496	496
q16	433	430	398	398
q17	617	878	368	368
q18	7511	7168	7018	7018
q19	1095	966	557	557
q20	350	358	238	238
q21	3735	2551	2359	2359
q22	1086	1030	991	991
Total cold run time: 105841 ms
Total hot run time: 34035 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5154	5109	5092	5092
q2	248	329	233	233
q3	2155	2704	2299	2299
q4	1396	1767	1378	1378
q5	4235	4220	4610	4220
q6	214	177	135	135
q7	2053	2020	1883	1883
q8	2680	2684	2555	2555
q9	7449	7345	7465	7345
q10	3153	3278	2877	2877
q11	585	521	508	508
q12	686	762	645	645
q13	3489	3915	3394	3394
q14	283	310	277	277
q15	522	502	504	502
q16	462	472	425	425
q17	1249	1627	1440	1440
q18	7896	7667	7770	7667
q19	819	879	977	879
q20	2022	2059	1914	1914
q21	4829	4369	4341	4341
q22	1079	1044	1010	1010
Total cold run time: 52658 ms
Total hot run time: 51019 ms

doris-robot · 2025-08-27T21:10:20Z

TPC-DS: Total hot run time: 187301 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1b57ba39b34406f0790d9eba50dffd9b814b279c, data reload: false

query1	1060	467	415	415
query2	6556	1771	1773	1771
query3	6763	237	225	225
query4	26476	23645	23394	23394
query5	4420	665	495	495
query6	339	244	227	227
query7	4658	519	321	321
query8	317	263	267	263
query9	8687	2887	2902	2887
query10	513	352	311	311
query11	15899	15003	15131	15003
query12	174	125	121	121
query13	1678	577	439	439
query14	9376	5779	5730	5730
query15	231	198	176	176
query16	7539	651	468	468
query17	1222	784	631	631
query18	2042	433	330	330
query19	197	202	173	173
query20	137	135	122	122
query21	218	166	108	108
query22	4070	4281	4140	4140
query23	33777	33044	32889	32889
query24	8115	2367	2424	2367
query25	591	515	452	452
query26	1246	278	165	165
query27	2747	528	363	363
query28	4305	2291	2252	2252
query29	757	627	500	500
query30	296	231	207	207
query31	923	842	721	721
query32	93	89	84	84
query33	583	403	356	356
query34	792	857	522	522
query35	828	842	814	814
query36	987	1024	899	899
query37	122	108	92	92
query38	4069	4127	4038	4038
query39	1517	1458	1423	1423
query40	224	133	129	129
query41	69	68	65	65
query42	128	117	121	117
query43	519	498	489	489
query44	1320	881	863	863
query45	183	180	176	176
query46	881	1005	647	647
query47	1798	1853	1749	1749
query48	378	429	321	321
query49	767	507	442	442
query50	640	684	412	412
query51	4114	4135	4271	4135
query52	115	112	106	106
query53	237	267	201	201
query54	644	599	539	539
query55	103	95	93	93
query56	353	343	342	342
query57	1196	1208	1129	1129
query58	294	292	294	292
query59	2718	2765	2630	2630
query60	359	357	358	357
query61	169	168	154	154
query62	791	731	688	688
query63	237	202	202	202
query64	4470	1243	964	964
query65	4447	4258	4217	4217
query66	1123	452	350	350
query67	15485	15265	14947	14947
query68	8242	929	585	585
query69	491	339	299	299
query70	1252	1160	1112	1112
query71	480	402	319	319
query72	5912	4936	4905	4905
query73	744	586	357	357
query74	9336	9134	8967	8967
query75	3847	3177	2642	2642
query76	3710	1153	735	735
query77	811	404	346	346
query78	9620	9728	8839	8839
query79	2330	842	607	607
query80	677	659	527	527
query81	508	272	231	231
query82	449	141	114	114
query83	267	257	248	248
query84	261	111	101	101
query85	893	456	422	422
query86	401	315	314	314
query87	4344	4398	4292	4292
query88	3443	2261	2240	2240
query89	414	325	298	298
query90	1866	226	238	226
query91	177	164	128	128
query92	97	76	74	74
query93	1704	1006	667	667
query94	686	394	336	336
query95	419	342	330	330
query96	494	585	284	284
query97	2684	2708	2597	2597
query98	248	228	217	217
query99	1688	1391	1292	1292
Total cold run time: 276577 ms
Total hot run time: 187301 ms

doris-robot · 2025-08-27T21:16:06Z

ClickBench: Total hot run time: 33.67 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1b57ba39b34406f0790d9eba50dffd9b814b279c, data reload: false

query1	0.05	0.05	0.05
query2	0.13	0.07	0.06
query3	0.31	0.07	0.08
query4	1.61	0.09	0.09
query5	0.43	0.42	0.41
query6	1.17	0.65	0.65
query7	0.03	0.03	0.02
query8	0.07	0.06	0.06
query9	0.66	0.54	0.54
query10	0.59	0.58	0.58
query11	0.26	0.13	0.14
query12	0.26	0.14	0.14
query13	0.66	0.64	0.66
query14	0.84	0.84	0.84
query15	0.96	0.89	0.88
query16	0.39	0.40	0.39
query17	1.04	1.11	1.04
query18	0.23	0.22	0.22
query19	1.99	1.81	1.81
query20	0.02	0.01	0.01
query21	15.40	1.02	0.71
query22	0.96	1.10	0.93
query23	14.70	1.56	0.80
query24	5.04	0.60	0.31
query25	0.16	0.10	0.10
query26	0.53	0.21	0.18
query27	0.10	0.09	0.09
query28	11.06	1.18	0.57
query29	12.54	3.97	3.35
query30	3.14	3.04	2.98
query31	2.82	0.63	0.44
query32	3.24	0.61	0.51
query33	3.12	3.13	3.18
query34	16.79	5.44	4.85
query35	4.87	4.85	4.88
query36	0.65	0.52	0.51
query37	0.23	0.19	0.18
query38	0.17	0.18	0.17
query39	0.06	0.05	0.05
query40	0.21	0.17	0.16
query41	0.12	0.07	0.06
query42	0.06	0.06	0.06
query43	0.06	0.05	0.06
Total cold run time: 107.73 s
Total hot run time: 33.67 s

hello-stephen · 2025-08-27T22:18:32Z

BE UT Coverage Report

Increment line coverage 0.00% (0/24) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	51.78% (17148/33116)
Line Coverage	37.26% (156252/419387)
Region Coverage	31.96% (119136/372797)
Branch Coverage	33.24% (52351/157478)

hello-stephen · 2025-08-27T23:26:48Z

BE Regression && UT Coverage Report

Increment line coverage 0.00% (0/24) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	60.07% (19542/32534)
Line Coverage	45.95% (192661/419277)
Region Coverage	41.34% (156407/378343)
Branch Coverage	42.12% (66754/158476)

morningman · 2025-08-28T06:52:01Z

run buildall

doris-robot · 2025-08-28T07:05:11Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	83.63% (1430/1710)
Line Coverage	67.26% (25443/37827)
Region Coverage	68.34% (12682/18556)
Branch Coverage	58.15% (6724/11564)

hello-stephen · 2025-08-28T07:54:00Z

FE UT Coverage Report

Increment line coverage 68.18% (15/22) 🎉
Increment coverage report
Complete coverage report

doris-robot · 2025-08-28T08:24:17Z

TPC-H: Total hot run time: 34579 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1df9e50ffa2d9b8ffca5fb7a158437cc342d77e9, data reload: false

------ Round 1 ----------------------------------
q1	17321	5269	5105	5105
q2	2020	357	246	246
q3	10020	1296	747	747
q4	10231	1026	522	522
q5	7581	2487	2341	2341
q6	185	174	143	143
q7	956	781	621	621
q8	9339	1408	1237	1237
q9	7080	5186	5174	5174
q10	6992	2397	2011	2011
q11	500	320	283	283
q12	361	365	235	235
q13	17781	3645	3084	3084
q14	240	246	229	229
q15	580	503	499	499
q16	442	440	408	408
q17	614	873	375	375
q18	8129	7157	7081	7081
q19	1098	962	603	603
q20	370	363	230	230
q21	3855	3266	2405	2405
q22	1046	1034	1000	1000
Total cold run time: 106741 ms
Total hot run time: 34579 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5191	5129	5141	5129
q2	269	333	239	239
q3	2218	2724	2293	2293
q4	1389	1805	1313	1313
q5	4212	4526	4569	4526
q6	224	175	131	131
q7	2056	2056	1849	1849
q8	2669	2599	2706	2599
q9	7334	7339	7357	7339
q10	3170	3323	2886	2886
q11	569	530	505	505
q12	717	810	618	618
q13	3585	4093	3336	3336
q14	283	328	294	294
q15	534	487	484	484
q16	462	496	465	465
q17	1236	1596	1435	1435
q18	7846	7763	7672	7672
q19	869	881	1033	881
q20	1940	1956	1815	1815
q21	4761	4337	4313	4313
q22	1088	1054	1007	1007
Total cold run time: 52622 ms
Total hot run time: 51129 ms

doris-robot · 2025-08-28T08:35:55Z

TPC-DS: Total hot run time: 187294 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1df9e50ffa2d9b8ffca5fb7a158437cc342d77e9, data reload: false

query1	1052	476	415	415
query2	6562	1782	1786	1782
query3	6768	228	228	228
query4	26310	23744	23256	23256
query5	4427	632	528	528
query6	335	266	250	250
query7	4652	519	314	314
query8	305	262	246	246
query9	8655	2921	2903	2903
query10	490	348	308	308
query11	15670	14973	14708	14708
query12	178	124	147	124
query13	1671	565	438	438
query14	8986	5921	5847	5847
query15	228	193	174	174
query16	7255	632	526	526
query17	1227	735	622	622
query18	2014	437	353	353
query19	195	195	170	170
query20	136	128	127	127
query21	220	131	121	121
query22	4170	4231	4031	4031
query23	33579	32899	32996	32899
query24	8175	2391	2384	2384
query25	603	528	451	451
query26	1263	291	166	166
query27	2736	524	353	353
query28	4310	2252	2242	2242
query29	832	609	514	514
query30	304	226	206	206
query31	899	845	767	767
query32	87	85	83	83
query33	585	403	344	344
query34	802	854	529	529
query35	842	837	751	751
query36	979	1017	938	938
query37	129	111	133	111
query38	4015	4070	3999	3999
query39	1480	1448	1489	1448
query40	236	136	131	131
query41	73	68	67	67
query42	130	115	114	114
query43	543	523	484	484
query44	1347	854	859	854
query45	183	181	181	181
query46	865	1014	645	645
query47	1738	1825	1729	1729
query48	391	421	335	335
query49	754	533	414	414
query50	665	692	405	405
query51	4183	4124	4119	4119
query52	123	113	106	106
query53	248	263	202	202
query54	621	613	575	575
query55	102	87	88	87
query56	354	345	325	325
query57	1205	1196	1149	1149
query58	305	287	290	287
query59	2633	2690	2598	2598
query60	372	373	374	373
query61	213	211	201	201
query62	793	750	701	701
query63	237	202	199	199
query64	4626	1233	885	885
query65	4319	4219	4208	4208
query66	1179	448	351	351
query67	15472	15115	15084	15084
query68	8742	927	596	596
query69	502	341	310	310
query70	1272	1158	1160	1158
query71	474	348	319	319
query72	5626	5077	5212	5077
query73	798	709	369	369
query74	9251	9152	8932	8932
query75	3983	3058	2622	2622
query76	3730	1147	775	775
query77	796	401	340	340
query78	9698	9743	8825	8825
query79	2070	830	601	601
query80	725	585	510	510
query81	494	265	229	229
query82	451	150	113	113
query83	267	266	253	253
query84	258	105	97	97
query85	892	467	499	467
query86	370	340	306	306
query87	4231	4250	4228	4228
query88	3104	2222	2213	2213
query89	401	336	306	306
query90	1939	236	235	235
query91	168	165	135	135
query92	85	77	77	77
query93	1291	991	655	655
query94	722	432	349	349
query95	428	339	337	337
query96	490	572	290	290
query97	2620	2660	2573	2573
query98	253	220	216	216
query99	1470	1420	1316	1316
Total cold run time: 274637 ms
Total hot run time: 187294 ms

doris-robot · 2025-08-28T08:41:42Z

ClickBench: Total hot run time: 33.62 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1df9e50ffa2d9b8ffca5fb7a158437cc342d77e9, data reload: false

query1	0.05	0.05	0.04
query2	0.12	0.07	0.07
query3	0.30	0.07	0.08
query4	1.62	0.09	0.09
query5	0.43	0.42	0.42
query6	1.17	0.65	0.64
query7	0.03	0.02	0.02
query8	0.08	0.07	0.06
query9	0.65	0.54	0.55
query10	0.59	0.59	0.58
query11	0.26	0.13	0.13
query12	0.27	0.15	0.14
query13	0.66	0.64	0.63
query14	0.83	0.86	0.84
query15	0.96	0.89	0.90
query16	0.41	0.40	0.39
query17	1.11	1.06	1.09
query18	0.22	0.22	0.22
query19	2.00	1.90	1.88
query20	0.02	0.02	0.01
query21	15.41	0.99	0.71
query22	0.92	1.08	0.91
query23	14.72	1.53	0.77
query24	5.28	0.59	0.30
query25	0.18	0.10	0.09
query26	0.56	0.21	0.18
query27	0.10	0.10	0.09
query28	11.02	1.13	0.58
query29	12.59	4.08	3.38
query30	3.09	3.00	2.99
query31	2.83	0.62	0.43
query32	3.28	0.60	0.51
query33	3.19	3.21	3.11
query34	16.29	5.46	4.77
query35	4.89	4.91	4.85
query36	0.65	0.53	0.51
query37	0.22	0.18	0.18
query38	0.18	0.17	0.16
query39	0.06	0.05	0.05
query40	0.22	0.18	0.17
query41	0.11	0.06	0.06
query42	0.06	0.06	0.05
query43	0.06	0.05	0.05
Total cold run time: 107.69 s
Total hot run time: 33.62 s

hello-stephen · 2025-08-28T09:20:03Z

BE UT Coverage Report

Increment line coverage 0.00% (0/24) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	51.78% (17149/33116)
Line Coverage	37.26% (156255/419391)
Region Coverage	31.94% (119082/372823)
Branch Coverage	33.24% (52356/157490)

hello-stephen · 2025-08-28T11:06:11Z

BE Regression && UT Coverage Report

Increment line coverage 100.00% (24/24) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	70.78% (23028/32534)
Line Coverage	57.11% (239469/419281)
Region Coverage	52.76% (199610/378369)
Branch Coverage	54.27% (86010/158488)

morningman · 2025-08-28T17:43:08Z

run buildall

hello-stephen · 2025-08-28T18:06:32Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	83.63% (1430/1710)
Line Coverage	67.24% (25433/37827)
Region Coverage	68.36% (12685/18556)
Branch Coverage	58.10% (6719/11564)

doris-robot · 2025-08-28T18:32:03Z

TPC-H: Total hot run time: 33968 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6ce2a7ad0f2a5fc4a5140614c17a807f974aee0b, data reload: false

------ Round 1 ----------------------------------
q1	16434	5167	5166	5166
q2	2007	315	210	210
q3	9700	1307	706	706
q4	9666	1022	524	524
q5	7151	2387	2313	2313
q6	179	172	134	134
q7	907	754	642	642
q8	8988	1335	1067	1067
q9	6948	5067	5091	5067
q10	6881	2372	1974	1974
q11	502	311	290	290
q12	361	360	235	235
q13	17364	3634	3023	3023
q14	240	247	221	221
q15	562	513	485	485
q16	431	431	381	381
q17	592	857	361	361
q18	7357	7089	7006	7006
q19	1105	943	538	538
q20	356	343	236	236
q21	3811	3232	2393	2393
q22	1122	1032	996	996
Total cold run time: 102664 ms
Total hot run time: 33968 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5207	5083	5035	5035
q2	250	330	226	226
q3	2198	2690	2276	2276
q4	1371	1778	1382	1382
q5	4193	4101	4355	4101
q6	232	183	134	134
q7	2090	1962	1812	1812
q8	2644	2617	2531	2531
q9	7471	7333	7227	7227
q10	3133	3342	2883	2883
q11	617	521	515	515
q12	671	789	625	625
q13	3504	3865	3253	3253
q14	297	317	280	280
q15	516	487	482	482
q16	462	498	461	461
q17	1175	1587	1371	1371
q18	8000	7627	7672	7627
q19	814	847	896	847
q20	1998	2162	2001	2001
q21	4948	4532	4372	4372
q22	1068	1053	994	994
Total cold run time: 52859 ms
Total hot run time: 50435 ms

doris-robot · 2025-08-28T18:43:40Z

TPC-DS: Total hot run time: 187601 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6ce2a7ad0f2a5fc4a5140614c17a807f974aee0b, data reload: false

query1	1055	431	438	431
query2	6574	1754	1778	1754
query3	6747	231	227	227
query4	26263	23817	23490	23490
query5	4727	650	523	523
query6	337	273	241	241
query7	4663	519	301	301
query8	317	259	251	251
query9	8659	2908	2884	2884
query10	490	352	332	332
query11	15781	15067	14825	14825
query12	176	122	115	115
query13	1672	570	432	432
query14	9366	5870	5837	5837
query15	217	191	173	173
query16	7539	630	464	464
query17	1206	733	621	621
query18	2057	435	325	325
query19	204	200	170	170
query20	132	189	127	127
query21	222	129	112	112
query22	4026	4315	4229	4229
query23	33721	32957	32966	32957
query24	7883	2379	2413	2379
query25	566	555	446	446
query26	1251	289	172	172
query27	2701	537	359	359
query28	4225	2272	2233	2233
query29	780	603	498	498
query30	307	228	197	197
query31	928	806	731	731
query32	92	84	79	79
query33	576	398	364	364
query34	841	848	535	535
query35	830	811	768	768
query36	966	1003	937	937
query37	137	123	101	101
query38	4050	4120	4029	4029
query39	1511	1445	1431	1431
query40	230	141	132	132
query41	72	67	64	64
query42	128	117	119	117
query43	512	517	488	488
query44	1383	865	874	865
query45	189	176	191	176
query46	873	1024	654	654
query47	1787	1794	1733	1733
query48	403	441	329	329
query49	744	514	405	405
query50	659	676	407	407
query51	4186	4152	4173	4152
query52	124	116	108	108
query53	252	274	201	201
query54	631	619	570	570
query55	97	91	92	91
query56	352	342	345	342
query57	1218	1217	1116	1116
query58	303	313	298	298
query59	2676	2764	2676	2676
query60	364	361	351	351
query61	168	155	157	155
query62	804	736	675	675
query63	239	195	198	195
query64	4170	1152	880	880
query65	4337	4224	4227	4224
query66	1123	452	359	359
query67	15466	15217	15343	15217
query68	7984	922	612	612
query69	490	338	291	291
query70	1198	1160	1129	1129
query71	447	342	325	325
query72	5778	5037	4965	4965
query73	672	588	363	363
query74	8950	8839	9016	8839
query75	3373	3108	2651	2651
query76	3542	1147	761	761
query77	790	436	348	348
query78	9429	9694	8902	8902
query79	1955	841	584	584
query80	776	592	522	522
query81	503	270	228	228
query82	194	146	115	115
query83	268	276	247	247
query84	264	115	99	99
query85	868	468	429	429
query86	375	327	321	321
query87	4327	4287	4104	4104
query88	2868	2218	2201	2201
query89	400	330	302	302
query90	1979	233	221	221
query91	165	216	132	132
query92	92	82	75	75
query93	2283	1010	663	663
query94	690	420	329	329
query95	417	348	337	337
query96	486	606	278	278
query97	2614	2681	2618	2618
query98	250	223	215	215
query99	1325	1445	1335	1335
Total cold run time: 273037 ms
Total hot run time: 187601 ms

doris-robot · 2025-08-28T18:49:26Z

ClickBench: Total hot run time: 33.47 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6ce2a7ad0f2a5fc4a5140614c17a807f974aee0b, data reload: false

query1	0.05	0.05	0.04
query2	0.12	0.07	0.06
query3	0.31	0.07	0.07
query4	1.61	0.08	0.08
query5	0.44	0.41	0.42
query6	1.17	0.64	0.64
query7	0.03	0.02	0.03
query8	0.07	0.06	0.06
query9	0.65	0.53	0.54
query10	0.59	0.60	0.59
query11	0.26	0.14	0.13
query12	0.27	0.14	0.13
query13	0.66	0.64	0.63
query14	0.83	0.85	0.85
query15	0.95	0.86	0.88
query16	0.38	0.40	0.38
query17	1.07	1.05	1.06
query18	0.23	0.22	0.21
query19	1.99	1.80	1.83
query20	0.01	0.01	0.02
query21	15.40	1.05	0.73
query22	0.93	1.10	0.86
query23	14.73	1.52	0.79
query24	5.13	0.60	0.33
query25	0.18	0.10	0.09
query26	0.55	0.22	0.17
query27	0.08	0.10	0.10
query28	11.06	1.17	0.57
query29	12.55	4.05	3.35
query30	3.15	3.08	3.01
query31	2.81	0.61	0.42
query32	3.27	0.61	0.51
query33	3.07	3.09	3.12
query34	16.48	5.53	4.77
query35	4.90	4.88	4.90
query36	0.64	0.52	0.51
query37	0.23	0.19	0.18
query38	0.18	0.17	0.17
query39	0.05	0.04	0.05
query40	0.22	0.19	0.18
query41	0.12	0.06	0.06
query42	0.07	0.06	0.06
query43	0.07	0.05	0.05
Total cold run time: 107.56 s
Total hot run time: 33.47 s

hello-stephen · 2025-08-28T18:57:51Z

BE UT Coverage Report

Increment line coverage 0.00% (0/24) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	51.79% (17151/33117)
Line Coverage	37.27% (156295/419407)
Region Coverage	31.96% (119172/372850)
Branch Coverage	33.25% (52368/157502)

morningman · 2025-08-30T06:20:18Z

run buildall

hello-stephen · 2025-08-30T06:45:47Z

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	84.48% (1464/1733)
Line Coverage	67.68% (26124/38600)
Region Coverage	68.66% (12989/18919)
Branch Coverage	58.55% (6941/11854)

doris-robot · 2025-08-30T08:10:57Z

TPC-H: Total hot run time: 34411 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3c8053b74790a121608c32e3ac7e7998117d1669, data reload: false

------ Round 1 ----------------------------------
q1	17264	5251	5113	5113
q2	2025	315	220	220
q3	10048	1293	733	733
q4	10232	998	532	532
q5	7610	2404	2406	2404
q6	184	167	136	136
q7	932	788	656	656
q8	9366	1351	1150	1150
q9	7093	5154	5243	5154
q10	6930	2395	1960	1960
q11	480	308	282	282
q12	355	368	239	239
q13	17801	3681	3051	3051
q14	237	233	223	223
q15	584	520	489	489
q16	441	440	390	390
q17	617	884	363	363
q18	7577	7109	7119	7109
q19	986	949	606	606
q20	345	359	247	247
q21	3700	3223	2343	2343
q22	1065	1050	1011	1011
Total cold run time: 105872 ms
Total hot run time: 34411 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5200	5177	5180	5177
q2	254	330	228	228
q3	2189	2679	2321	2321
q4	1356	1805	1360	1360
q5	4243	4440	4520	4440
q6	230	176	139	139
q7	2053	1953	1896	1896
q8	2757	2647	2533	2533
q9	7417	7567	7395	7395
q10	3147	3348	2899	2899
q11	597	510	512	510
q12	690	822	940	822
q13	3416	3862	3341	3341
q14	287	321	283	283
q15	551	491	479	479
q16	448	491	452	452
q17	1228	1584	1370	1370
q18	7952	7799	7578	7578
q19	867	913	1017	913
q20	2118	2026	1907	1907
q21	4832	4400	4254	4254
q22	1074	1079	1026	1026
Total cold run time: 52906 ms
Total hot run time: 51323 ms

doris-robot · 2025-08-30T08:22:38Z

TPC-DS: Total hot run time: 187416 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3c8053b74790a121608c32e3ac7e7998117d1669, data reload: false

query1	1080	458	406	406
query2	6560	1748	1747	1747
query3	6746	236	224	224
query4	26592	23244	23235	23235
query5	4418	667	520	520
query6	346	250	246	246
query7	4657	521	303	303
query8	309	272	248	248
query9	8658	2927	2942	2927
query10	521	354	305	305
query11	15391	15025	14700	14700
query12	179	130	121	121
query13	1695	580	456	456
query14	8769	5948	5909	5909
query15	218	192	180	180
query16	7629	663	488	488
query17	1266	768	653	653
query18	2051	436	419	419
query19	209	203	170	170
query20	138	124	122	122
query21	216	133	120	120
query22	4092	4245	4111	4111
query23	33930	33150	32968	32968
query24	8170	2374	2420	2374
query25	569	521	442	442
query26	1240	280	170	170
query27	2722	513	360	360
query28	4282	2275	2251	2251
query29	786	602	495	495
query30	294	225	198	198
query31	916	798	744	744
query32	93	79	80	79
query33	599	395	355	355
query34	821	870	525	525
query35	862	850	751	751
query36	990	1030	918	918
query37	129	112	91	91
query38	4099	4014	4082	4014
query39	1503	1418	1430	1418
query40	230	135	133	133
query41	66	77	58	58
query42	130	110	126	110
query43	529	510	476	476
query44	1370	854	847	847
query45	178	182	178	178
query46	864	1017	657	657
query47	1779	1811	1729	1729
query48	382	426	343	343
query49	748	512	424	424
query50	646	675	401	401
query51	4136	4149	4038	4038
query52	117	117	114	114
query53	254	260	211	211
query54	618	602	552	552
query55	92	91	95	91
query56	343	350	314	314
query57	1206	1192	1124	1124
query58	291	281	279	279
query59	2662	2697	2725	2697
query60	359	347	343	343
query61	162	151	156	151
query62	830	718	653	653
query63	233	191	194	191
query64	4343	1169	841	841
query65	4311	4195	4197	4195
query66	1143	428	369	369
query67	15438	15271	15297	15271
query68	9110	921	586	586
query69	490	321	303	303
query70	1291	1175	1117	1117
query71	476	339	313	313
query72	6013	5093	5152	5093
query73	789	700	370	370
query74	9342	9095	9098	9095
query75	4255	3104	2559	2559
query76	3717	1176	763	763
query77	822	427	336	336
query78	9563	9750	8891	8891
query79	2440	853	629	629
query80	689	589	530	530
query81	467	271	230	230
query82	422	141	110	110
query83	294	259	244	244
query84	307	116	97	97
query85	925	484	431	431
query86	344	328	302	302
query87	4277	4277	4170	4170
query88	2818	2222	2250	2222
query89	432	349	295	295
query90	1949	233	231	231
query91	158	166	152	152
query92	94	78	76	76
query93	1893	1011	664	664
query94	707	428	329	329
query95	421	346	327	327
query96	484	595	278	278
query97	2664	2667	2595	2595
query98	254	216	211	211
query99	1521	1415	1314	1314
Total cold run time: 276633 ms
Total hot run time: 187416 ms

doris-robot · 2025-08-30T08:28:23Z

ClickBench: Total hot run time: 33.68 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3c8053b74790a121608c32e3ac7e7998117d1669, data reload: false

query1	0.05	0.05	0.04
query2	0.12	0.07	0.06
query3	0.30	0.07	0.07
query4	1.61	0.09	0.10
query5	0.43	0.42	0.43
query6	1.18	0.65	0.65
query7	0.03	0.02	0.02
query8	0.07	0.06	0.06
query9	0.65	0.54	0.53
query10	0.58	0.59	0.59
query11	0.27	0.13	0.13
query12	0.26	0.15	0.13
query13	0.66	0.65	0.64
query14	0.85	0.84	0.85
query15	0.97	0.88	0.90
query16	0.39	0.38	0.38
query17	1.05	1.05	1.06
query18	0.24	0.22	0.21
query19	1.96	1.82	1.81
query20	0.02	0.01	0.02
query21	15.39	1.03	0.72
query22	0.93	1.16	0.93
query23	14.70	1.49	0.78
query24	4.89	0.61	0.33
query25	0.17	0.10	0.09
query26	0.54	0.22	0.18
query27	0.10	0.10	0.09
query28	11.20	1.20	0.58
query29	12.62	4.07	3.35
query30	3.19	3.06	3.08
query31	2.82	0.62	0.45
query32	3.24	0.61	0.50
query33	3.12	3.16	3.13
query34	16.34	5.50	4.79
query35	4.92	4.87	4.85
query36	0.65	0.53	0.51
query37	0.21	0.18	0.18
query38	0.18	0.17	0.16
query39	0.06	0.05	0.05
query40	0.21	0.18	0.18
query41	0.12	0.05	0.06
query42	0.07	0.06	0.06
query43	0.06	0.05	0.05
Total cold run time: 107.42 s
Total hot run time: 33.68 s

doris-robot · 2025-08-30T09:28:23Z

BE UT Coverage Report

Increment line coverage 0.00% (0/24) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	51.65% (17120/33149)
Line Coverage	37.17% (156364/420729)
Region Coverage	31.85% (119281/374551)
Branch Coverage	33.18% (52418/157973)

hello-stephen · 2025-08-30T10:35:23Z

BE Regression && UT Coverage Report

Increment line coverage 100.00% (24/24) 🎉

Increment coverage report
Complete coverage report

Category	Coverage
Function Coverage	70.53% (22967/32565)
Line Coverage	56.88% (239250/420601)
Region Coverage	52.28% (198700/380068)
Branch Coverage	53.96% (85771/158954)

hello-stephen · 2025-08-30T10:50:48Z

FE Regression Coverage Report

Increment line coverage 81.82% (18/22) 🎉
Increment coverage report
Complete coverage report

wm1581066

LGTM

github-actions · 2025-09-01T18:00:46Z

PR approved by anyone and no changes requested.

github-actions · 2025-09-02T02:44:03Z

PR approved by at least one committer and no changes requested.

…d export (#55392) ### What problem does this PR solve? Outfile: ``` select * from tbl1 into outfile "file:///tmp/my_file_" FORMAT AS CSV PROPERTIES ( "compress_type" = "gzip" ); ``` Export: ``` EXPORT TABLE test_export_csv TO "file:///tmp/test_" PROPERTIES( "label" = "l4", "format" = "csv", "column_separator"=",", "compress_type" = "gzip" ); ``` Now support "plain", "gz", "bz2", "snappyblock", "lz4block", "zstd"

…n outfile and export #55392 (#55561) Cherry-picked from #55392 Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>

Followup #55392 Change gzip to gz, bzip2 to bz2. So that tools like `gunzip` can recognize it directly

…d export apache#55392 (apache#4958)

…#58090) ### What problem does this PR solve? Related PR: #55392 Problem Summary: Support compression when outfile with `csv_with_names` and `cvs_with_names_and_types`

…apache#58090) ### What problem does this PR solve? Related PR: apache#55392 Problem Summary: Support compression when outfile with `csv_with_names` and `cvs_with_names_and_types`

…#58090) ### What problem does this PR solve? Related PR: #55392 Problem Summary: Support compression when outfile with `csv_with_names` and `cvs_with_names_and_types`

morningman added dev/3.0.x dev/3.1.x labels Aug 27, 2025

morningman added 5 commits August 29, 2025 11:50

[opt](outfile) support csv with compression type

3bf362e

1

07f15de

2

fb582f0

3

e79963c

2

9aa81cc

wm1581066 approved these changes Sep 1, 2025

View reviewed changes

github-actions bot added the reviewed label Sep 1, 2025

CalvinKirs approved these changes Sep 2, 2025

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 2, 2025

morningman merged commit 956703f into apache:master Sep 2, 2025
25 of 28 checks passed

github-actions bot added the dev/3.0.x-conflict label Sep 2, 2025

github-actions bot mentioned this pull request Sep 2, 2025

branch-3.1: [feat](outfile) support compression type for csv format in outfile and export #55392 #55561

Merged

morrySnow pushed a commit that referenced this pull request Sep 4, 2025

branch-3.1: [feat](outfile) support compression type for csv format i…

b41fcda

…n outfile and export #55392 (#55561) Cherry-picked from #55392 Co-authored-by: Mingyu Chen (Rayner) <morningman@163.com>

morrySnow added dev/3.1.1-merged and removed dev/3.1.x labels Sep 4, 2025

morningman mentioned this pull request Sep 9, 2025

[opt](outfile) change suffix of compressed file #55803

Merged

16 tasks

zy-kkk pushed a commit that referenced this pull request Sep 11, 2025

[opt](outfile) change suffix of compressed file (#55803)

d1e858d

Followup #55392 Change gzip to gz, bzip2 to bz2. So that tools like `gunzip` can recognize it directly

github-actions bot pushed a commit that referenced this pull request Sep 11, 2025

[opt](outfile) change suffix of compressed file (#55803)

923f702

Followup #55392 Change gzip to gz, bzip2 to bz2. So that tools like `gunzip` can recognize it directly

morrySnow mentioned this pull request Sep 22, 2025

Release Note 3.1.1 #56289

Closed

Hastyshell pushed a commit to Hastyshell/doris that referenced this pull request Nov 12, 2025

[feat](outfile) support compression type for csv format in outfile an…

24aa8d7

…d export apache#55392 (apache#4958)

morningman mentioned this pull request Nov 17, 2025

[opt](outfile) support compressed csv with names and types in outfile #58090

Merged

16 tasks

Conversation

morningman commented Aug 27, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What problem does this PR solve?

Release note

Check List (For Author)

Check List (For Reviewer who merge this PR)

Uh oh!

Thearas commented Aug 27, 2025

Uh oh!

morningman commented Aug 27, 2025

Uh oh!

hello-stephen commented Aug 27, 2025

Cloud UT Coverage Report

Uh oh!

hello-stephen commented Aug 27, 2025

FE UT Coverage Report

Uh oh!

doris-robot commented Aug 27, 2025

Uh oh!

doris-robot commented Aug 27, 2025

Uh oh!

doris-robot commented Aug 27, 2025

Uh oh!

hello-stephen commented Aug 27, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Aug 27, 2025

BE Regression && UT Coverage Report

Uh oh!

morningman commented Aug 28, 2025

Uh oh!

doris-robot commented Aug 28, 2025

Cloud UT Coverage Report

Uh oh!

hello-stephen commented Aug 28, 2025

FE UT Coverage Report

Uh oh!

doris-robot commented Aug 28, 2025

Uh oh!

doris-robot commented Aug 28, 2025

Uh oh!

doris-robot commented Aug 28, 2025

Uh oh!

hello-stephen commented Aug 28, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Aug 28, 2025

BE Regression && UT Coverage Report

Uh oh!

morningman commented Aug 28, 2025

Uh oh!

hello-stephen commented Aug 28, 2025

Cloud UT Coverage Report

Uh oh!

doris-robot commented Aug 28, 2025

Uh oh!

doris-robot commented Aug 28, 2025

Uh oh!

doris-robot commented Aug 28, 2025

Uh oh!

hello-stephen commented Aug 28, 2025

BE UT Coverage Report

Uh oh!

morningman commented Aug 30, 2025

Uh oh!

hello-stephen commented Aug 30, 2025

Cloud UT Coverage Report

Uh oh!

doris-robot commented Aug 30, 2025

Uh oh!

doris-robot commented Aug 30, 2025

Uh oh!

doris-robot commented Aug 30, 2025

Uh oh!

doris-robot commented Aug 30, 2025

BE UT Coverage Report

Uh oh!

hello-stephen commented Aug 30, 2025

BE Regression && UT Coverage Report

morningman commented Aug 27, 2025 •

edited

Loading