Skip to content

branch-3.1: [fix](variant) fix the reading core caused by inserting nested column and scalar column in variant sub-column #53083#53977

Merged
morrySnow merged 11 commits intoapache:branch-3.1from
amorynan:pick_53083_to_doris_branch-3.1
Jul 31, 2025
Merged

branch-3.1: [fix](variant) fix the reading core caused by inserting nested column and scalar column in variant sub-column #53083#53977
morrySnow merged 11 commits intoapache:branch-3.1from
amorynan:pick_53083_to_doris_branch-3.1

Conversation

@amorynan
Copy link
Contributor

@amorynan amorynan commented Jul 28, 2025

backport: #53083

… and scalar column in variant sub-column (apache#53083)

this pr main fix the problem which if we create table with
```variant_enable_flatten_nested```
then insert variant data:
```'{"nested":{"a":"1"}}``` and ```'{"nested":[{"a":1,"c":1.1},{"b":"1"}]}'```
we will meet core for reading
so we should forbid this table property
and for old data we insert different structure data will meet some error like this:
```
mysql> insert into vs values (2, '{"nested":{"a":"1"}}');
Query OK, 1 row affected (0.22 sec)
{'label':'label_165a8209698c4391_988c6532615017c4', 'status':'VISIBLE',
'txnId':'1011'}

mysql> insert into vs values (1,
'{"nested":[{"a":1,"c":1.1},{"b":"1"}]}');
ERROR 1105 (HY000): errCode = 2, detailMessage =
(10.16.10.6)[INTERNAL_ERROR]tablet 1752145213719 failed on majority
backends: [DATA_QUALITY_ERROR]PStatus:
(10.16.10.6)[DATA_QUALITY_ERROR]Ambiguous paths: v.nested.a vs
v.nested.a with different nested part true vs false
```
@amorynan amorynan requested a review from morrySnow as a code owner July 28, 2025 09:44
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@morrySnow morrySnow changed the title [cherry-pick](variant)Pick 53083 to doris branch 3.1 branch-3.1: [fix](variant) fix the reading core caused by inserting nested column and scalar column in variant sub-column #53083 Jul 29, 2025
@amorynan
Copy link
Contributor Author

run buildall

@amorynan
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 81.15% (1210/1491)
Line Coverage 65.28% (21318/32657)
Region Coverage 66.74% (10714/16054)
Branch Coverage 56.43% (5641/9996)

@amorynan
Copy link
Contributor Author

run buildall

@hello-stephen
Copy link
Contributor

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 81.15% (1210/1491)
Line Coverage 65.28% (21318/32657)
Region Coverage 66.77% (10720/16054)
Branch Coverage 56.45% (5643/9996)

@doris-robot
Copy link

TPC-H: Total hot run time: 32385 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 87915ffb495a7448fec7e5ee293d07f02e54d508, data reload: false

------ Round 1 ----------------------------------
q1	17588	5434	5456	5434
q2	2054	275	164	164
q3	10442	1253	738	738
q4	10195	872	454	454
q5	7640	2395	2133	2133
q6	181	164	131	131
q7	904	750	610	610
q8	9326	1453	1199	1199
q9	5206	4905	4966	4905
q10	6748	2273	1816	1816
q11	484	295	269	269
q12	334	355	208	208
q13	17779	3599	2994	2994
q14	224	227	206	206
q15	524	471	462	462
q16	418	430	377	377
q17	590	867	370	370
q18	7090	6357	6190	6190
q19	1199	960	556	556
q20	313	349	207	207
q21	3015	2159	1978	1978
q22	1047	1035	984	984
Total cold run time: 103301 ms
Total hot run time: 32385 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5546	5511	5479	5479
q2	239	339	236	236
q3	2236	2595	2314	2314
q4	1415	1794	1348	1348
q5	4415	4847	4919	4847
q6	198	176	129	129
q7	2040	1957	1814	1814
q8	2633	2803	2692	2692
q9	7272	7159	7256	7159
q10	3014	3289	2862	2862
q11	585	494	498	494
q12	634	739	558	558
q13	3283	3791	3179	3179
q14	293	289	255	255
q15	525	474	457	457
q16	430	495	445	445
q17	1236	1744	1241	1241
q18	7614	7464	7259	7259
q19	833	1183	1044	1044
q20	2016	2051	1876	1876
q21	5341	4852	4665	4665
q22	1149	1112	1049	1049
Total cold run time: 52947 ms
Total hot run time: 51402 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196553 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 87915ffb495a7448fec7e5ee293d07f02e54d508, data reload: false

query1	1317	958	894	894
query2	6250	1976	1941	1941
query3	10981	4442	4511	4442
query4	33143	23649	23497	23497
query5	3719	599	475	475
query6	280	205	197	197
query7	3987	493	325	325
query8	321	257	274	257
query9	9531	2572	2558	2558
query10	468	335	249	249
query11	18295	15282	15138	15138
query12	164	108	109	108
query13	1553	541	425	425
query14	9421	7611	7065	7065
query15	261	209	185	185
query16	7917	648	490	490
query17	1622	799	601	601
query18	2079	436	334	334
query19	213	197	164	164
query20	129	120	118	118
query21	214	133	108	108
query22	4560	4540	4331	4331
query23	34935	34537	33968	33968
query24	7633	2731	2684	2684
query25	513	508	432	432
query26	809	295	194	194
query27	2043	481	348	348
query28	5371	2220	2189	2189
query29	629	559	438	438
query30	238	187	167	167
query31	998	931	842	842
query32	69	63	60	60
query33	487	367	305	305
query34	740	846	537	537
query35	807	814	732	732
query36	1024	1043	972	972
query37	106	92	67	67
query38	4041	4046	3933	3933
query39	1526	1494	1468	1468
query40	207	119	105	105
query41	48	49	51	49
query42	119	111	103	103
query43	513	542	486	486
query44	1362	822	822	822
query45	182	179	171	171
query46	891	1056	702	702
query47	2010	2024	1931	1931
query48	413	418	345	345
query49	726	486	416	416
query50	688	707	433	433
query51	7402	7339	7076	7076
query52	105	101	91	91
query53	226	258	188	188
query54	545	560	482	482
query55	79	76	77	76
query56	293	279	261	261
query57	1267	1292	1188	1188
query58	245	224	231	224
query59	3112	3274	3111	3111
query60	294	280	267	267
query61	115	116	122	116
query62	794	751	705	705
query63	236	203	192	192
query64	3324	1010	655	655
query65	3308	3272	3264	3264
query66	790	413	305	305
query67	16382	15673	15793	15673
query68	6436	847	540	540
query69	508	307	259	259
query70	1167	1095	1067	1067
query71	389	287	259	259
query72	5764	3751	3796	3751
query73	627	739	355	355
query74	10234	9047	8967	8967
query75	3201	3158	2661	2661
query76	3094	1181	767	767
query77	476	375	277	277
query78	10333	10416	9591	9591
query79	3410	918	593	593
query80	719	564	419	419
query81	500	265	226	226
query82	656	119	87	87
query83	167	157	137	137
query84	245	94	82	82
query85	780	351	299	299
query86	390	311	312	311
query87	4327	4350	4173	4173
query88	5071	2364	2365	2364
query89	417	335	294	294
query90	1805	190	192	190
query91	145	139	110	110
query92	67	55	53	53
query93	2528	891	534	534
query94	689	418	302	302
query95	344	281	263	263
query96	485	608	280	280
query97	3184	3256	3202	3202
query98	227	204	196	196
query99	1559	1410	1269	1269
Total cold run time: 294014 ms
Total hot run time: 196553 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.23 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 87915ffb495a7448fec7e5ee293d07f02e54d508, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.06
query4	1.65	0.09	0.09
query5	0.52	0.51	0.51
query6	1.14	0.75	0.76
query7	0.02	0.02	0.02
query8	0.06	0.04	0.04
query9	0.56	0.50	0.49
query10	0.55	0.56	0.56
query11	0.16	0.12	0.12
query12	0.16	0.14	0.13
query13	0.62	0.60	0.60
query14	0.80	0.78	0.81
query15	0.85	0.84	0.83
query16	0.38	0.38	0.39
query17	1.08	1.04	1.07
query18	0.19	0.19	0.19
query19	1.83	1.89	1.81
query20	0.02	0.01	0.02
query21	15.38	0.94	0.66
query22	0.76	0.75	0.70
query23	14.81	1.50	0.70
query24	2.26	0.37	0.22
query25	0.13	0.08	0.08
query26	0.28	0.20	0.18
query27	0.08	0.07	0.07
query28	13.42	1.16	0.55
query29	12.65	4.02	3.40
query30	0.25	0.08	0.06
query31	2.82	0.62	0.40
query32	3.23	0.57	0.48
query33	2.98	3.00	3.05
query34	16.71	5.19	4.55
query35	4.63	4.62	4.66
query36	0.63	0.48	0.47
query37	0.21	0.18	0.16
query38	0.16	0.15	0.16
query39	0.05	0.04	0.05
query40	0.17	0.14	0.13
query41	0.10	0.05	0.06
query42	0.06	0.06	0.05
query43	0.05	0.05	0.04
Total cold run time: 102.75 s
Total hot run time: 29.23 s

@amorynan
Copy link
Contributor Author

run buildall

@hello-stephen
Copy link
Contributor

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 81.15% (1210/1491)
Line Coverage 65.29% (21323/32657)
Region Coverage 66.77% (10720/16054)
Branch Coverage 56.45% (5643/9996)

@doris-robot
Copy link

TPC-H: Total hot run time: 32537 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e262e17fe8a24c493506ac04b0f2af7e267ea49b, data reload: false

------ Round 1 ----------------------------------
q1	17719	5515	5457	5457
q2	2063	292	169	169
q3	10660	1272	719	719
q4	10859	883	461	461
q5	9119	2401	2133	2133
q6	189	165	133	133
q7	877	733	605	605
q8	9333	1427	1155	1155
q9	5389	4919	4954	4919
q10	6743	2284	1811	1811
q11	475	297	264	264
q12	338	350	206	206
q13	17791	3591	3046	3046
q14	234	224	207	207
q15	530	465	467	465
q16	412	430	368	368
q17	611	860	361	361
q18	6942	6388	6314	6314
q19	1241	969	550	550
q20	330	336	202	202
q21	3150	2166	1998	1998
q22	1022	1014	994	994
Total cold run time: 106027 ms
Total hot run time: 32537 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5593	5551	5509	5509
q2	237	330	236	236
q3	2258	2632	2284	2284
q4	1346	1808	1386	1386
q5	4406	4993	5159	4993
q6	170	159	124	124
q7	2020	1904	1806	1806
q8	2567	2850	2661	2661
q9	7186	7076	7177	7076
q10	3014	3280	2784	2784
q11	588	500	498	498
q12	637	733	618	618
q13	3355	3767	3153	3153
q14	295	303	277	277
q15	529	474	483	474
q16	421	486	418	418
q17	1204	1754	1269	1269
q18	7682	7386	7322	7322
q19	800	1084	1077	1077
q20	2008	2016	1879	1879
q21	5392	4901	4598	4598
q22	1126	1066	1024	1024
Total cold run time: 52834 ms
Total hot run time: 51466 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189568 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e262e17fe8a24c493506ac04b0f2af7e267ea49b, data reload: false

query1	986	396	392	392
query2	6539	1915	1861	1861
query3	6708	218	233	218
query4	33489	23577	23522	23522
query5	4330	588	474	474
query6	277	197	194	194
query7	4628	496	320	320
query8	301	287	243	243
query9	9543	2560	2549	2549
query10	475	332	268	268
query11	18606	15409	15219	15219
query12	156	109	104	104
query13	1669	529	407	407
query14	10485	6713	7159	6713
query15	253	194	181	181
query16	8313	682	473	473
query17	1785	783	587	587
query18	2175	427	325	325
query19	228	183	160	160
query20	119	118	116	116
query21	212	131	116	116
query22	4449	4582	4408	4408
query23	35006	33813	33179	33179
query24	7653	2625	2653	2625
query25	535	488	419	419
query26	1204	283	169	169
query27	2110	468	340	340
query28	5151	2122	2094	2094
query29	763	585	453	453
query30	264	186	157	157
query31	981	897	818	818
query32	93	60	60	60
query33	521	368	313	313
query34	733	845	519	519
query35	777	799	701	701
query36	1014	1050	916	916
query37	109	98	72	72
query38	3931	3921	3818	3818
query39	1506	1430	1423	1423
query40	209	128	105	105
query41	52	54	51	51
query42	121	100	101	100
query43	512	535	481	481
query44	1320	816	816	816
query45	186	172	172	172
query46	863	1053	652	652
query47	1874	1891	1846	1846
query48	421	419	352	352
query49	788	484	382	382
query50	654	673	418	418
query51	7151	7179	7147	7147
query52	104	100	95	95
query53	232	257	180	180
query54	518	532	486	486
query55	81	80	84	80
query56	264	264	254	254
query57	1260	1227	1150	1150
query58	241	210	223	210
query59	2960	2992	2829	2829
query60	284	282	264	264
query61	121	114	115	114
query62	814	734	687	687
query63	226	189	186	186
query64	4569	956	618	618
query65	3268	3166	3171	3166
query66	1066	407	302	302
query67	15784	15725	15511	15511
query68	7960	827	536	536
query69	488	302	269	269
query70	1166	1125	1138	1125
query71	508	295	259	259
query72	5691	3778	3793	3778
query73	640	737	349	349
query74	10387	9059	8982	8982
query75	3182	3126	2660	2660
query76	3247	1162	770	770
query77	468	360	277	277
query78	10241	10332	9610	9610
query79	3093	892	590	590
query80	706	518	439	439
query81	507	255	223	223
query82	658	118	90	90
query83	183	171	148	148
query84	295	100	85	85
query85	800	370	308	308
query86	404	327	294	294
query87	4284	4327	4227	4227
query88	5159	2364	2336	2336
query89	404	328	287	287
query90	1850	186	188	186
query91	138	159	107	107
query92	64	60	52	52
query93	2057	858	535	535
query94	697	402	292	292
query95	347	279	286	279
query96	484	602	284	284
query97	3186	3261	3132	3132
query98	223	207	196	196
query99	1597	1449	1283	1283
Total cold run time: 295134 ms
Total hot run time: 189568 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 28.2 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e262e17fe8a24c493506ac04b0f2af7e267ea49b, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.62	0.11	0.11
query5	0.50	0.50	0.52
query6	1.13	0.75	0.73
query7	0.02	0.01	0.02
query8	0.07	0.03	0.03
query9	0.60	0.49	0.50
query10	0.55	0.55	0.56
query11	0.14	0.10	0.10
query12	0.13	0.11	0.11
query13	0.62	0.60	0.60
query14	0.78	0.78	0.78
query15	0.85	0.82	0.81
query16	0.39	0.38	0.39
query17	1.08	1.04	1.07
query18	0.23	0.22	0.21
query19	1.96	1.80	1.82
query20	0.01	0.01	0.01
query21	15.38	0.94	0.55
query22	0.75	0.74	0.61
query23	15.23	1.41	0.57
query24	3.29	1.40	0.29
query25	0.14	0.16	0.13
query26	0.28	0.15	0.12
query27	0.06	0.05	0.05
query28	13.34	1.05	0.44
query29	12.57	3.87	3.27
query30	0.24	0.09	0.06
query31	2.83	0.61	0.38
query32	3.22	0.55	0.46
query33	3.01	3.03	3.03
query34	16.72	5.12	4.56
query35	4.57	4.52	4.53
query36	0.63	0.51	0.48
query37	0.08	0.07	0.05
query38	0.04	0.03	0.04
query39	0.03	0.03	0.02
query40	0.17	0.13	0.12
query41	0.08	0.03	0.03
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 103.74 s
Total hot run time: 28.2 s

@amorynan
Copy link
Contributor Author

run buildall

@hello-stephen
Copy link
Contributor

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 81.15% (1210/1491)
Line Coverage 65.27% (21315/32657)
Region Coverage 66.72% (10711/16054)
Branch Coverage 56.41% (5639/9996)

@amorynan
Copy link
Contributor Author

run buildall

@hello-stephen
Copy link
Contributor

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 81.15% (1210/1491)
Line Coverage 65.27% (21315/32657)
Region Coverage 66.77% (10719/16054)
Branch Coverage 56.41% (5639/9996)

@doris-robot
Copy link

TPC-H: Total hot run time: 32884 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a97782727e1dbc0e5869d99b70c858073fb37fdf, data reload: false

------ Round 1 ----------------------------------
q1	17589	5558	5474	5474
q2	2073	285	181	181
q3	10567	1246	759	759
q4	10272	886	455	455
q5	8716	2385	2113	2113
q6	186	169	135	135
q7	902	764	634	634
q8	9342	1477	1223	1223
q9	5236	4960	4957	4957
q10	6761	2277	1803	1803
q11	474	277	264	264
q12	346	353	220	220
q13	17791	3629	2989	2989
q14	229	234	214	214
q15	515	481	472	472
q16	428	435	371	371
q17	611	877	355	355
q18	7098	6553	6506	6506
q19	1342	967	545	545
q20	332	347	209	209
q21	3077	2173	2035	2035
q22	1065	1042	970	970
Total cold run time: 104952 ms
Total hot run time: 32884 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5543	5574	5740	5574
q2	242	349	260	260
q3	2259	2625	2302	2302
q4	1336	1792	1320	1320
q5	4445	4938	5033	4938
q6	170	161	133	133
q7	2091	1998	1843	1843
q8	2660	2802	2770	2770
q9	7221	7226	7241	7226
q10	3016	3321	2736	2736
q11	561	500	487	487
q12	663	778	638	638
q13	3413	3787	3178	3178
q14	276	286	270	270
q15	508	480	465	465
q16	471	490	444	444
q17	1250	1744	1253	1253
q18	7691	7337	7334	7334
q19	821	1144	1118	1118
q20	2022	2051	1866	1866
q21	5406	4849	4693	4693
q22	1081	1086	977	977
Total cold run time: 53146 ms
Total hot run time: 51825 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197213 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a97782727e1dbc0e5869d99b70c858073fb37fdf, data reload: false

query1	1303	955	919	919
query2	6211	1912	1910	1910
query3	10993	4559	4576	4559
query4	33012	23773	23514	23514
query5	3687	622	464	464
query6	276	207	179	179
query7	3994	499	320	320
query8	307	254	239	239
query9	9743	2626	2610	2610
query10	474	329	259	259
query11	18197	15358	15215	15215
query12	163	114	106	106
query13	1551	549	421	421
query14	9233	7387	6881	6881
query15	215	216	190	190
query16	7831	730	512	512
query17	1599	791	607	607
query18	2016	421	318	318
query19	222	189	166	166
query20	122	120	120	120
query21	208	131	107	107
query22	4535	4550	4429	4429
query23	34802	34202	33966	33966
query24	7555	2750	2757	2750
query25	508	489	435	435
query26	815	283	176	176
query27	2083	482	375	375
query28	5158	2242	2193	2193
query29	608	621	455	455
query30	239	195	166	166
query31	959	891	863	863
query32	73	57	57	57
query33	492	373	325	325
query34	757	852	528	528
query35	813	832	766	766
query36	998	1063	942	942
query37	96	93	70	70
query38	4037	4038	4000	4000
query39	1540	1456	1446	1446
query40	204	112	109	109
query41	51	49	47	47
query42	128	108	105	105
query43	511	526	480	480
query44	1364	844	843	843
query45	180	189	171	171
query46	902	1078	688	688
query47	1955	1969	1934	1934
query48	420	455	354	354
query49	732	506	417	417
query50	700	716	437	437
query51	7546	7284	7233	7233
query52	108	101	96	96
query53	235	268	195	195
query54	537	552	482	482
query55	81	79	77	77
query56	267	267	252	252
query57	1264	1293	1199	1199
query58	233	221	221	221
query59	3041	3180	2920	2920
query60	300	285	272	272
query61	128	115	107	107
query62	816	730	690	690
query63	230	195	194	194
query64	3100	1004	642	642
query65	3394	3260	3316	3260
query66	774	423	313	313
query67	16395	15990	15549	15549
query68	7039	862	565	565
query69	499	301	272	272
query70	1191	1127	1102	1102
query71	405	291	265	265
query72	5776	3756	3881	3756
query73	639	761	365	365
query74	10329	9358	9007	9007
query75	3232	3134	2686	2686
query76	3105	1196	773	773
query77	498	374	280	280
query78	10388	10478	9686	9686
query79	3260	860	604	604
query80	715	519	434	434
query81	506	260	225	225
query82	643	116	89	89
query83	167	170	156	156
query84	246	109	86	86
query85	786	365	299	299
query86	403	309	294	294
query87	4290	4272	4242	4242
query88	5258	2447	2427	2427
query89	429	332	297	297
query90	1778	196	225	196
query91	134	140	123	123
query92	66	55	53	53
query93	2053	888	552	552
query94	690	421	308	308
query95	359	285	272	272
query96	491	614	290	290
query97	3222	3287	3177	3177
query98	219	216	194	194
query99	1661	1390	1293	1293
Total cold run time: 293498 ms
Total hot run time: 197213 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.15 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a97782727e1dbc0e5869d99b70c858073fb37fdf, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.04	0.04
query3	0.23	0.06	0.06
query4	1.65	0.08	0.09
query5	0.52	0.52	0.52
query6	1.12	0.74	0.74
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.58	0.52	0.49
query10	0.55	0.56	0.55
query11	0.15	0.11	0.12
query12	0.16	0.14	0.13
query13	0.60	0.59	0.60
query14	0.79	0.79	0.81
query15	0.86	0.86	0.84
query16	0.38	0.38	0.37
query17	1.03	1.06	1.07
query18	0.19	0.18	0.18
query19	1.93	1.87	1.90
query20	0.02	0.01	0.01
query21	15.37	0.96	0.66
query22	0.75	0.76	0.68
query23	14.82	1.53	0.70
query24	2.23	0.36	0.23
query25	0.14	0.09	0.08
query26	0.29	0.21	0.18
query27	0.07	0.07	0.08
query28	13.39	1.22	0.54
query29	12.62	4.03	3.37
query30	0.26	0.08	0.05
query31	2.84	0.60	0.40
query32	3.24	0.57	0.48
query33	3.00	3.01	3.00
query34	16.41	5.19	4.49
query35	4.60	4.61	4.66
query36	0.63	0.48	0.50
query37	0.22	0.17	0.16
query38	0.16	0.16	0.15
query39	0.06	0.05	0.04
query40	0.17	0.14	0.13
query41	0.10	0.05	0.05
query42	0.06	0.06	0.05
query43	0.04	0.04	0.04
Total cold run time: 102.41 s
Total hot run time: 29.15 s

@amorynan
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 81.15% (1210/1491)
Line Coverage 65.27% (21315/32657)
Region Coverage 66.77% (10720/16054)
Branch Coverage 56.40% (5638/9996)

@doris-robot
Copy link

TPC-H: Total hot run time: 32705 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f7502e714830ba732df14193a449815aa9028feb, data reload: false

------ Round 1 ----------------------------------
q1	17894	5479	5433	5433
q2	2075	284	183	183
q3	10743	1246	770	770
q4	10463	883	460	460
q5	9565	2367	2122	2122
q6	189	163	137	137
q7	921	745	615	615
q8	9353	1454	1200	1200
q9	5259	4956	4925	4925
q10	6786	2253	1843	1843
q11	503	277	262	262
q12	350	351	205	205
q13	17768	3603	2980	2980
q14	223	221	202	202
q15	527	472	469	469
q16	421	417	377	377
q17	611	868	360	360
q18	7016	6537	6357	6357
q19	1493	949	567	567
q20	331	346	204	204
q21	3206	2220	2037	2037
q22	1060	1022	997	997
Total cold run time: 106757 ms
Total hot run time: 32705 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5638	5504	5520	5504
q2	233	322	229	229
q3	2254	2619	2345	2345
q4	1351	1750	1338	1338
q5	4410	4978	4968	4968
q6	171	160	129	129
q7	2068	1962	1793	1793
q8	2583	2858	2698	2698
q9	7248	7203	7236	7203
q10	3033	3339	2690	2690
q11	582	493	502	493
q12	673	786	637	637
q13	3437	3755	3220	3220
q14	295	302	277	277
q15	518	480	476	476
q16	444	492	432	432
q17	1205	1718	1270	1270
q18	7635	7378	7276	7276
q19	864	1103	1148	1103
q20	1978	2047	1893	1893
q21	5292	4731	4654	4654
q22	1037	1071	1012	1012
Total cold run time: 52949 ms
Total hot run time: 51640 ms

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 25.00% (2/8) 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link

TPC-DS: Total hot run time: 196261 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f7502e714830ba732df14193a449815aa9028feb, data reload: false

query1	1292	977	909	909
query2	6391	1977	1904	1904
query3	10932	4693	4434	4434
query4	32927	23750	23171	23171
query5	3703	604	467	467
query6	285	198	180	180
query7	4005	501	325	325
query8	304	232	224	224
query9	9243	2602	2585	2585
query10	446	341	255	255
query11	17863	15225	15173	15173
query12	158	104	101	101
query13	1551	567	418	418
query14	9100	6751	7426	6751
query15	221	197	183	183
query16	7871	666	491	491
query17	1583	775	616	616
query18	2094	447	328	328
query19	249	197	170	170
query20	127	126	125	125
query21	214	134	109	109
query22	4661	4511	4386	4386
query23	35242	34269	34075	34075
query24	7503	2709	2779	2709
query25	491	501	434	434
query26	923	286	176	176
query27	2647	474	349	349
query28	5705	2195	2167	2167
query29	603	619	469	469
query30	253	192	163	163
query31	978	923	864	864
query32	67	63	57	57
query33	503	394	353	353
query34	773	855	530	530
query35	795	816	750	750
query36	1010	1054	956	956
query37	110	100	68	68
query38	4056	3994	3926	3926
query39	1531	1485	1471	1471
query40	215	119	103	103
query41	49	50	47	47
query42	116	106	104	104
query43	512	526	496	496
query44	1404	851	837	837
query45	187	176	166	166
query46	897	1053	689	689
query47	1943	1970	1935	1935
query48	445	446	358	358
query49	746	499	411	411
query50	687	712	432	432
query51	7492	7349	7173	7173
query52	102	101	96	96
query53	231	266	189	189
query54	558	566	473	473
query55	78	76	79	76
query56	271	270	266	266
query57	1271	1286	1183	1183
query58	240	221	233	221
query59	3140	3296	3115	3115
query60	298	313	276	276
query61	116	115	138	115
query62	800	748	698	698
query63	234	204	200	200
query64	3145	1000	634	634
query65	3376	3283	3270	3270
query66	902	416	318	318
query67	16251	15730	15386	15386
query68	5901	853	537	537
query69	495	318	264	264
query70	1183	1095	1129	1095
query71	400	319	265	265
query72	5727	3761	3593	3593
query73	644	769	358	358
query74	10331	9440	9259	9259
query75	3255	3145	2705	2705
query76	3142	1181	771	771
query77	472	377	276	276
query78	10396	10177	9542	9542
query79	3791	930	585	585
query80	1755	532	430	430
query81	589	262	214	214
query82	1177	121	89	89
query83	246	163	142	142
query84	252	99	83	83
query85	796	349	296	296
query86	463	319	303	303
query87	4294	4324	4259	4259
query88	5085	2396	2378	2378
query89	433	337	304	304
query90	1769	190	191	190
query91	145	141	111	111
query92	68	56	53	53
query93	3005	913	534	534
query94	770	403	308	308
query95	350	280	271	271
query96	488	621	285	285
query97	3132	3306	3183	3183
query98	231	211	197	197
query99	1449	1445	1292	1292
Total cold run time: 296350 ms
Total hot run time: 196261 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 29.25 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f7502e714830ba732df14193a449815aa9028feb, data reload: false

query1	0.03	0.03	0.03
query2	0.08	0.03	0.04
query3	0.23	0.06	0.06
query4	1.64	0.09	0.09
query5	0.52	0.51	0.49
query6	1.12	0.74	0.74
query7	0.02	0.02	0.02
query8	0.06	0.04	0.06
query9	0.58	0.52	0.49
query10	0.56	0.56	0.57
query11	0.17	0.12	0.12
query12	0.16	0.12	0.12
query13	0.60	0.60	0.60
query14	0.78	0.79	0.81
query15	0.86	0.83	0.85
query16	0.39	0.41	0.36
query17	1.03	1.04	1.08
query18	0.20	0.18	0.20
query19	2.02	1.91	1.82
query20	0.01	0.02	0.01
query21	15.40	0.95	0.66
query22	0.77	0.76	0.68
query23	14.81	1.50	0.67
query24	2.18	0.37	0.22
query25	0.15	0.09	0.09
query26	0.30	0.19	0.19
query27	0.08	0.08	0.08
query28	13.44	1.22	0.56
query29	12.65	4.08	3.39
query30	0.25	0.11	0.07
query31	2.81	0.60	0.41
query32	3.22	0.57	0.48
query33	2.96	3.05	3.03
query34	16.51	5.18	4.56
query35	4.60	4.63	4.61
query36	0.63	0.51	0.49
query37	0.21	0.18	0.17
query38	0.17	0.16	0.16
query39	0.06	0.05	0.04
query40	0.17	0.14	0.13
query41	0.09	0.06	0.05
query42	0.06	0.05	0.06
query43	0.06	0.05	0.04
Total cold run time: 102.64 s
Total hot run time: 29.25 s

@morrySnow morrySnow merged commit d94ad18 into apache:branch-3.1 Jul 31, 2025
20 of 21 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants