Skip to content

[fix](Nereids) self join not always could do colocate join#54323

Merged
morrySnow merged 1 commit intoapache:masterfrom
morrySnow:fix_colocate_join
Aug 5, 2025
Merged

[fix](Nereids) self join not always could do colocate join#54323
morrySnow merged 1 commit intoapache:masterfrom
morrySnow:fix_colocate_join

Conversation

@morrySnow
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@morrySnow
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33853 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 83eac11daefe4e5c3ff5ae1fc2d7611c9740790c, data reload: false

------ Round 1 ----------------------------------
q1	17584	5299	5235	5235
q2	1916	294	185	185
q3	10316	1287	689	689
q4	10218	1069	531	531
q5	7484	2264	2306	2264
q6	179	168	136	136
q7	875	766	632	632
q8	9301	1232	1038	1038
q9	6726	5024	5069	5024
q10	6882	2354	1994	1994
q11	455	282	273	273
q12	364	364	238	238
q13	17774	3442	3022	3022
q14	242	244	220	220
q15	514	471	465	465
q16	435	432	371	371
q17	565	826	350	350
q18	7493	7021	7043	7021
q19	916	982	552	552
q20	313	320	228	228
q21	2815	3050	2360	2360
q22	1068	1025	1051	1025
Total cold run time: 104435 ms
Total hot run time: 33853 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5324	5320	5264	5264
q2	241	311	215	215
q3	2079	2558	2172	2172
q4	1336	1751	1316	1316
q5	4103	4174	4554	4174
q6	224	183	144	144
q7	1971	1955	1802	1802
q8	2551	2557	2488	2488
q9	7290	7574	7139	7139
q10	3241	3314	2907	2907
q11	549	514	508	508
q12	691	755	648	648
q13	3380	3751	3217	3217
q14	288	317	298	298
q15	502	443	464	443
q16	478	544	505	505
q17	1231	1531	1376	1376
q18	11060	7878	7663	7663
q19	9330	1141	1259	1141
q20	2045	2025	1912	1912
q21	10878	4274	4260	4260
q22	1060	1052	966	966
Total cold run time: 69852 ms
Total hot run time: 50558 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 171112 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 83eac11daefe4e5c3ff5ae1fc2d7611c9740790c, data reload: false

============================================
query1	994	382	436	382
query2	6530	1924	1733	1733
query3	6744	225	225	225
query4	27153	23653	23086	23086
query5	4361	669	556	556
query6	354	251	261	251
query7	4645	532	304	304
query8	298	235	236	235
query9	8560	2986	2946	2946
query10	473	350	317	317
query11	15945	14983	14886	14886
query12	182	140	130	130
query13	1661	567	431	431
query14	8632	6051	5873	5873
query15	214	186	169	169
query16	7810	641	445	445
query17	1634	822	632	632
query18	2084	450	312	312
query19	278	214	216	214
query20	156	147	142	142
query21	220	126	110	110
query22	4249	4003	3852	3852
query23	34838	34385	34358	34358
query24	8124	2403	2438	2403
query25	546	553	441	441
query26	928	291	169	169
query27	2630	498	360	360
query28	4261	2377	2354	2354
query29	720	596	513	513
query30	299	245	205	205
query31	872	775	709	709
query32	93	76	83	76
query33	555	434	375	375
query34	815	862	526	526
query35	825	839	762	762
query36	1055	1019	927	927
query37	133	118	93	93
query38	3943	4064	3927	3927
query39	1449	1405	1363	1363
query40	236	145	140	140
query41	66	59	59	59
query42	145	131	133	131
query43	553	517	478	478
query44	1404	885	881	881
query45	201	183	188	183
query46	953	1059	696	696
query47	1801	1827	1763	1763
query48	405	430	321	321
query49	703	505	466	466
query50	655	703	429	429
query51	4187	4203	4176	4176
query52	130	134	120	120
query53	257	297	227	227
query54	663	659	573	573
query55	95	90	91	90
query56	357	359	357	357
query57	1226	1239	1145	1145
query58	351	341	343	341
query59	2552	2696	2543	2543
query60	409	401	400	400
query61	128	128	124	124
query62	808	719	654	654
query63	257	212	227	212
query64	3526	1129	802	802
query65	4215	4163	4133	4133
query66	975	470	369	369
query67	query68	16539	874	840	840
query69	1152	292	296	292
query70	1458	1150	1151	1150
query71	716	323	332	323
query72	9409	2253	2251	2251
query73	2979	695	363	363
query74	9109	8941	8783	8783
query75	7656	3145	2658	2658
query76	8856	1205	786	786
query77	1151	427	336	336
query78	9736	10611	9471	9471
query79	15333	578	576	576
query80	3303	542	505	505
query81	538	263	230	230
query82	550	153	124	124
query83	369	280	269	269
query84	292	99	78	78
query85	988	368	328	328
query86	358	325	320	320
query87	4285	4205	4142	4142
query88	5676	2245	2216	2216
query89	498	355	359	355
query90	2503	230	228	228
query91	145	141	118	118
query92	86	72	68	68
query93	6615	969	655	655
query94	1305	391	295	295
query95	448	333	330	330
query96	507	591	278	278
query97	2726	2748	2609	2609
query98	279	238	225	225
query99	1479	1398	1305	1305
Total cold run time: 309565 ms
Total hot run time: 171112 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.91 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 83eac11daefe4e5c3ff5ae1fc2d7611c9740790c, data reload: false

query1	0.04	0.03	0.04
query2	0.07	0.04	0.04
query3	0.25	0.07	0.08
query4	1.60	0.10	0.11
query5	0.43	0.41	0.42
query6	1.16	0.66	0.65
query7	0.03	0.02	0.02
query8	0.04	0.04	0.04
query9	0.56	0.48	0.47
query10	0.53	0.53	0.52
query11	0.16	0.10	0.11
query12	0.14	0.11	0.11
query13	0.63	0.63	0.65
query14	0.94	1.08	1.19
query15	0.90	0.90	0.89
query16	0.40	0.39	0.39
query17	1.09	1.07	1.09
query18	0.21	0.20	0.20
query19	2.05	1.91	1.93
query20	0.01	0.01	0.02
query21	15.39	0.85	0.55
query22	0.76	1.12	0.67
query23	14.97	1.18	0.62
query24	6.14	1.95	0.46
query25	0.49	0.18	0.14
query26	0.71	0.16	0.14
query27	0.06	0.06	0.05
query28	9.29	0.85	0.46
query29	12.58	3.79	3.30
query30	3.09	2.98	3.02
query31	2.82	0.57	0.39
query32	3.23	0.57	0.50
query33	2.98	3.17	3.25
query34	16.13	5.33	4.94
query35	4.90	4.94	4.93
query36	0.70	0.53	0.50
query37	0.10	0.08	0.08
query38	0.06	0.05	0.04
query39	0.04	0.03	0.03
query40	0.17	0.13	0.14
query41	0.08	0.03	0.03
query42	0.04	0.03	0.03
query43	0.04	0.03	0.03
Total cold run time: 106.01 s
Total hot run time: 32.91 s

@github-actions
Copy link
Contributor

github-actions bot commented Aug 5, 2025

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Aug 5, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Aug 5, 2025

PR approved by anyone and no changes requested.

@morrySnow morrySnow merged commit ff319b2 into apache:master Aug 5, 2025
31 of 33 checks passed
@morrySnow morrySnow deleted the fix_colocate_join branch August 5, 2025 07:29
morrySnow added a commit to morrySnow/incubator-doris that referenced this pull request Aug 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants

Comments