Skip to content

[feat](eager-agg)Eager agg 0214#60757

Draft
englefly wants to merge 14 commits intoapache:masterfrom
englefly:eager-agg-0214
Draft

[feat](eager-agg)Eager agg 0214#60757
englefly wants to merge 14 commits intoapache:masterfrom
englefly:eager-agg-0214

Conversation

@englefly
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Feb 14, 2026

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 27608 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f90def55f7e6340e69de14ccf648f940ba0378c3, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17676	4511	4329	4329
q2	q3	10643	785	510	510
q4	4682	359	249	249
q5	7557	1242	1014	1014
q6	177	175	146	146
q7	780	840	669	669
q8	9752	1500	1332	1332
q9	5280	4783	4753	4753
q10	6324	1922	1668	1668
q11	471	268	232	232
q12	815	576	468	468
q13	18066	2941	2172	2172
q14	235	230	217	217
q15	954	802	795	795
q16	791	727	674	674
q17	711	861	413	413
q18	6009	5490	5268	5268
q19	1508	998	637	637
q20	491	485	401	401
q21	4475	1837	1419	1419
q22	337	296	242	242
Total cold run time: 97734 ms
Total hot run time: 27608 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4558	4341	4551	4341
q2	q3	3866	4268	3753	3753
q4	850	1152	768	768
q5	4008	4331	4335	4331
q6	182	173	147	147
q7	1721	1619	1491	1491
q8	2440	2655	2528	2528
q9	7988	7518	7376	7376
q10	3764	3989	3571	3571
q11	519	442	410	410
q12	478	612	491	491
q13	2740	3334	2324	2324
q14	289	333	290	290
q15	906	803	793	793
q16	742	791	703	703
q17	1169	1438	1330	1330
q18	7195	6885	6866	6866
q19	886	918	945	918
q20	2057	2155	2131	2131
q21	3967	3516	3302	3302
q22	462	459	416	416
Total cold run time: 50787 ms
Total hot run time: 48280 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 152972 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f90def55f7e6340e69de14ccf648f940ba0378c3, data reload: false

query5	4329	637	531	531
query6	317	225	203	203
query7	4227	478	270	270
query8	343	241	221	221
query9	8748	2771	2768	2768
query10	533	378	377	377
query11	7388	5866	5543	5543
query12	183	127	126	126
query13	1294	461	354	354
query14	5720	3818	3527	3527
query14_1	2773	2771	2820	2771
query15	206	197	179	179
query16	1025	481	471	471
query17	1110	729	624	624
query18	2443	442	358	358
query19	238	211	183	183
query20	136	134	131	131
query21	228	151	126	126
query22	4743	5049	4848	4848
query23	16875	15925	15889	15889
query23_1	15876	15848	15839	15839
query24	7710	1689	1329	1329
query24_1	1359	1302	1260	1260
query25	585	526	468	468
query26	1018	269	165	165
query27	2721	466	288	288
query28	4499	1890	1862	1862
query29	864	554	465	465
query30	321	247	215	215
query31	1360	1300	1208	1208
query32	82	74	69	69
query33	528	340	275	275
query34	924	897	576	576
query35	648	682	593	593
query36	1067	1146	917	917
query37	136	90	79	79
query38	2965	2871	2868	2868
query39	893	863	852	852
query39_1	829	828	836	828
query40	228	148	133	133
query41	63	59	58	58
query42	304	301	290	290
query43	240	246	220	220
query44	
query45	195	194	177	177
query46	873	969	609	609
query47	2112	2166	2077	2077
query48	330	312	232	232
query49	632	461	378	378
query50	675	272	220	220
query51	4106	4078	4062	4062
query52	286	302	282	282
query53	290	334	294	294
query54	310	272	255	255
query55	136	90	82	82
query56	310	310	302	302
query57	1375	1345	1284	1284
query58	295	294	270	270
query59	1378	1436	1255	1255
query60	344	341	336	336
query61	148	145	146	145
query62	642	582	534	534
query63	302	277	280	277
query64	4742	1276	1015	1015
query65	
query66	1410	456	358	358
query67	16535	16302	16314	16302
query68	
query69	382	323	296	296
query70	939	980	987	980
query71	346	311	289	289
query72	2742	2649	2332	2332
query73	542	539	318	318
query74	10079	9967	9769	9769
query75	2844	2753	2433	2433
query76	2301	1042	667	667
query77	357	366	294	294
query78	11301	11406	10646	10646
query79	2570	813	600	600
query80	1726	601	534	534
query81	571	284	244	244
query82	1009	150	118	118
query83	330	262	253	253
query84	250	117	102	102
query85	917	471	425	425
query86	412	297	295	295
query87	3135	3093	2963	2963
query88	3539	2685	2670	2670
query89	417	362	337	337
query90	2023	182	165	165
query91	166	155	132	132
query92	78	74	74	74
query93	1132	813	516	516
query94	633	334	287	287
query95	599	391	303	303
query96	641	511	228	228
query97	2449	2476	2435	2435
query98	238	214	218	214
query99	996	986	926	926
Total cold run time: 235608 ms
Total hot run time: 152972 ms

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 63.48% (412/649) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

FE Regression Coverage Report

Increment line coverage 74.58% (484/649) 🎉
Increment coverage report
Complete coverage report

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 27615 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 742e5dc1a961547a7c51c084b61e93ee833a0d02, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17674	4467	4292	4292
q2	q3	10663	795	510	510
q4	4678	354	255	255
q5	7565	1188	1027	1027
q6	176	181	142	142
q7	787	845	662	662
q8	9302	1443	1298	1298
q9	4760	4714	4661	4661
q10	6298	1902	1670	1670
q11	490	267	241	241
q12	715	563	475	475
q13	18062	2902	2149	2149
q14	229	231	213	213
q15	934	793	801	793
q16	743	724	674	674
q17	700	844	415	415
q18	5919	5499	5309	5309
q19	1203	989	596	596
q20	512	488	380	380
q21	4436	1935	1581	1581
q22	352	336	272	272
Total cold run time: 96198 ms
Total hot run time: 27615 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4639	4529	4581	4529
q2	q3	4008	4364	3824	3824
q4	862	1164	744	744
q5	4024	4387	4448	4387
q6	184	172	139	139
q7	1798	1604	1481	1481
q8	2443	2711	2539	2539
q9	7574	7446	7268	7268
q10	3760	3926	3589	3589
q11	530	456	429	429
q12	520	604	485	485
q13	2957	3205	2335	2335
q14	280	302	271	271
q15	882	812	795	795
q16	690	757	758	757
q17	1132	1440	1413	1413
q18	7288	6837	6699	6699
q19	860	877	953	877
q20	2053	2124	2029	2029
q21	3949	3482	3264	3264
q22	453	437	404	404
Total cold run time: 50886 ms
Total hot run time: 48258 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 152691 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 742e5dc1a961547a7c51c084b61e93ee833a0d02, data reload: false

query5	4334	629	523	523
query6	326	217	218	217
query7	4218	477	265	265
query8	321	236	223	223
query9	8703	2739	2727	2727
query10	518	373	334	334
query11	7390	5856	5638	5638
query12	175	122	125	122
query13	1258	465	327	327
query14	5662	3807	3591	3591
query14_1	2831	2752	2762	2752
query15	195	191	172	172
query16	978	475	435	435
query17	1074	689	593	593
query18	2434	447	337	337
query19	205	207	172	172
query20	133	122	123	122
query21	218	145	119	119
query22	4773	4861	4722	4722
query23	16676	15900	15654	15654
query23_1	15678	15921	15741	15741
query24	7404	1694	1293	1293
query24_1	1281	1247	1268	1247
query25	560	488	433	433
query26	1299	272	161	161
query27	2918	479	295	295
query28	4799	1904	1983	1904
query29	870	574	463	463
query30	310	243	207	207
query31	1355	1276	1216	1216
query32	78	72	72	72
query33	502	324	277	277
query34	903	925	572	572
query35	635	671	635	635
query36	1076	1144	942	942
query37	133	97	80	80
query38	2896	2940	2844	2844
query39	880	872	859	859
query39_1	806	847	852	847
query40	234	153	131	131
query41	61	60	61	60
query42	300	298	297	297
query43	249	240	221	221
query44	
query45	199	192	179	179
query46	886	988	604	604
query47	2105	2143	2052	2052
query48	328	323	240	240
query49	646	470	398	398
query50	707	287	220	220
query51	4089	4066	4035	4035
query52	286	291	281	281
query53	294	351	284	284
query54	303	284	283	283
query55	100	85	92	85
query56	324	342	317	317
query57	1342	1322	1269	1269
query58	299	289	280	280
query59	1332	1415	1283	1283
query60	355	340	337	337
query61	166	182	170	170
query62	635	596	543	543
query63	311	276	278	276
query64	5080	1342	1108	1108
query65	
query66	1476	445	368	368
query67	16372	16570	16285	16285
query68	
query69	392	300	279	279
query70	893	1016	944	944
query71	351	318	304	304
query72	2790	2677	2388	2388
query73	542	549	318	318
query74	10022	9950	9781	9781
query75	2845	2783	2456	2456
query76	2299	1038	698	698
query77	355	393	311	311
query78	11221	11293	10643	10643
query79	3089	816	589	589
query80	1718	621	522	522
query81	596	278	252	252
query82	1016	147	118	118
query83	336	266	245	245
query84	251	130	98	98
query85	928	490	440	440
query86	448	299	292	292
query87	3141	3062	2943	2943
query88	3522	2669	2649	2649
query89	433	362	344	344
query90	2002	178	177	177
query91	171	158	133	133
query92	75	72	68	68
query93	1359	815	494	494
query94	637	330	286	286
query95	584	391	309	309
query96	628	511	226	226
query97	2461	2513	2411	2411
query98	237	218	217	217
query99	989	998	920	920
Total cold run time: 236738 ms
Total hot run time: 152691 ms

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 63.48% (412/649) 🎉
Increment coverage report
Complete coverage report

@hello-stephen
Copy link
Contributor

FE Regression Coverage Report

Increment line coverage 74.58% (484/649) 🎉
Increment coverage report
Complete coverage report

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 27628 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d8703bf984891db2830e567b16976638d0b6c9b4, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17629	4560	4300	4300
q2	q3	10656	766	520	520
q4	4671	343	250	250
q5	7556	1201	1018	1018
q6	184	179	158	158
q7	783	847	679	679
q8	9311	1455	1360	1360
q9	4820	4790	4693	4693
q10	6303	1893	1632	1632
q11	469	265	253	253
q12	716	575	475	475
q13	18061	2914	2209	2209
q14	231	231	214	214
q15	958	789	790	789
q16	781	713	679	679
q17	705	876	433	433
q18	5896	5413	5225	5225
q19	1387	977	628	628
q20	503	512	392	392
q21	4490	1935	1461	1461
q22	344	291	260	260
Total cold run time: 96454 ms
Total hot run time: 27628 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4449	4355	4381	4355
q2	q3	3879	4388	3818	3818
q4	880	1201	804	804
q5	4078	4385	4305	4305
q6	191	177	145	145
q7	1743	1629	1506	1506
q8	2459	2686	2593	2593
q9	7828	7368	7310	7310
q10	3779	3983	3684	3684
q11	510	432	455	432
q12	543	627	466	466
q13	2779	3399	2405	2405
q14	295	303	279	279
q15	845	825	838	825
q16	740	779	713	713
q17	1162	1456	1380	1380
q18	7085	6796	6669	6669
q19	886	879	920	879
q20	2143	2232	2014	2014
q21	4168	3587	3411	3411
q22	458	445	418	418
Total cold run time: 50900 ms
Total hot run time: 48411 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 152941 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d8703bf984891db2830e567b16976638d0b6c9b4, data reload: false

query5	4332	635	506	506
query6	314	233	219	219
query7	4213	474	270	270
query8	348	261	234	234
query9	8726	2754	2747	2747
query10	518	385	341	341
query11	7431	5864	5548	5548
query12	178	125	127	125
query13	1265	455	355	355
query14	6194	3794	3571	3571
query14_1	2862	2837	2877	2837
query15	204	194	175	175
query16	992	471	427	427
query17	1113	726	623	623
query18	2476	457	352	352
query19	219	209	185	185
query20	137	129	130	129
query21	224	178	120	120
query22	4791	5091	4882	4882
query23	16713	16010	15670	15670
query23_1	15828	15890	15867	15867
query24	7874	1707	1306	1306
query24_1	1290	1287	1308	1287
query25	580	473	416	416
query26	1237	255	142	142
query27	2780	471	285	285
query28	4500	1867	1858	1858
query29	793	566	477	477
query30	309	237	208	208
query31	1340	1299	1225	1225
query32	77	68	74	68
query33	533	353	271	271
query34	915	914	548	548
query35	644	665	611	611
query36	1062	1130	946	946
query37	137	92	83	83
query38	2994	2898	2904	2898
query39	894	905	853	853
query39_1	844	822	813	813
query40	227	153	134	134
query41	61	59	57	57
query42	300	297	301	297
query43	237	252	227	227
query44	
query45	192	188	180	180
query46	876	970	600	600
query47	2095	2129	2033	2033
query48	312	314	231	231
query49	665	456	379	379
query50	664	279	218	218
query51	4093	4044	4111	4044
query52	286	296	278	278
query53	291	341	280	280
query54	286	262	253	253
query55	87	84	80	80
query56	310	306	311	306
query57	1348	1336	1274	1274
query58	286	273	266	266
query59	1330	1487	1316	1316
query60	344	343	315	315
query61	177	144	148	144
query62	620	584	531	531
query63	304	279	268	268
query64	4979	1279	983	983
query65	
query66	1450	471	358	358
query67	16381	16336	16291	16291
query68	
query69	382	311	284	284
query70	983	927	967	927
query71	333	300	290	290
query72	2829	2664	2502	2502
query73	535	545	331	331
query74	9976	9926	9829	9829
query75	2842	2762	2475	2475
query76	2325	1036	686	686
query77	373	405	318	318
query78	11239	11401	10714	10714
query79	1129	805	592	592
query80	717	649	562	562
query81	516	283	242	242
query82	1339	149	119	119
query83	379	282	253	253
query84	259	127	102	102
query85	933	572	522	522
query86	376	309	286	286
query87	3133	3076	2978	2978
query88	3515	2655	2634	2634
query89	423	374	342	342
query90	1933	195	170	170
query91	170	153	129	129
query92	83	73	69	69
query93	899	821	494	494
query94	453	319	292	292
query95	584	342	330	330
query96	636	510	226	226
query97	2490	2501	2424	2424
query98	232	222	213	213
query99	1019	996	865	865
Total cold run time: 232655 ms
Total hot run time: 152941 ms

@hello-stephen
Copy link
Contributor

FE Regression Coverage Report

Increment line coverage 74.58% (484/649) 🎉
Increment coverage report
Complete coverage report

@englefly
Copy link
Contributor Author

run buildall

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 27570 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5e7967e160c4d801b6c3c321202ed1a4d18fb351, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17622	4492	4331	4331
q2	q3	10641	832	535	535
q4	4683	376	275	275
q5	7567	1197	1017	1017
q6	181	176	149	149
q7	781	845	670	670
q8	9297	1468	1298	1298
q9	4950	4721	4729	4721
q10	6333	1897	1712	1712
q11	491	253	242	242
q12	776	565	459	459
q13	18089	2919	2183	2183
q14	241	228	215	215
q15	956	795	797	795
q16	786	727	681	681
q17	708	867	418	418
q18	5964	5411	5225	5225
q19	1121	996	615	615
q20	523	491	395	395
q21	4542	1821	1397	1397
q22	367	279	237	237
Total cold run time: 96619 ms
Total hot run time: 27570 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4396	4336	4350	4336
q2	q3	3816	4323	3791	3791
q4	833	1155	782	782
q5	4037	4304	4338	4304
q6	183	171	139	139
q7	1707	1596	1482	1482
q8	2433	2672	2532	2532
q9	7850	7600	7742	7600
q10	3795	4029	3575	3575
q11	524	438	426	426
q12	484	568	465	465
q13	2689	3129	2525	2525
q14	306	303	281	281
q15	858	798	791	791
q16	711	762	777	762
q17	1200	1434	1354	1354
q18	7253	6959	6619	6619
q19	876	905	892	892
q20	2077	2159	2011	2011
q21	4006	3448	3407	3407
q22	466	434	401	401
Total cold run time: 50500 ms
Total hot run time: 48475 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 153610 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5e7967e160c4d801b6c3c321202ed1a4d18fb351, data reload: false

query5	4315	646	506	506
query6	337	243	218	218
query7	4207	479	268	268
query8	336	267	232	232
query9	8729	2728	2699	2699
query10	508	393	332	332
query11	7254	5878	5532	5532
query12	178	129	125	125
query13	1270	449	367	367
query14	5655	3811	3573	3573
query14_1	2776	2779	2793	2779
query15	205	196	177	177
query16	1012	486	387	387
query17	1112	730	619	619
query18	2448	454	353	353
query19	216	212	187	187
query20	139	134	127	127
query21	230	145	131	131
query22	4936	5016	4674	4674
query23	15954	15540	15412	15412
query23_1	15460	16229	16036	16036
query24	7521	1673	1260	1260
query24_1	1293	1304	1271	1271
query25	635	530	487	487
query26	1482	302	178	178
query27	2992	529	308	308
query28	4902	1944	1946	1944
query29	924	628	506	506
query30	316	273	220	220
query31	1564	1372	1301	1301
query32	87	85	72	72
query33	554	377	275	275
query34	954	944	619	619
query35	684	701	715	701
query36	1216	1231	1052	1052
query37	143	104	87	87
query38	3118	3143	3111	3111
query39	945	988	897	897
query39_1	870	893	867	867
query40	243	160	143	143
query41	64	61	66	61
query42	314	315	318	315
query43	252	264	232	232
query44	
query45	204	203	187	187
query46	897	999	642	642
query47	2284	2253	2088	2088
query48	302	337	227	227
query49	628	448	374	374
query50	680	276	217	217
query51	4129	4164	4115	4115
query52	289	293	279	279
query53	290	337	289	289
query54	307	278	262	262
query55	92	98	85	85
query56	329	320	312	312
query57	1343	1326	1263	1263
query58	288	277	278	277
query59	1336	1428	1262	1262
query60	342	347	334	334
query61	152	151	153	151
query62	624	580	535	535
query63	311	278	278	278
query64	5102	1269	1003	1003
query65	
query66	1445	457	361	361
query67	16689	16356	16316	16316
query68	
query69	390	320	291	291
query70	963	986	956	956
query71	338	306	295	295
query72	2850	2680	2477	2477
query73	529	539	319	319
query74	9996	9951	9784	9784
query75	2896	2757	2445	2445
query76	2309	1043	660	660
query77	357	382	309	309
query78	11268	11451	10709	10709
query79	1638	798	592	592
query80	1334	604	548	548
query81	572	280	243	243
query82	987	149	122	122
query83	332	256	244	244
query84	254	114	98	98
query85	908	470	436	436
query86	420	310	309	309
query87	3158	3069	3011	3011
query88	3531	2634	2602	2602
query89	423	373	344	344
query90	2031	177	173	173
query91	169	158	139	139
query92	74	74	76	74
query93	991	821	503	503
query94	652	321	283	283
query95	589	350	310	310
query96	626	498	224	224
query97	2494	2478	2410	2410
query98	232	216	215	215
query99	1024	977	901	901
Total cold run time: 235040 ms
Total hot run time: 153610 ms

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 27389 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 295bd29e62c92509a9b96dd18e2ee72013855af9, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17660	4527	4280	4280
q2	q3	10658	781	523	523
q4	4675	358	251	251
q5	7546	1188	1014	1014
q6	170	172	146	146
q7	759	826	665	665
q8	9299	1445	1323	1323
q9	4848	4706	4721	4706
q10	6295	1918	1639	1639
q11	457	251	254	251
q12	703	566	460	460
q13	18060	2903	2175	2175
q14	218	224	210	210
q15	937	797	790	790
q16	769	710	671	671
q17	694	849	416	416
q18	5904	5487	5220	5220
q19	1135	993	620	620
q20	501	481	384	384
q21	4333	1803	1407	1407
q22	339	283	238	238
Total cold run time: 95960 ms
Total hot run time: 27389 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4374	4326	4310	4310
q2	q3	3813	4272	3755	3755
q4	843	1152	779	779
q5	4017	4296	4285	4285
q6	171	175	140	140
q7	1713	1659	1498	1498
q8	2384	2627	2489	2489
q9	7578	7456	7202	7202
q10	3815	3988	3680	3680
q11	533	459	439	439
q12	499	609	472	472
q13	2738	3157	2324	2324
q14	276	285	281	281
q15	836	804	796	796
q16	745	787	724	724
q17	1157	1474	1367	1367
q18	7231	6786	6606	6606
q19	882	872	904	872
q20	2124	2150	1989	1989
q21	4113	3538	3340	3340
q22	425	460	386	386
Total cold run time: 50267 ms
Total hot run time: 47734 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 152811 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 295bd29e62c92509a9b96dd18e2ee72013855af9, data reload: false

query5	4335	623	507	507
query6	331	215	203	203
query7	4218	462	259	259
query8	342	241	239	239
query9	8706	2715	2688	2688
query10	521	377	346	346
query11	7340	5845	5590	5590
query12	188	153	122	122
query13	1250	454	362	362
query14	5509	3733	3518	3518
query14_1	2759	2735	2727	2727
query15	203	190	170	170
query16	986	508	443	443
query17	1077	699	577	577
query18	2450	425	337	337
query19	204	203	204	203
query20	133	135	131	131
query21	222	137	121	121
query22	4936	5050	4937	4937
query23	16702	15942	15691	15691
query23_1	15720	15985	16009	15985
query24	8362	1658	1270	1270
query24_1	1409	1313	1273	1273
query25	555	492	443	443
query26	1321	276	173	173
query27	2791	485	294	294
query28	4490	1862	1867	1862
query29	835	581	508	508
query30	313	256	213	213
query31	1379	1285	1226	1226
query32	83	73	79	73
query33	521	363	294	294
query34	950	922	564	564
query35	643	691	611	611
query36	1086	1130	969	969
query37	138	94	87	87
query38	2963	2937	2836	2836
query39	896	865	854	854
query39_1	834	836	822	822
query40	231	151	136	136
query41	69	65	62	62
query42	302	293	292	292
query43	244	251	218	218
query44	
query45	201	193	191	191
query46	882	987	609	609
query47	2150	2168	2097	2097
query48	349	311	234	234
query49	683	453	378	378
query50	674	270	204	204
query51	4118	4148	4024	4024
query52	283	290	279	279
query53	283	332	282	282
query54	291	261	254	254
query55	94	88	84	84
query56	332	306	304	304
query57	1373	1345	1269	1269
query58	286	267	273	267
query59	1352	1481	1279	1279
query60	337	335	321	321
query61	145	146	141	141
query62	625	576	534	534
query63	312	275	279	275
query64	4950	1276	964	964
query65	
query66	1472	461	364	364
query67	16424	16379	16263	16263
query68	
query69	392	310	284	284
query70	951	960	958	958
query71	340	304	282	282
query72	2786	2649	2397	2397
query73	540	559	320	320
query74	9954	9991	9759	9759
query75	2845	2737	2462	2462
query76	2251	1037	660	660
query77	365	393	294	294
query78	11292	11342	10711	10711
query79	3140	763	597	597
query80	1770	614	552	552
query81	564	285	246	246
query82	1031	146	116	116
query83	331	262	241	241
query84	250	117	103	103
query85	923	490	425	425
query86	413	308	266	266
query87	3182	3060	2963	2963
query88	3536	2631	2625	2625
query89	430	367	339	339
query90	1998	190	171	171
query91	163	159	131	131
query92	74	75	68	68
query93	1437	820	497	497
query94	640	323	303	303
query95	573	385	308	308
query96	638	504	226	226
query97	2466	2496	2449	2449
query98	250	245	220	220
query99	1030	997	929	929
Total cold run time: 237220 ms
Total hot run time: 152811 ms

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage 63.48% (412/649) 🎉
Increment coverage report
Complete coverage report

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 27560 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0f4a389ce3320e82030c9782a8f835edb2a3f112, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17697	4517	4334	4334
q2	q3	10647	791	528	528
q4	4692	359	258	258
q5	7733	1213	1014	1014
q6	192	183	156	156
q7	811	854	668	668
q8	10445	1480	1330	1330
q9	5654	4767	4729	4729
q10	6322	1915	1630	1630
q11	469	260	247	247
q12	751	572	471	471
q13	18056	2937	2216	2216
q14	239	231	223	223
q15	940	832	785	785
q16	749	716	668	668
q17	728	865	400	400
q18	6678	5312	5270	5270
q19	1402	974	607	607
q20	503	489	387	387
q21	4508	1828	1398	1398
q22	340	288	241	241
Total cold run time: 99556 ms
Total hot run time: 27560 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4502	4342	4349	4342
q2	q3	3856	4300	3787	3787
q4	840	1160	799	799
q5	4044	4343	4325	4325
q6	182	170	138	138
q7	1716	1632	1461	1461
q8	2395	2670	2612	2612
q9	7831	7439	7316	7316
q10	3751	3962	3598	3598
q11	523	434	408	408
q12	507	593	453	453
q13	2753	3193	2383	2383
q14	299	322	286	286
q15	850	831	871	831
q16	740	802	718	718
q17	1214	1441	1359	1359
q18	7040	6798	6712	6712
q19	864	916	959	916
q20	2091	2168	2170	2168
q21	3953	3460	3319	3319
q22	455	412	378	378
Total cold run time: 50406 ms
Total hot run time: 48309 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 153374 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0f4a389ce3320e82030c9782a8f835edb2a3f112, data reload: false

query5	4358	633	509	509
query6	334	225	227	225
query7	4233	466	261	261
query8	332	230	221	221
query9	8736	2747	2724	2724
query10	558	384	356	356
query11	7331	5870	5615	5615
query12	194	124	124	124
query13	1268	455	346	346
query14	5607	3882	3566	3566
query14_1	2813	2826	2821	2821
query15	203	194	178	178
query16	1010	489	461	461
query17	1103	731	617	617
query18	2500	456	361	361
query19	214	214	183	183
query20	133	136	130	130
query21	232	143	128	128
query22	4924	4812	4894	4812
query23	16961	16106	15878	15878
query23_1	15916	15778	15865	15778
query24	7565	1674	1239	1239
query24_1	1289	1298	1300	1298
query25	575	645	519	519
query26	1738	267	154	154
query27	2822	473	295	295
query28	4488	1852	1867	1852
query29	832	564	478	478
query30	309	245	206	206
query31	1364	1275	1222	1222
query32	82	71	70	70
query33	502	335	318	318
query34	915	922	566	566
query35	636	679	597	597
query36	1091	1110	996	996
query37	129	92	84	84
query38	2974	2913	2840	2840
query39	874	877	833	833
query39_1	825	822	840	822
query40	228	155	135	135
query41	62	60	58	58
query42	297	298	295	295
query43	244	242	218	218
query44	
query45	204	191	184	184
query46	878	985	603	603
query47	2078	2150	2010	2010
query48	315	311	219	219
query49	628	460	375	375
query50	667	280	212	212
query51	4247	4146	4040	4040
query52	288	293	281	281
query53	287	330	274	274
query54	289	263	259	259
query55	96	94	82	82
query56	316	313	305	305
query57	1361	1332	1257	1257
query58	283	277	310	277
query59	1330	1505	1254	1254
query60	338	334	317	317
query61	148	147	149	147
query62	636	597	549	549
query63	311	278	273	273
query64	5048	1253	1002	1002
query65	
query66	1452	468	354	354
query67	16436	16344	16252	16252
query68	
query69	388	304	289	289
query70	952	987	999	987
query71	336	312	314	312
query72	2842	2753	2508	2508
query73	542	555	338	338
query74	9969	9870	9816	9816
query75	2887	2771	2475	2475
query76	2298	1037	687	687
query77	371	379	321	321
query78	11146	11266	10709	10709
query79	3040	822	602	602
query80	1768	650	570	570
query81	551	293	247	247
query82	1005	155	127	127
query83	335	278	250	250
query84	259	127	108	108
query85	987	552	437	437
query86	412	322	334	322
query87	3136	3069	2986	2986
query88	3556	2672	2661	2661
query89	433	365	344	344
query90	1863	176	169	169
query91	161	161	137	137
query92	78	73	67	67
query93	1210	830	499	499
query94	644	324	302	302
query95	589	393	313	313
query96	636	527	235	235
query97	2490	2525	2400	2400
query98	242	219	222	219
query99	1002	990	916	916
Total cold run time: 237032 ms
Total hot run time: 153374 ms

englefly and others added 13 commits March 2, 2026 10:11
ds14 增加了agg push,执行时间 4.7 -> 4.8
h13 增加了 agg push,应该让p6 恢复到 p4 的成绩,提高一些

当任一 group key的ndv 接近 行数(0.9 倍)时,不下推agg

DORIS-24367 case-when 不能下推join 补null的一侧

pick unnest-subquery-cte

ut-tmp

adjust rt

update-shape

fix eager_agg.groovy, runtime_filter_mode=OFF;

fmt

14/67 因为rebase后增加了 repeat 拆分, 形状变化

支持  min(if), max(if), 增加了context.isValid检查,避免无效下推

doris-24240: rewriteRoot 检查nullable失败则不做eagerAgg

column pruning 不产生不合法 的setOp

24207-2: orExpansion union 字段没对齐

DORIS-24239 context.groupKeys 不能为空

DORIS-24206: fix EliminateGroupByKeyByUniform bug:没有替换alias的exprId

DORIS-24205
1. union 的孩子不能部分改写
2. agg 输入字段和 group key 有交集,则不下推

LogicalProject 构造projectMap时不能有unbound

DORIS-23842 没有aggFunc时 下推包含所有group key
的分支,而不是大分支. ds37/38/82/87 受到影响。select distinct A from T1 join T2 on ... group by A`

aliasMap 使用HashMap,不用IdentityMap

DORIS-24149

DORIS-24151

doris-24150 rt case

1. exprId 的等值判断, 2.update rt.

DORIS-24150

update shape

remove unused code

1. sum-if 不考虑穿过bigJoin, 2. 支持union

q5 两个sum(0)错误去重了

sum-if 基本款 (还没有支持union), 43 有提升

simple sum-if no union

检查context的字段 是project的输出.拒绝 sum(A) 下推 proj(x, x+y as A) 且x 不是group key

derive deep false

throw exception for eager agg when FeDebug

1. remove finalGroupKeys, 2. project 下推后改写projects

push agg on join

group key only slotreference

do not support avg/count

mode=1 时 即使没有经过big join 也要 强制 下推

shape with/without pkfk based on tpc_preview
@englefly
Copy link
Contributor Author

englefly commented Mar 2, 2026

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 27530 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4fd41b6bde3a7c72efcd889b0042d38412de1f9b, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17645	4563	4312	4312
q2	q3	10643	807	532	532
q4	4711	357	255	255
q5	7926	1222	1047	1047
q6	215	174	145	145
q7	834	850	660	660
q8	10430	1479	1357	1357
q9	6384	4772	4680	4680
q10	6484	1937	1652	1652
q11	488	252	236	236
q12	764	576	469	469
q13	18133	2941	2182	2182
q14	244	234	208	208
q15	957	785	807	785
q16	804	735	703	703
q17	763	915	403	403
q18	6014	5353	5262	5262
q19	1232	980	626	626
q20	512	492	391	391
q21	4475	1860	1375	1375
q22	348	287	250	250
Total cold run time: 100006 ms
Total hot run time: 27530 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4497	4324	4347	4324
q2	q3	3855	4301	3770	3770
q4	848	1179	755	755
q5	4022	4365	4341	4341
q6	175	166	140	140
q7	1716	1611	1502	1502
q8	2416	2650	2691	2650
q9	7767	7386	7470	7386
q10	3712	3950	3571	3571
q11	524	434	411	411
q12	506	615	449	449
q13	2750	3366	2380	2380
q14	286	319	284	284
q15	897	840	788	788
q16	728	764	729	729
q17	1204	1397	1339	1339
q18	7101	6735	6660	6660
q19	953	909	956	909
q20	2106	2185	2029	2029
q21	4224	3928	3547	3547
q22	507	434	378	378
Total cold run time: 50794 ms
Total hot run time: 48342 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 153438 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4fd41b6bde3a7c72efcd889b0042d38412de1f9b, data reload: false

query5	4330	637	518	518
query6	337	227	214	214
query7	4211	467	263	263
query8	327	240	234	234
query9	8700	2744	2734	2734
query10	541	405	344	344
query11	7324	5836	5674	5674
query12	197	131	126	126
query13	1280	479	364	364
query14	6196	3868	3591	3591
query14_1	2815	2807	2839	2807
query15	205	197	178	178
query16	994	493	469	469
query17	1122	727	629	629
query18	2580	447	354	354
query19	221	217	182	182
query20	136	138	134	134
query21	227	151	125	125
query22	4716	4869	4706	4706
query23	16890	15932	15717	15717
query23_1	15765	15975	15999	15975
query24	7335	1720	1252	1252
query24_1	1255	1268	1282	1268
query25	582	487	423	423
query26	1275	273	161	161
query27	3040	482	292	292
query28	4503	1906	1911	1906
query29	811	578	484	484
query30	310	246	213	213
query31	1367	1289	1203	1203
query32	81	73	71	71
query33	510	337	271	271
query34	911	919	564	564
query35	670	679	606	606
query36	1113	1064	976	976
query37	130	96	84	84
query38	2967	2986	2823	2823
query39	874	865	843	843
query39_1	833	832	826	826
query40	233	153	138	138
query41	64	60	60	60
query42	313	310	299	299
query43	247	251	222	222
query44	
query45	201	188	181	181
query46	873	993	606	606
query47	2120	2126	2055	2055
query48	310	321	227	227
query49	619	462	393	393
query50	678	286	217	217
query51	4280	4185	4098	4098
query52	287	291	281	281
query53	290	333	291	291
query54	303	277	265	265
query55	94	86	88	86
query56	318	332	299	299
query57	1370	1353	1270	1270
query58	292	277	305	277
query59	1339	1463	1316	1316
query60	341	338	325	325
query61	165	139	146	139
query62	649	586	553	553
query63	318	278	273	273
query64	4973	1268	990	990
query65	
query66	1425	460	353	353
query67	16383	16424	16299	16299
query68	
query69	381	303	281	281
query70	986	957	937	937
query71	347	313	303	303
query72	2859	2720	2437	2437
query73	542	558	345	345
query74	10009	9911	9810	9810
query75	2844	2755	2485	2485
query76	2297	1037	701	701
query77	370	380	324	324
query78	11304	11348	10691	10691
query79	1165	829	600	600
query80	1359	657	584	584
query81	575	284	259	259
query82	1277	158	119	119
query83	378	275	247	247
query84	253	118	102	102
query85	1093	553	433	433
query86	438	325	297	297
query87	3157	3132	2992	2992
query88	3568	2669	2647	2647
query89	435	373	345	345
query90	1877	177	168	168
query91	163	162	133	133
query92	82	77	71	71
query93	911	820	507	507
query94	652	332	297	297
query95	600	342	322	322
query96	641	519	224	224
query97	2469	2514	2481	2481
query98	230	220	223	220
query99	1010	1002	927	927
Total cold run time: 234638 ms
Total hot run time: 153438 ms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants