Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix] (inverted index) fix the error result in the query when using count on index #42346 #42495

Merged

Conversation

csun5285
Copy link
Contributor

Proposed changes

pick from master #42346

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@csun5285
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49312 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 05b8e5cca67722fe44da01f5b6821b238272b2f8, data reload: false

------ Round 1 ----------------------------------
q1	17948	4437	4368	4368
q2	2057	161	145	145
q3	10436	1909	1921	1909
q4	10293	1239	1345	1239
q5	8416	3955	3949	3949
q6	240	127	125	125
q7	2065	1624	1597	1597
q8	9520	2743	2723	2723
q9	13104	9970	10095	9970
q10	8647	3527	3520	3520
q11	409	249	243	243
q12	460	300	310	300
q13	18350	4000	4039	4000
q14	356	340	325	325
q15	501	458	453	453
q16	542	469	450	450
q17	1145	958	930	930
q18	7252	6844	7005	6844
q19	1670	1518	1485	1485
q20	532	301	305	301
q21	4441	4176	4045	4045
q22	504	402	391	391
Total cold run time: 118888 ms
Total hot run time: 49312 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4358	4340	4278	4278
q2	322	226	226	226
q3	4210	4138	4140	4138
q4	2756	2772	2783	2772
q5	7268	7195	7134	7134
q6	239	122	121	121
q7	3271	2815	2853	2815
q8	4401	4513	4473	4473
q9	14310	13927	14003	13927
q10	4252	4311	4306	4306
q11	763	734	679	679
q12	1021	873	864	864
q13	7617	3868	3903	3868
q14	471	451	452	451
q15	500	466	468	466
q16	660	621	640	621
q17	3918	3902	3960	3902
q18	8975	8884	8969	8884
q19	1749	1662	1689	1662
q20	2447	2158	2134	2134
q21	8532	8482	8480	8480
q22	1042	962	966	962
Total cold run time: 83082 ms
Total hot run time: 77163 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 212714 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 05b8e5cca67722fe44da01f5b6821b238272b2f8, data reload: false

query1	925	399	412	399
query2	6557	2280	2109	2109
query3	6924	201	201	201
query4	23121	21449	21547	21449
query5	19745	6525	6518	6518
query6	406	218	239	218
query7	5048	302	308	302
query8	250	261	261	261
query9	3096	2655	2585	2585
query10	419	323	302	302
query11	15844	15282	15523	15282
query12	130	74	79	74
query13	1029	452	441	441
query14	18756	13620	13420	13420
query15	388	218	228	218
query16	6451	286	268	268
query17	1517	937	929	929
query18	899	318	325	318
query19	213	155	157	155
query20	99	96	98	96
query21	193	97	102	97
query22	5210	4869	5004	4869
query23	34267	33423	33452	33423
query24	6539	6305	6364	6305
query25	543	431	435	431
query26	800	165	160	160
query27	2315	304	302	302
query28	6084	2239	2205	2205
query29	2862	2784	2778	2778
query30	246	167	168	167
query31	961	752	743	743
query32	73	64	64	64
query33	444	263	270	263
query34	861	476	481	476
query35	1127	944	902	902
query36	1251	1221	1133	1133
query37	94	61	63	61
query38	3118	2955	2903	2903
query39	1362	1340	1341	1340
query40	212	98	97	97
query41	41	37	36	36
query42	101	91	82	82
query43	709	648	579	579
query44	1222	725	734	725
query45	245	227	231	227
query46	1226	967	957	957
query47	1928	1935	1835	1835
query48	531	422	415	415
query49	621	389	399	389
query50	882	609	578	578
query51	4804	4645	4707	4645
query52	95	73	96	73
query53	227	184	193	184
query54	2674	2500	2500	2500
query55	95	89	83	83
query56	235	201	217	201
query57	1212	1120	1204	1120
query58	213	223	229	223
query59	3663	3455	3404	3404
query60	222	224	215	215
query61	100	96	105	96
query62	875	463	471	463
query63	204	179	173	173
query64	3354	1596	1532	1532
query65	3624	3544	3578	3544
query66	747	445	400	400
query67	15380	16077	14982	14982
query68	9275	648	630	630
query69	515	278	265	265
query70	1625	1315	1482	1315
query71	409	307	310	307
query72	7018	4888	4869	4869
query73	744	322	323	322
query74	6305	5813	5889	5813
query75	5087	3715	3675	3675
query76	5050	1126	1182	1126
query77	738	257	257	257
query78	12850	12038	11575	11575
query79	7477	648	616	616
query80	1919	401	384	384
query81	485	241	237	237
query82	1681	106	101	101
query83	166	137	137	137
query84	260	72	71	71
query85	1020	319	318	318
query86	348	292	305	292
query87	3197	2977	3027	2977
query88	4685	2297	2276	2276
query89	378	281	286	281
query90	1860	214	208	208
query91	159	129	127	127
query92	57	51	50	50
query93	5874	543	564	543
query94	732	210	214	210
query95	2052	2051	2034	2034
query96	648	316	316	316
query97	6519	6394	6396	6394
query98	223	199	197	197
query99	2978	910	866	866
Total cold run time: 317943 ms
Total hot run time: 212714 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.88 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 05b8e5cca67722fe44da01f5b6821b238272b2f8, data reload: false

query1	0.02	0.02	0.03
query2	0.06	0.02	0.02
query3	0.25	0.04	0.04
query4	1.81	0.07	0.05
query5	0.53	0.53	0.51
query6	1.23	0.60	0.61
query7	0.02	0.01	0.01
query8	0.04	0.02	0.03
query9	0.52	0.50	0.48
query10	0.54	0.54	0.53
query11	0.12	0.10	0.09
query12	0.11	0.09	0.09
query13	0.62	0.60	0.61
query14	0.79	0.79	0.80
query15	0.78	0.75	0.76
query16	0.36	0.36	0.36
query17	1.03	0.99	1.02
query18	0.22	0.24	0.24
query19	1.90	1.82	1.86
query20	0.02	0.01	0.01
query21	15.43	0.56	0.59
query22	2.21	2.70	1.65
query23	17.34	1.16	0.94
query24	6.74	1.10	1.78
query25	0.39	0.14	0.05
query26	0.73	0.15	0.16
query27	0.05	0.05	0.04
query28	5.59	0.74	0.72
query29	12.62	2.36	2.33
query30	0.60	0.53	0.55
query31	2.80	0.39	0.37
query32	3.37	0.49	0.48
query33	3.05	3.08	3.04
query34	15.25	4.82	4.79
query35	4.87	4.86	4.84
query36	1.08	1.02	1.02
query37	0.06	0.05	0.05
query38	0.04	0.02	0.03
query39	0.02	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.02	0.01
query43	0.02	0.01	0.02
Total cold run time: 103.48 s
Total hot run time: 30.88 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 05b8e5cca67722fe44da01f5b6821b238272b2f8 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       22.2 seconds inserted 10000000 Rows, about 450K ops/s

Copy link
Member

@airborne12 airborne12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Oct 28, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

@airborne12 airborne12 merged commit 9f28bbc into apache:branch-2.0 Oct 29, 2024
22 of 26 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. area/nereids kind/test reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants