Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[enhancement](delete) Using insert timeout session var to control delete job timeout #41063

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

TangSiyang2001
Copy link
Collaborator

Proposed changes

As title.

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@TangSiyang2001
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41677 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a8411617aa504c4274c820de2a9ec93fd631897e, data reload: false

------ Round 1 ----------------------------------
q1	17580	7404	7339	7339
q2	2068	167	155	155
q3	10888	1102	1197	1102
q4	10568	751	705	705
q5	7749	3052	3057	3052
q6	242	156	154	154
q7	1001	611	611	611
q8	9423	2050	2061	2050
q9	6815	6412	6380	6380
q10	7014	2279	2335	2279
q11	432	243	247	243
q12	405	215	217	215
q13	17806	2984	2976	2976
q14	255	207	220	207
q15	573	527	519	519
q16	687	612	629	612
q17	973	788	780	780
q18	7410	6771	6776	6771
q19	1406	1099	979	979
q20	581	288	283	283
q21	4102	3270	3273	3270
q22	1100	995	998	995
Total cold run time: 109078 ms
Total hot run time: 41677 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7231	7294	7217	7217
q2	324	225	235	225
q3	2954	2928	3026	2928
q4	1999	1818	1826	1818
q5	5599	5602	5526	5526
q6	226	139	137	137
q7	2268	1804	1765	1765
q8	3287	3415	3430	3415
q9	8808	8895	8755	8755
q10	3548	3467	3484	3467
q11	575	479	481	479
q12	799	618	598	598
q13	11113	3156	3139	3139
q14	295	265	288	265
q15	561	514	530	514
q16	717	719	670	670
q17	1831	1606	1601	1601
q18	8172	7916	7654	7654
q19	1735	1497	1378	1378
q20	2128	1904	1879	1879
q21	5705	5264	5452	5264
q22	1171	1051	1011	1011
Total cold run time: 71046 ms
Total hot run time: 59705 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196781 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a8411617aa504c4274c820de2a9ec93fd631897e, data reload: false

query1	1270	879	899	879
query2	6414	2077	2021	2021
query3	10763	4029	3913	3913
query4	63211	27121	23694	23694
query5	5311	460	481	460
query6	392	162	160	160
query7	5473	301	300	300
query8	305	227	215	215
query9	8872	2645	2626	2626
query10	488	285	272	272
query11	18044	15185	15792	15185
query12	167	106	101	101
query13	1465	416	411	411
query14	10655	7823	7796	7796
query15	225	176	175	175
query16	6544	500	486	486
query17	1225	598	584	584
query18	1571	322	309	309
query19	238	155	151	151
query20	134	110	110	110
query21	207	109	106	106
query22	4634	4495	4666	4495
query23	34617	33700	34004	33700
query24	5979	2914	2856	2856
query25	514	401	416	401
query26	632	157	158	157
query27	1623	280	291	280
query28	4294	2449	2421	2421
query29	671	418	423	418
query30	231	157	168	157
query31	981	770	812	770
query32	72	56	59	56
query33	427	282	290	282
query34	898	486	484	484
query35	874	769	732	732
query36	1069	937	945	937
query37	148	90	87	87
query38	4034	3915	3915	3915
query39	1473	1433	1434	1433
query40	204	95	98	95
query41	50	47	50	47
query42	120	95	92	92
query43	509	476	482	476
query44	1176	817	829	817
query45	196	167	168	167
query46	1137	794	741	741
query47	1882	1805	1800	1800
query48	472	362	376	362
query49	687	409	402	402
query50	841	405	409	405
query51	7060	6935	7021	6935
query52	94	83	82	82
query53	253	178	175	175
query54	565	440	434	434
query55	78	75	79	75
query56	260	271	245	245
query57	1228	1081	1107	1081
query58	219	220	233	220
query59	3175	2863	2892	2863
query60	296	264	264	264
query61	100	105	106	105
query62	762	667	687	667
query63	224	190	183	183
query64	1413	662	661	661
query65	3278	3162	3201	3162
query66	669	309	296	296
query67	15982	15557	15769	15557
query68	6190	579	552	552
query69	687	405	315	315
query70	1210	1154	1127	1127
query71	489	270	265	265
query72	6786	4054	3816	3816
query73	988	326	330	326
query74	10270	9015	9030	9015
query75	3740	2665	2672	2665
query76	3929	990	971	971
query77	570	285	292	285
query78	9978	11053	10117	10117
query79	3022	551	549	549
query80	813	445	441	441
query81	537	242	239	239
query82	306	142	143	142
query83	295	131	139	131
query84	296	79	80	79
query85	756	306	276	276
query86	435	307	284	284
query87	4468	4346	4302	4302
query88	3546	2306	2350	2306
query89	376	278	291	278
query90	2092	195	191	191
query91	178	145	140	140
query92	62	48	48	48
query93	1066	536	537	536
query94	777	312	303	303
query95	344	247	251	247
query96	598	273	284	273
query97	3263	3138	3120	3120
query98	213	208	195	195
query99	1548	1303	1324	1303
Total cold run time: 318903 ms
Total hot run time: 196781 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.21 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a8411617aa504c4274c820de2a9ec93fd631897e, data reload: false

query1	0.05	0.04	0.04
query2	0.06	0.03	0.03
query3	0.22	0.06	0.06
query4	1.65	0.10	0.10
query5	0.52	0.50	0.50
query6	1.12	0.74	0.73
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.55	0.50	0.49
query10	0.55	0.56	0.54
query11	0.14	0.11	0.11
query12	0.14	0.12	0.11
query13	0.61	0.59	0.58
query14	3.00	3.01	2.99
query15	0.91	0.81	0.81
query16	0.37	0.37	0.39
query17	1.01	1.06	1.02
query18	0.20	0.19	0.19
query19	1.92	1.79	2.03
query20	0.02	0.01	0.01
query21	15.39	0.62	0.60
query22	2.81	3.03	2.37
query23	17.12	0.83	0.73
query24	2.64	0.94	1.50
query25	0.27	0.17	0.14
query26	0.34	0.14	0.13
query27	0.04	0.04	0.04
query28	10.75	1.09	1.08
query29	12.53	3.29	3.23
query30	0.25	0.06	0.06
query31	2.87	0.38	0.37
query32	3.30	0.48	0.46
query33	3.00	2.99	3.06
query34	17.21	4.33	4.44
query35	4.42	4.45	4.48
query36	0.68	0.51	0.49
query37	0.08	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.02	0.02
query40	0.15	0.12	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 107.19 s
Total hot run time: 33.21 s

@TangSiyang2001
Copy link
Collaborator Author

run feut

@TangSiyang2001
Copy link
Collaborator Author

run external

@TangSiyang2001
Copy link
Collaborator Author

run cloud_p0

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 20, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

Copy link
Contributor

PR approved by anyone and no changes requested.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.x reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants