-
Notifications
You must be signed in to change notification settings - Fork 3.6k
Description
Search before asking
- I had searched in the issues and found no similar issues.
Version
Apache Doris 3.1.1 vs Apache Doris 3.0.8
What's Wrong?
In a compared test with
- same java jdbc client with batch insert
- same data to insert
- same table filed and index
- same target enviroment and hardware
with the following connection string:
- useServerPrepStmts=false&useLocalSessionState=true&rewriteBatchedStatements=true&cachePrepStmts=true&prepStmtCacheSqlLimit=1048576&prepStmtCacheSize=500&sessionVariables=group_commit=async_mode,enable_nereids_planner=true,time_zone=UTC,enable_prepared_stmt_audit_log=false
Table definition is the same with the only difference in the core field and 1 properties:
data VARIANT<properties("variant_max_subcolumns_count" = "2048")> NOT NULL
and "inverted_index_storage_format" = "V3"
In Apache Doris 3.0.8 I can insert 900 row batch with 1600 json field etach row in few second (2s) now more than 15s.
It seams that group_commit=async_mode it not working.
The Java client does not immediately return control but waits several seconds causing a decrease in throughput and the inability to utilize hardware resources that ramain low.
What You Expected?
I expected a performance increase based on what was described in the release notes
https://doris.apache.org/docs/dev/releasenotes/v3.1/release-3.1.0
How to Reproduce?
No response
Anything Else?
No response
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct