[Optimize] Support send batch parallelism for olap table sink#6397
[Optimize] Support send batch parallelism for olap table sink#6397caiconghui merged 11 commits intoapache:masterfrom
Conversation
|
How much is this performance improvement? |
a7c90c7 to
08f9651
Compare
This is the first step to speed up olap table sink. and the bottleneck for olaptable sink is still need to be deep solved. MySQL [test]> insert into info_p1 select * from info_p1; MySQL [test]> set send_batch_parallelism=5; MySQL [test]> insert into info_p1 select * from info_p1; |
a25c642 to
0724fe4
Compare
6ba4c80 to
eb62440
Compare
morningman
left a comment
There was a problem hiding this comment.
I think for any load job, if the user does not explicitly set the send_batch_parallelism parameter, the value of the session variable will be used by default.
|
PR approved by at least one committer and no changes requested. |
|
PR approved by anyone and no changes requested. |
|
PR approved by at least one committer and no changes requested. |
Proposed changes
Describe the big picture of your changes here to communicate to the maintainers why we should accept this pull request. If it fixes a bug or resolves a feature request, be sure to link to that issue.
Types of changes
What types of changes does your code introduce to Doris?
Put an
xin the boxes that applyChecklist
Put an
xin the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your code.Further comments
If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...