Skip to content

Conversation

@github-actions
Copy link
Contributor

PR Body: For a routine load job, it will be divided into many tasks, each of which is a transaction. Currently, the default time consumed(max_batch_interval) is 10 seconds. The benefits of increasing this value are:

  1. Larger batch consumption can lead to better performance.
  2. Reducing the number of transactions can alleviate the pressure of compaction and the conflicts of concurrent transaction submissions.

related doc: https://github.com/apache/doris-website/pull/1236/files

Cherry-picked from #42491

…re convenient to use (#42491)

For a routine load job, it will be divided into many tasks, each of
which is a transaction. Currently, the default time
consumed(max_batch_interval) is 10 seconds. The benefits of increasing
this value are:
1. Larger batch consumption can lead to better performance.
2. Reducing the number of transactions can alleviate the pressure of
compaction and the conflicts of concurrent transaction submissions.

related doc: https://github.com/apache/doris-website/pull/1236/files
@github-actions
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@sollhui
Copy link
Contributor

sollhui commented Oct 31, 2024

run buildall

@liaoxin01 liaoxin01 changed the title branch-3.0: [improve](routine load) adjust default values to make routine load more convenient to use [improve](routine load) adjust default values to make routine load more convenient to use Nov 4, 2024
@liaoxin01
Copy link
Contributor

run buildall

@liaoxin01 liaoxin01 merged commit e679fbe into branch-3.0 Nov 4, 2024
@gavinchou gavinchou mentioned this pull request Nov 26, 2024
@dataroaring dataroaring deleted the auto-pick-42491-branch-3.0 branch December 27, 2024 07:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants