Skip to content

[opt](split) close the batch mode of file split in default #36109

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
morningman merged 1 commit into from
Jun 11, 2024
Merged

[opt](split) close the batch mode of file split in default #36109

morningman merged 1 commit into from
Jun 11, 2024

Conversation

@AshinGau
Copy link
Member

@AshinGau AshinGau commented Jun 11, 2024

Proposed changes

bp: #36108

@doris-robot
Copy link

doris-robot commented Jun 11, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@AshinGau
Copy link
Member Author

AshinGau commented Jun 11, 2024

run buildall

@morningman morningman merged commit d2a6911 into apache:branch-2.1 Jun 11, 2024
@AshinGau AshinGau mentioned this pull request Jun 17, 2024
Merged
AshinGau added a commit that referenced this pull request Jun 19, 2024
@AshinGau
[opt](split) generate and get split batch concurrently (#36044)
f59dc4f 
bp #36045, and turn on batch split, which is turn off in #36109
Generate and get split batch concurrently.
`SplitSource.getNextBatch` remove the synchronization, and make each get their splits concurrently, and `SplitAssignment` generates splits asynchronously.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@morningman morningman morningman approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@AshinGau @doris-robot @morningman