Skip to content

[fix](routine load) reduce routine load task consume log #42058

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
dataroaring merged 1 commit into from
Oct 20, 2024
Merged

[fix](routine load) reduce routine load task consume log #42058

dataroaring merged 1 commit into from
Oct 20, 2024

Conversation

@sollhui
Copy link
Contributor

@sollhui sollhui commented Oct 17, 2024

There is too much routine load task log, five million logs were generated in 10 minutes.

grep 'consumer meet partition eof' be.INFO.log.20240930-164533 | wc -l 
5369624

@doris-robot
Copy link

doris-robot commented Oct 17, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@sollhui
Copy link
Contributor Author

sollhui commented Oct 17, 2024

run buildall

liaoxin01
liaoxin01 approved these changes Oct 17, 2024
View reviewed changes
Copy link
Contributor

@liaoxin01 liaoxin01 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

github-actions bot commented Oct 17, 2024

clang-tidy review says "All clean, LGTM! 👍"

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Oct 17, 2024
@github-actions
Copy link
Contributor

github-actions bot commented Oct 17, 2024

PR approved by at least one committer and no changes requested.

@github-actions
Copy link
Contributor

github-actions bot commented Oct 17, 2024

PR approved by anyone and no changes requested.

@doris-robot
Copy link

doris-robot commented Oct 17, 2024

TeamCity be ut coverage result:
Function Coverage: 37.46% (9710/25919)
Line Coverage: 28.72% (80593/280615)
Region Coverage: 28.17% (41714/148091)
Branch Coverage: 24.74% (21205/85698)
Coverage Report: http://coverage.selectdb-in.cc/coverage/b70fa39c522b593f7d97b4df0abd8372ed1f163c_b70fa39c522b593f7d97b4df0abd8372ed1f163c/report/index.html

dataroaring
dataroaring approved these changes Oct 20, 2024
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring merged commit 72f26b9 into apache:master Oct 20, 2024
This was referenced Oct 22, 2024
Merged
Merged
liaoxin01 pushed a commit that referenced this pull request Oct 23, 2024
@sollhui
[fix](routine load) reduce routine load task consume log (#42058) (#4…
1a30b13 
…2293)

pick (#42058)

There is too much routine load task log, five million logs were
generated in 10 minutes.

```
grep 'consumer meet partition eof' be.INFO.log.20240930-164533 | wc -l 
5369624
```
liaoxin01 pushed a commit that referenced this pull request Oct 23, 2024
@sollhui
[fix](routine load) reduce routine load task consume log (#42058) (#4…
0d76c16 
…2268)

pick (#42058)

There is too much routine load task log, five million logs were
generated in 10 minutes.

```
grep 'consumer meet partition eof' be.INFO.log.20240930-164533 | wc -l 
5369624
```
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@liaoxin01 liaoxin01 liaoxin01 approved these changes

@dataroaring dataroaring dataroaring approved these changes

Assignees

No one assigned

Labels

approved Indicates a PR has been approved by one committer. dev/2.1.7-merged dev/3.0.3-merged reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@sollhui @doris-robot @liaoxin01 @dataroaring