Skip to content

Conversation

@morningman
Copy link
Contributor

No description provided.

COUNTER_ROUTINE_LOAD_RECEIVED_BYTES = new LongCounterMetric("routine_load_receive_bytes",
"total received bytes of routine load");
PALO_METRIC_REGISTER.addPaloMetrics(COUNTER_ROUTINE_LOAD_RECEIVED_BYTES);
COUNTER_ROUTINE_LOAD_ERROR_ROWS = new LongCounterMetric("routine_load_error_rows",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it meaningful for our or user without group by job id? Or maybe COUNTER_ROUTINE_LOAD_ROWS + COUNTER_ROUTINE_LOAD_ERROR_ROWS is more meaningful?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think each job's loaded rows or error rows should be saved in each job.
This metrics are for a global perspective of system runtime overview.
I use COUNTER_ROUTINE_LOAD_ERROR_ROWS to monitor if there are too many error rows.

@morningman morningman merged commit 4e2c53a into apache:kafka_routine_load Mar 25, 2019
morningman added a commit to morningman/doris that referenced this pull request Mar 25, 2019
* Add metrics for routine load
* limit the max number of routine load task in backend to 10
* Fix bug that some partitions will no be assigned
morningman added a commit that referenced this pull request Mar 25, 2019
* Add metrics for routine load
* limit the max number of routine load task in backend to 10
* Fix bug that some partitions will no be assigned
morningman added a commit to morningman/doris that referenced this pull request Apr 4, 2019
* Add metrics for routine load
* limit the max number of routine load task in backend to 10
* Fix bug that some partitions will no be assigned
morningman added a commit that referenced this pull request Apr 4, 2019
* Add metrics for routine load
* limit the max number of routine load task in backend to 10
* Fix bug that some partitions will no be assigned
morningman added a commit that referenced this pull request Apr 19, 2019
* Add metrics for routine load
* limit the max number of routine load task in backend to 10
* Fix bug that some partitions will no be assigned
EmmyMiao87 pushed a commit to EmmyMiao87/incubator-doris that referenced this pull request Apr 23, 2019
* Add metrics for routine load
* limit the max number of routine load task in backend to 10
* Fix bug that some partitions will no be assigned
morningman added a commit that referenced this pull request Apr 24, 2019
* Add metrics for routine load
* limit the max number of routine load task in backend to 10
* Fix bug that some partitions will no be assigned
imay pushed a commit that referenced this pull request Apr 28, 2019
* Add metrics for routine load
* limit the max number of routine load task in backend to 10
* Fix bug that some partitions will no be assigned
mrhhsg pushed a commit to mrhhsg/doris that referenced this pull request Oct 4, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants