-
Notifications
You must be signed in to change notification settings - Fork 3.7k
Add metrics for routine load #795
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add metrics for routine load #795
Conversation
| COUNTER_ROUTINE_LOAD_RECEIVED_BYTES = new LongCounterMetric("routine_load_receive_bytes", | ||
| "total received bytes of routine load"); | ||
| PALO_METRIC_REGISTER.addPaloMetrics(COUNTER_ROUTINE_LOAD_RECEIVED_BYTES); | ||
| COUNTER_ROUTINE_LOAD_ERROR_ROWS = new LongCounterMetric("routine_load_error_rows", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is it meaningful for our or user without group by job id? Or maybe COUNTER_ROUTINE_LOAD_ROWS + COUNTER_ROUTINE_LOAD_ERROR_ROWS is more meaningful?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think each job's loaded rows or error rows should be saved in each job.
This metrics are for a global perspective of system runtime overview.
I use COUNTER_ROUTINE_LOAD_ERROR_ROWS to monitor if there are too many error rows.
* Add metrics for routine load * limit the max number of routine load task in backend to 10 * Fix bug that some partitions will no be assigned
* Add metrics for routine load * limit the max number of routine load task in backend to 10 * Fix bug that some partitions will no be assigned
* Add metrics for routine load * limit the max number of routine load task in backend to 10 * Fix bug that some partitions will no be assigned
* Add metrics for routine load * limit the max number of routine load task in backend to 10 * Fix bug that some partitions will no be assigned
* Add metrics for routine load * limit the max number of routine load task in backend to 10 * Fix bug that some partitions will no be assigned
* Add metrics for routine load * limit the max number of routine load task in backend to 10 * Fix bug that some partitions will no be assigned
* Add metrics for routine load * limit the max number of routine load task in backend to 10 * Fix bug that some partitions will no be assigned
* Add metrics for routine load * limit the max number of routine load task in backend to 10 * Fix bug that some partitions will no be assigned
No description provided.