This repository was archived by the owner on Aug 20, 2025. It is now read-only.
METRON-745: Create Error Dashboards #475
Closed
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Following Ryan's work in #453, we have the opportunity to present errors from our topologies.
It's nothing too complicated, essentially just some high level overviews of the various error fields, along with a pane for viewing the actual errors along with all their fields. Note that they include both raw and unique message counts (via the hash fields) in most things.
This also corrects the error_index.template files. These are supposed to match ErrorFields in Constants.java, but didn't.
I've attached some screenshots, and this can be spun up on quick dev and Ambari (both dashboard.p and the various kibana-index.json are updated). Quick dev automatically passes some data through, so it's a good way to get this spun up with something interesting showing.
Feedback on what else would be useful and if we want to adjust anything would be great. Keep in mind, we don't actually have a lot of fields to work with (because if everything was good, we wouldn't be here in the first place!). See error_index.template for the fields we have.
Testing
Spun up in quick-dev and Ambari. Quick-dev will automatically put data through
Notes
If I recall correctly, that's a known Kibana bug that we're stuck with.
The bottom pane extends further down, but we've all seen a table of data before.
Thank you for submitting a contribution to Apache Metron (Incubating).
Please refer to our Development Guidelines for the complete guide to follow for contributions.
Please refer also to our Build Verification guildlines for complete smoke testing guides.
In order to streamline the review of the contribution we ask you follow these guidelines and ask you to double check
the following:
For all changes:
For code changes:
- [ ] Have you written or updated unit tests and or integration tests to verify your changes?It's all Kibana UI work, so the testing was done on quick-dev and an Ambari clusterFor documentation related changes:
Note:
Please ensure that once the PR is submitted, you check travis-ci for build issues and submit an update to your PR as soon as possible.
It is also recommened that travis-ci is set up for your personal repository such that your branches are built there before submitting a pull request.