[GLUTEN-2139][CORE] Add gluten event and UI#2247
Conversation
|
Run Gluten Clickhouse CI |
|
Run Gluten Clickhouse CI |
|
@ulysses-you thank you for improving on this! I tried this patch locally and it seems working, just two questions:
-yuan |
|
thank you @zhouyuan for the thoughs,
I think it works with ch backend. All backends use the same code path, since the main code chang is at GlutenDriverPlugin and columnar rule. It should have no difference between velox and ch backend.
yes, it's right. This pr is compatible with AQE as it follows the behavior of vanilla Spark event |
zhouyuan
left a comment
There was a problem hiding this comment.
👍
there are some TODOs but we could fix those in the next PRs.
What changes were proposed in this pull request?
This pr adds a new module
gluten-uito holds the event and UI related code. So it would be more easy to put a simple gluten-ui jar instead of gluten-core jar into history server.Adds two Gluten events:
Introduce a new config
spark.gluten.ui.enabledwith enabled by default.(Fixes: #2139)
How was this patch tested?
Add test and test locally