-
Notifications
You must be signed in to change notification settings - Fork 3.7k
[Feature][Fix](multi-catalog) Implements transactional hive full acid tables. #20679
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
run buildall |
|
clang-tidy review says "All clean, LGTM! 👍" |
d51f1d8 to
f0bbbfa
Compare
|
run buildall |
|
clang-tidy review says "All clean, LGTM! 👍" |
| if (columnsFromPath == null || columnsFromPath.isEmpty()) { | ||
| return Collections.emptyList(); | ||
| } | ||
| int pathCount = isACID ? 3 : 2; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Add comment explain 3 and 2, better give an example
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ok
| } | ||
| } | ||
|
|
||
| private List<Split> splitFile(Path path, long blockSize, BlockLocation[] blockLocations, long length, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Better to find a way to extract the common part of splitFile and the same method defined in FileScanNode, or it is hard to maintain.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ok
|
run buildall |
|
clang-tidy review says "All clean, LGTM! 👍" |
morningman
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
|
PR approved by at least one committer and no changes requested. |
|
PR approved by anyone and no changes requested. |
|
run buildall |
Proposed changes
After supporting insert-only transactional hive full acid tables #19518, #19419, this PR support transactional hive full acid tables.
Further comments
Regression test only test with hive2 transactional hive full acid tables now, because the docker image version is hive 2.x, will add hive 3.x. docker later.
If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...