Skip to content

Conversation

@spaces-X
Copy link
Contributor

@spaces-X spaces-X commented Apr 20, 2022

Proposed changes

close #9135

This bug was introduced from #6087

Problem Summary:

Describe the overview of changes.

Checklist(Required)

  1. Does it affect the original behavior: (No)
  2. Has unit tests been added: (No Need)
  3. Has document been added or modified: (No Need)
  4. Does it need to update dependencies: (No)
  5. Are there any changes that cannot be rolled back: (Yes/No)

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@spaces-X spaces-X requested a review from wangbo April 20, 2022 10:21
@wangshuo128
Copy link
Contributor

Would you please elaborate how this issue happen?

@spaces-X
Copy link
Contributor Author

Would you please elaborate how this issue happen?

Buffer flip is used incorrectly.
When the hash key is string type, the hash value is always zero. The reason is that the buffer of string type is obtained by wrap, which is not needed to flip. If we do so, the buffer limit for read will be zero.

@spaces-X spaces-X added area/spark-load Issues or PRs related to the spark load dev/1.0.1-deprecated should be merged into dev-1.0.1 branch labels Apr 23, 2022
Copy link
Contributor

@wangbo wangbo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Apr 24, 2022
@github-actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@morningman morningman merged commit 62b38d7 into apache:master Apr 26, 2022
weizhengte pushed a commit to weizhengte/incubator-doris that referenced this pull request Apr 26, 2022
… spark load. (apache#9136)

Buffer flip is used incorrectly.
When the hash key is string type, the hash value is always zero.
The reason is that the buffer of string type is obtained by wrap, which is not needed to flip.
If we do so, the buffer limit for read will be zero.

(cherry picked from commit 62b38d7)
@morningman morningman added dev/merged-1.0.1-deprecated PR has been merged into dev-1.0.1 and removed dev/1.0.1-deprecated should be merged into dev-1.0.1 branch labels Apr 26, 2022
morningman pushed a commit that referenced this pull request Apr 26, 2022
… spark load. (#9136)

Buffer flip is used incorrectly.
When the hash key is string type, the hash value is always zero.
The reason is that the buffer of string type is obtained by wrap, which is not needed to flip.
If we do so, the buffer limit for read will be zero.
Kikyou1997 pushed a commit to Kikyou1997/incubator-doris that referenced this pull request May 9, 2022
… spark load. (apache#9136)

Buffer flip is used incorrectly.
When the hash key is string type, the hash value is always zero.
The reason is that the buffer of string type is obtained by wrap, which is not needed to flip.
If we do so, the buffer limit for read will be zero.
starocean999 pushed a commit to starocean999/incubator-doris that referenced this pull request May 19, 2022
… spark load. (apache#9136)

Buffer flip is used incorrectly.
When the hash key is string type, the hash value is always zero.
The reason is that the buffer of string type is obtained by wrap, which is not needed to flip.
If we do so, the buffer limit for read will be zero.
englefly pushed a commit to englefly/incubator-doris that referenced this pull request May 23, 2022
… spark load. (apache#9136)

Buffer flip is used incorrectly.
When the hash key is string type, the hash value is always zero.
The reason is that the buffer of string type is obtained by wrap, which is not needed to flip.
If we do so, the buffer limit for read will be zero.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. area/spark-load Issues or PRs related to the spark load dev/merged-1.0.1-deprecated PR has been merged into dev-1.0.1 reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] getHashValue of string type is always zero in spark load

4 participants