Skip to content

ARROW-10388: [Java] Fix Spark integration build failure #8526

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
liyafan82 wants to merge 2 commits into from
Closed

ARROW-10388: [Java] Fix Spark integration build failure #8526

liyafan82 wants to merge 2 commits into from

Conversation

@liyafan82
Copy link
Contributor

@liyafan82 liyafan82 commented Oct 26, 2020

@github-actions
Copy link

github-actions bot commented Oct 26, 2020

https://issues.apache.org/jira/browse/ARROW-10388

@kou
Copy link
Member

kou commented Oct 27, 2020

@github-actions crossbow submit -spark-

@github-actions
Copy link

github-actions bot commented Oct 27, 2020

Revision: ef51e5246815469371863f896f7bc85457e46dfb

Submitted crossbow builds: ursa-labs/crossbow @ actions-681

Task Status
test-conda-python-3.7-spark-branch-3.0 Github Actions
test-conda-python-3.8-spark-master Github Actions

@liyafan82
Copy link
Contributor Author

liyafan82 commented Oct 27, 2020 •
edited
Loading

The first test (test-conda-python-3.7-spark-branch-3.0) failed because of lacking a library on the class path:

Caused by: java.lang.RuntimeException: No DefaultAllocationManager found on classpath. Can't allocate Arrow buffers. Please consider adding arrow-memory-netty or arrow-memory-unsafe as a dependency.

This change was introduced recently as we split the arrow-memory module into 3 modules.

@emkornfield
Copy link
Contributor

emkornfield commented Oct 28, 2020

@liyafan82 I applied a small cleanup patch. If this looks good and CI is green we should go ahead and merge this and open up a separate JIRA for the allocator issue.

@liyafan82
Copy link
Contributor Author

liyafan82 commented Oct 28, 2020

@liyafan82 I applied a small cleanup patch. If this looks good and CI is green we should go ahead and merge this and open up a separate JIRA for the allocator issue.

@emkornfield Sounds reasonable. Thanks.

@liyafan82 liyafan82 closed this Oct 29, 2020
@liyafan82 liyafan82 reopened this Oct 29, 2020
@liyafan82
Copy link
Contributor Author

liyafan82 commented Oct 29, 2020

Merging this, as something is wrong with continuous-integration/travis-ci/pr

@liyafan82 liyafan82 closed this in 38971af Oct 29, 2020
@liyafan82
Copy link
Contributor Author

liyafan82 commented Oct 29, 2020

I have opened https://issues.apache.org/jira/browse/SPARK-33279 to track the build failure on spark-3.0 branch.

@asfimport asfimport mentioned this pull request Oct 29, 2020
Closed
pribor pushed a commit to GlobalWebIndex/arrow that referenced this pull request Oct 24, 2025
@liyafan82 @emkornfield @kou
ARROW-10388: [Java] Fix Spark integration build failure
15ede52 
Please see https://issues.apache.org/jira/browse/ARROW-10388

Closes apache#8526 from liyafan82/fly_1026_spk

Lead-authored-by: liyafan82 <fan_li_ya@foxmail.com>
Co-authored-by: emkornfield <emkornfield@gmail.com>
Signed-off-by: liyafan82 <fan_li_ya@foxmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@liyafan82 @kou @emkornfield