Skip to content

Conversation

@xuanyuanking
Copy link
Member

What changes were proposed in this pull request?

Change the remote repo used in IsolatedClientLoader from datanucleus to google mirror.

Why are the changes needed?

We need to connect the Maven repositories in IsolatedClientLoader for downloading Hive jars. The repository currently used is "http://www.datanucleus.org/downloads/maven2", which is no longer maintained. This will cause downloading failure and make hive test cases flaky while Jenkins host is blocked by maven central repo.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Existing UT.

@SparkQA
Copy link

SparkQA commented Sep 24, 2019

Test build #111284 has finished for PR 25915 at commit 1f7b8c9.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Member

@srowen srowen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This also looks good to me pending tests.

@cloud-fan
Copy link
Contributor

thanks, merging to master!

@dongjoon-hyun
Copy link
Member

dongjoon-hyun commented Sep 24, 2019

Thank you, all!
Can we have this in branch-2.4 since it's our LTS branch? The download failure fix will help us a lot in terms of maintenance.

This will cause downloading failure

@cloud-fan
Copy link
Contributor

+1, feel free to backport, or I can do it tomorrow.

@dongjoon-hyun
Copy link
Member

Thank you. I'll do that~

dongjoon-hyun pushed a commit that referenced this pull request Sep 24, 2019
…dClientLoader to google minor

### What changes were proposed in this pull request?
Change the remote repo used in IsolatedClientLoader from datanucleus to google mirror.

### Why are the changes needed?
We need to connect the Maven repositories in IsolatedClientLoader for downloading Hive jars. The repository currently used is "http://www.datanucleus.org/downloads/maven2", which is [no longer maintained](http://www.datanucleus.org:15080/downloads/maven2/README.txt). This will cause downloading failure and make hive test cases flaky while Jenkins host is blocked by maven central repo.

### Does this PR introduce any user-facing change?
No

### How was this patch tested?
Existing UT.

Closes #25915 from xuanyuanking/SPARK-29229.

Authored-by: Yuanjian Li <xyliyuanjian@gmail.com>
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
(cherry picked from commit b3e9be4)
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
@xuanyuanking xuanyuanking deleted the SPARK-29229 branch September 25, 2019 01:49
@xuanyuanking
Copy link
Member Author

Thanks for reviewing. :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants