Skip to content

IT: Switch to OpenJDK8 base image.#5060

Merged
drcrallen merged 2 commits intoapache:masterfrom
gianm:dockerit
Nov 9, 2017
Merged

IT: Switch to OpenJDK8 base image.#5060
drcrallen merged 2 commits intoapache:masterfrom
gianm:dockerit

Conversation

@gianm
Copy link
Copy Markdown
Contributor

@gianm gianm commented Nov 8, 2017

Also split the Docker image into a base image and a child image, and
build the base image ahead of time for efficiency's sake. Also upgrade
ZK to 3.4.10 due to missing 3.4.6 downloads on the mirror as seen here:

https://travis-ci.org/druid-io/druid/jobs/299289856

Also split the Docker image into a base image and a child image, and
build the base image ahead of time for efficiency's sake. Also upgrade
ZK to 3.4.10.
@gianm
Copy link
Copy Markdown
Contributor Author

gianm commented Nov 8, 2017

OpenJDK was attempted in #4970 but the tests didn't pass: #4970 (comment). So let's see if it works today. Maybe installing more things on the image ahead of time would help.

@gianm
Copy link
Copy Markdown
Contributor Author

gianm commented Nov 9, 2017

ITs passed in 34 minutes: https://travis-ci.org/druid-io/druid/jobs/299375692. I think the max is 50 so it seems like a good enough margin of error.

@leventov
Copy link
Copy Markdown
Member

leventov commented Nov 9, 2017

Could you please add a comment in pom.xml along with zookeeper dependency version, that if it is updated, the version in the Docker setup scripts needs to be updated too?

@leventov leventov added this to the 0.11.0 milestone Nov 9, 2017
@leventov
Copy link
Copy Markdown
Member

leventov commented Nov 9, 2017

Adding to 0.11.0 milestone to fix CI for backports

/root/.m2

# Base image is built from integration-tests/docker-base in the Druid repo
FROM imply/druiditbase
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice to eventually pull from a druid-io source, ECR, GCR, Docker Hub, and Quay are all options. Is there any pro or con to any of them that folks know about?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Docker Hub is built into docker so that's a pro in favor of that one. It's also free. It's pretty bare bones but should be good enough for what we're doing.

There is already a "semi-official" https://hub.docker.com/r/druidio/ that @xvrl set up: https://groups.google.com/d/topic/druid-development/RCLPKrBEMr0/discussion

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Definitely makes sense to me to move this to druidio on docker hub if that repo is made "official" instead of "semi-official" (probably just meaning more druid people should have push access).

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I meant for it to become the official one, @jon-wei is the only one that gave me his login. Maybe once I have all the PMC members in there, it can be christened as the official one? @gianm @fjy @himanshug @drcrallen @cheddar @nishantmonu51

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@xvrl that sounds good to me; my docker hub id is "gianm"

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@xvrl mine is "himanshu01"

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@gianm @himanshug you should have access now.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks @xvrl

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@xvrl thanks

@gianm
Copy link
Copy Markdown
Contributor Author

gianm commented Nov 9, 2017

@leventov

Could you please add a comment in pom.xml along with zookeeper dependency version, that if it is updated, the version in the Docker setup scripts needs to be updated too?

That's not really what happened; in reality what happened is that ZK 3.4.6 was removed from the apache download mirror we were using today. Only the latest ZK 3.4.10 is still there. I'm not sure why this happened, but it didn't seem to hurt to upgrade for the ITs, so I did it.

@leventov
Copy link
Copy Markdown
Member

leventov commented Nov 9, 2017

I mean, it's nice not to forget to change the version in IT, when e. g. in pom.xml it's updated to 3.4.11. Or I didn't understand you?

@gianm
Copy link
Copy Markdown
Contributor Author

gianm commented Nov 9, 2017

@leventov Ah, I misunderstood what you meant by "need". I thought you meant it was required for the test to pass. I was just saying it's not. But I guess you just meant it would be nice to upgrade them together, so I will add a comment about that.

@himanshug
Copy link
Copy Markdown
Contributor

LGTM , integration test build had passed ... AnnouncerTest had failed, restarted that.

@drcrallen drcrallen merged commit e6ec431 into apache:master Nov 9, 2017
leventov pushed a commit that referenced this pull request Nov 9, 2017
* IT: Switch to OpenJDK8 base image.

Also split the Docker image into a base image and a child image, and
build the base image ahead of time for efficiency's sake. Also upgrade
ZK to 3.4.10.

* Additional comments about ZK upgrades.
gianm pushed a commit that referenced this pull request Nov 9, 2017
* IT: Switch to OpenJDK8 base image.

Also split the Docker image into a base image and a child image, and
build the base image ahead of time for efficiency's sake. Also upgrade
ZK to 3.4.10.

* Additional comments about ZK upgrades.
@gianm gianm deleted the dockerit branch September 23, 2022 19:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants