4040 docker openshift by pdurbin · Pull Request #4168 · IQSS/dataverse

pdurbin · 2017-09-27T17:50:23Z

Related Issues

connects to Provide Docker file to create a dev environment #3938 Provide Docker file to create a dev environment
Get Dataverse running on OpenShift (Docker and Kubernetes) #4040 Get Dataverse running on OpenShift (Docker and Kubernetes) (deferred to backlog)

Pull Request Checklist

Unit tests completed: None
Integration tests: None
Deployment requirements, SQL updates, Solr updates, etc.: Tested on Minishift, per Dev Guide updates
Documentation completed
Merged latest from "develop" branch and resolved conflicts

The idea is that we won't mess with the kick-the-tires for a bit so that people can play with Minishift without that tag constantly changing under their feet while we work on other efforts in other tags such as getting the containers to run as non-root and getting them to run in 1 GB of memory.

Back out of the "kick the tires" story of using OpenShift Online instead of Vagrant because Dataverse won't fit in the free tier which limits your application to 1 GB of total memory. PostgreSQL and Solr each seem to run fine in 256 MB of memory but Dataverse/Glassfish can't run in 512MB of memory. That said, logic has been added to the installer to check if we're running in Docker and how much memory we have. We don't change the Glassfish heap size based on this value, however, because the war files fails to deploy.

Conflicts (just a trailing character: doc/sphinx-guides/source/installation/config.rst

coveralls · 2017-09-27T17:56:56Z

Coverage remained the same at 12.438% when pulling 74767a6 on 4040-docker-openshift into c84e899 on develop.

danmcp · 2017-09-27T18:21:30Z

conf/openshift/openshift.json

+            }
+          },
+          "spec": {
+            "containers": [


I still really want to see these split out into separate pods.

@danmcp can you please link me to an example that's closer to what you want? Thanks!

@pdurbin In this example:

https://github.com/openshift/origin/blob/master/examples/sample-app/application-template-stibuild.json

There is the mysql container inside its deployment config:

https://github.com/openshift/origin/blob/master/examples/sample-app/application-template-stibuild.json#L400

And here is the ruby container inside its deployment config:

https://github.com/openshift/origin/blob/master/examples/sample-app/application-template-stibuild.json#L244

@danmcp thanks. I made myself a couple screenshots so I can better see what you're talking about. It sounds like you want more than one DeploymentConfig entries, each with a single container like this:

What I'm doing right now is only using a single DeploymentConfig and putting all three of my containers in it like this:

@danmcp is there a way to have one DeploymentConfig run before the other? Right now the Glassfish/Dataverse container restarts until the PostgreSQL and Solr containers are available.

pameyer · 2017-09-27T22:07:25Z

conf/docker/dataverse-glassfish/Dockerfile

+#COPY ./init-dataverse /root/dvinstall
+#COPY ./setup-all.sh /root/dvinstall
+#COPY ./setup-irods.sh /root/dvinstall
+COPY ./Dockerfile /


It shouldn't be necessary to copy the Dockerfile into the image.

coveralls · 2017-09-29T18:30:55Z

Coverage remained the same at 12.438% when pulling 4dd759b on 4040-docker-openshift into c84e899 on develop.

danmcp · 2017-10-10T20:12:04Z

@pdurbin You can't force order other than using an external orchestrator. But generally you want to avoid this sort of methodology because you would end up in the same state if everything had to be restarted or redeployed. It's better to build your components in a way that doesn't depend on a particular order. One way to do this is with an init container. You would add one to the glassfish container and it will wait for the DB to be available before it exits. At which point glassfish would start up.

https://kubernetes.io/docs/concepts/workloads/pods/init-containers/

coveralls · 2017-10-11T21:45:59Z

Coverage decreased (-0.007%) to 12.431% when pulling 8a48b4f on 4040-docker-openshift into c84e899 on develop.

landreev

Per our conversation earlier, the scripts look good. Once @matthew-a-dunlap has added his doc change it should be ready for QA.

pdurbin · 2017-10-12T01:41:43Z

doc/sphinx-guides/source/developers/dev-environment.rst

+Use "developer" as the username and a couple characters as the password.
+
+Allow Containers to Run as Root in Minishift
+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~


Whoops! This whole section can be removed. The containers run as non-root as of b84526c

pdurbin · 2017-10-12T13:27:13Z

doc/sphinx-guides/source/developers/dev-environment.rst

 The following curl command is expected to fail until you "expose" the HTTP service.

-``curl http://dataverse-glassfish-service-project1.192.168.99.102.nip.io/api/info/version``
+``curl http://dataverse-glassfish-service-project1.192.168.99.100.nip.io/api/info/version``


Ah, I think @pameyer warned me that these IP addresses will change.

pdurbin · 2017-10-12T13:27:23Z

doc/sphinx-guides/source/developers/dev-environment.rst

 This should show a version number:

-``curl http://dataverse-glassfish-service-project1.192.168.99.102.nip.io/api/info/version``
+``curl http://dataverse-glassfish-service-project1.192.168.99.100.nip.io/api/info/version``


Ditto: https://github.com/IQSS/dataverse/pull/4168/files/4dd759b35b72507e316b1db10ae3bd759fd5b2f0..8a48b4f8aaeb0dae72e8da7f3a158c8eea1edcc7#r144287933

pdurbin · 2017-10-12T13:28:32Z

doc/sphinx-guides/source/developers/dev-environment.rst

 - password: developer

-Visit https://192.168.99.100:8443/console/project/project1/browse/routes and click http://dataverse-glassfish-service-project1.192.168.99.100.nip.io/ or whatever is shows. This assumes you named your project ``project1``.
+Visit https://192.168.99.100:8443/console/project/project1/browse/routes and click http://dataverse-glassfish-service-project1.192.168.99.100.nip.io/ or whatever is shows under "Routes External Traffic". This assumes you named your project ``project1``.


This says 100 also. I think we should back out of the changes to 102 above and just say that the IP will vary.

Oh, duh. It looks like @matthew-a-dunlap was making this IP consistently "100", which is great. I added notes that it can vary in 25cfb30

coveralls · 2017-10-12T13:55:55Z

Coverage decreased (-0.007%) to 12.431% when pulling 25cfb30 on 4040-docker-openshift into c84e899 on develop.

coveralls · 2017-10-17T16:38:42Z

Coverage decreased (-0.007%) to 12.431% when pulling 1e7fb53 on 4040-docker-openshift into c84e899 on develop.

pdurbin added 22 commits September 14, 2017 16:00

stub out Docker and OpenShift files #4040

d287772

switch from Project to Template, add dev docs #4040

77b3f67

use config from @danmcp #4040

4702e0a

add centos/postgresql-94-centos7 #4040

f41d753

add ndslabs/dataverse-solr image #4040

c20dd39

add more handy oc commands to docs #4040

3ab921c

expose postgres env vars needed by init-glassfish #4040

2198367

must have selector for expose route to work #4040

6ec54c2

set dataverseAdmin password to "admin" #4040

e90f771

explain how to run containers as root #4040

975d38e

build and switch to iqss/dataverse-solr on Docker Hub #4040

0a44410

switch from ndslabs to iqss Dataverse/Glassfish image #4040

7c81b4e

use the right Docker tag for Dataverse/Glassfish #4040

6e4ef45

document dataverse.timerServer JVM option

8040a5d

document how to create Docker images #4040

815e48a

add NDS Labs Workbench for testing Dataverse #4040 #4152

43d3844

get Dataverse/Glassfish container running as non-root #4040

b84526c

Merge branch 'develop' into 4040-docker-openshift #4040

ef81e53

Conflicts (just a trailing character: doc/sphinx-guides/source/installation/config.rst

cleanup #4040

e920e9f

remove cruft from botch conflict resolution #4040

74767a6

pdurbin mentioned this pull request Sep 27, 2017

Get Dataverse running on OpenShift (Docker and Kubernetes) #4040

Closed

danmcp reviewed Sep 27, 2017

View reviewed changes

This was referenced Sep 27, 2017

Provide Docker file to create a dev environment #3938

Closed

How to get Dataverse running on a Windows computer for development #3927

Closed

pameyer reviewed Sep 27, 2017

View reviewed changes

let build script push arbitrary tags to Docker Hub #4040

4dd759b

Documentation edits minishift #4040

8a48b4f

landreev approved these changes Oct 11, 2017

View reviewed changes

pdurbin commented Oct 12, 2017

View reviewed changes

doc fix: all containers run as non-root now #4040

25cfb30

pdurbin mentioned this pull request Oct 16, 2017

Remove references from NDS Labs Workbench from Dataverse guides #4152

Closed

File path clarity#4040

1e7fb53

kcondon merged commit 06c8dde into develop Oct 17, 2017

kcondon deleted the 4040-docker-openshift branch October 17, 2017 21:05

pdurbin added this to the 4.8.2 - Docker Images, Dataset Locking Updates milestone Nov 8, 2017

pdurbin mentioned this pull request Dec 15, 2017

improve ability of developers to run integration tests #4369

Closed

pdurbin mentioned this pull request Feb 27, 2018

The name and future of this git repo IQSS/dataverse-aws#11

Open

patrickdillon mentioned this pull request Apr 18, 2018

Add Postgresql Statefulsets with Replication to OpenShift/Kubernetes #4598

Closed

MichaelClifford mentioned this pull request Apr 25, 2018

Add Glassfish Statefulsets to OpenShift/Kubernetes #4617

Closed

pdurbin mentioned this pull request May 25, 2018

Docker for production #4665

Closed

Comments

Conversation

pdurbin commented Sep 27, 2017 • edited by kcondon Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Related Issues

Pull Request Checklist

Uh oh!

coveralls commented Sep 27, 2017

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

coveralls commented Sep 29, 2017

Uh oh!

danmcp commented Oct 10, 2017

Uh oh!

coveralls commented Oct 11, 2017

Uh oh!

landreev left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

coveralls commented Oct 12, 2017

Uh oh!

coveralls commented Oct 17, 2017

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

pdurbin commented Sep 27, 2017 •

edited by kcondon

Loading