provide docker image(s)

[casperdcl]

Provide docker images

• make dev installation and testing easier
• also can be used by end-users (something like docker run --rm -t -v $PWD:/repo dvc status)
• also would make it easier for end-users to incorporate into their own docker images
• can be tested on travis
• can be released via github package registry
• can be released via docker hub
• related Snapcraft #2771
• realted consider getting rid of packages/binaries built by pyinstaller (windows exe and mac pkg) #2760

@casperdcl , I'm not sure how much benefit would bring, giving that it is not that hard to create a docker image for DVC: docker run --name dvc -ti python pip install dvc && docker container commit --change 'CMD ["dvc"]' dvc dvc

Also, testing this would be the same as testing DVC on a linux machine (or at least, it should be)

I doubt that users want to use it as a base image, since it doesn't provide anything else than DVC.

I'd prefer to not maintain this one, to be honest

[pared]

I would also argue, that when doing some data science stuff in docker, its probably easier to install DVC in your own image, rather than try to adjust DVC image to you requirements (like installing TF/pytorch/...).

[casperdcl]

@pared that was my point about

• also would make it easier for end-users to incorporate into their own docker images

as in people could copy-paste from our docker file into theirs...

I assumed it's more complex than just a pip install to get all the features (at least some apt-get installs as well?)

[pared]

@casperdcl ok, I didn't quite get it.

as in people could copy-paste from our docker file into theirs...

That would surely help to build custom image.

[efiop]

@casperdcl Hm, apt-gets would depend on the base image that you are using. If it is absolutely bare then yeah, you will need to install python and whatnot. But for regular things like ubuntu you don't have to install anything special, except, I guess, git. We have a docker image that we are using for testing here https://github.com/iterative/dvc-test/blob/master/docker/ubuntu/16.04/Dockerfile . Not sure if we still need to install libffi explicitly 🤔

[casperdcl]

@efiop the setup.py file seems to imply more deps are required - I was referring to a full pip install dvc[all,ssh_gssapi,tests]

[casperdcl]

@efiop can confirm libffi not required on ubuntu:18.04

[efiop]

@casperdcl Ah, got it. yeah, gssapi requires some dev tools to compile stuff as well as tests, so the dockerfile for that would be more complicated. We could provide it in the docs maybe? I'm not quite sure about building and testing it. When used for regular tests, it would always run linux inside, instead of running on the host system, which is a problem, as we already have a lack of native-testing on windows and osx, and that might prevent us from discovering bugs when developing. Though a nice thing about it is that you don't have to setup a test env on your machine, that is true 🙂

[casperdcl]

Yes I did start making a few flavours of docker images for testing (alpine, ubuntu LTS, 2.7, 3.6 etc) ages ago which are probably sitting in a git stash on one of any number of machines. maybe.

Now I just use a conda env for dvc testing.