Skip to content

Make running sytest docker work in worker mode#573

Merged
erikjohnston merged 2 commits into
developfrom
erikj/worker_docker_ci
Mar 15, 2019
Merged

Make running sytest docker work in worker mode#573
erikjohnston merged 2 commits into
developfrom
erikj/worker_docker_ci

Conversation

@erikjohnston
Copy link
Copy Markdown
Member

This also includes moving a bunch of setup into the docker image so that
the containers start up a lot faster.

This does make the docker images about ~1.1GB, which is quite a lot bigger than before.

Depends on matrix-org/synapse#4853

This also includes moving a bunch of setup into the docker image so that
the containers start up a lot faster.
Copy link
Copy Markdown
Member

@richvdh richvdh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

generally looks sane

Comment thread docker/Dockerfile-synapsepy2 Outdated
RUN /venv/bin/pip install -q --no-cache-dir lxml psycopg2

# Uninstall matrix-synapse package so it doesn't collide with the version we try
# Zand test
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Zand

Comment thread docker/Dockerfile-synapsepy3 Outdated
RUN /venv/bin/pip install -q --no-cache-dir lxml psycopg2

# Uninstall matrix-synapse package so it doesn't collide with the version we try
# Zand test
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Zand

Comment thread docker/Dockerfile-synapsepy2 Outdated

RUN su -c '/usr/lib/postgresql/9.6/bin/initdb -E "UTF-8" --lc-collate="en_US.UTF-8" --lc-ctype="en_US.UTF-8" --username=postgres' postgres

# Turn of all the fsync stuff for postgres
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

off

@@ -1,14 +1,35 @@
FROM matrixdotorg/sytest:latest
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it'd be really nice to combine these two into one dockerfile with an ARG in the same way that synapse's dockerfile works.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

given that the lifespan of the py2 version is only a fortnight, not important, I guess.

Comment thread docker/README.md Outdated
This will run on the same branch in SyTest as the Synapse checkout, if possible, but will fall back to using develop.

If you want to use an existing checkout of SyTest, mount it to `/test` inside the container by adding `-v /path/to/sytest\:/test` to the docker command.
If you want to use an existing checkout of SyTest, mount it to `/test` inside the container by adding `-v /path/to/sytest\:/test` to the docker command (note that this will be written to).
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: wrapping is a thing

Comment thread docker/pydron.py
server = HTTPServer(('', PORT_NUMBER), WebHandler)
server.serve_forever()

except KeyboardInterrupt:
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what's this for, ooi?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This (empirically) captures when we ask docker to stop half way through a job.

Comment thread docker/Dockerfile
perl \
wget \
postgresql \
postgresql-9.6 \
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it feels weird that we are doing this here rather than in Dockerfile-synapsepy2 or whatever

Copy link
Copy Markdown
Member

@richvdh richvdh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

actually it's fine. fix the typos and ship it.

@erikjohnston erikjohnston merged commit 673d8ea into develop Mar 15, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants