Skip to content

Updates to docker-entrypoint for worker and scheduler#364

Merged
washort merged 4 commits intomozilla:masterfrom
jasonthomas:patch-1
Apr 11, 2018
Merged

Updates to docker-entrypoint for worker and scheduler#364
washort merged 4 commits intomozilla:masterfrom
jasonthomas:patch-1

Conversation

@jasonthomas
Copy link
Copy Markdown
Member

I've added --max-memory-per-child to 1/4 of the available system memory. I think this will assist with workers being reaped by OOMKiller and other memory issues we have seen.

--maxtasksperchild was renamed to --max-tasks-per-child in Celery 4 [1].

/cc @robotblake

r?

[1] https://github.com/celery/celery/blob/8047ca9e818db8151dc6c80814600797ab94f5bc/docs/history/whatsnew-4.0.rst#worker

@jezdez
Copy link
Copy Markdown

jezdez commented Apr 11, 2018

We should send a PR for this upstream as well.

@jezdez
Copy link
Copy Markdown

jezdez commented Apr 11, 2018

@jasonthomas r+

@washort washort merged commit 7118fe3 into mozilla:master Apr 11, 2018
emtwo pushed a commit that referenced this pull request May 25, 2018
* Use --max-tasks-per-child as per celery documentation

* Set --max-memory-per-child to 1/4th of total system memory

* Split exec command over multiple lines

* Fix memory variable typo
washort pushed a commit that referenced this pull request Jul 25, 2018
* Use --max-tasks-per-child as per celery documentation

* Set --max-memory-per-child to 1/4th of total system memory

* Split exec command over multiple lines

* Fix memory variable typo
washort pushed a commit that referenced this pull request Jul 30, 2018
* Use --max-tasks-per-child as per celery documentation

* Set --max-memory-per-child to 1/4th of total system memory

* Split exec command over multiple lines

* Fix memory variable typo
jezdez pushed a commit that referenced this pull request Aug 16, 2018
* Use --max-tasks-per-child as per celery documentation

* Set --max-memory-per-child to 1/4th of total system memory

* Split exec command over multiple lines

* Fix memory variable typo
jezdez pushed a commit that referenced this pull request Sep 6, 2018
* Use --max-tasks-per-child as per celery documentation

* Set --max-memory-per-child to 1/4th of total system memory

* Split exec command over multiple lines

* Fix memory variable typo
jezdez pushed a commit that referenced this pull request Sep 6, 2018
* Use --max-tasks-per-child as per celery documentation

* Set --max-memory-per-child to 1/4th of total system memory

* Split exec command over multiple lines

* Fix memory variable typo
jezdez pushed a commit that referenced this pull request Sep 6, 2018
* Use --max-tasks-per-child as per celery documentation

* Set --max-memory-per-child to 1/4th of total system memory

* Split exec command over multiple lines

* Fix memory variable typo
jezdez pushed a commit that referenced this pull request Nov 1, 2018
* Use --max-tasks-per-child as per celery documentation

* Set --max-memory-per-child to 1/4th of total system memory

* Split exec command over multiple lines

* Fix memory variable typo
jezdez pushed a commit that referenced this pull request Dec 12, 2018
* Use --max-tasks-per-child as per celery documentation

* Set --max-memory-per-child to 1/4th of total system memory

* Split exec command over multiple lines

* Fix memory variable typo
jezdez pushed a commit that referenced this pull request Dec 17, 2018
* Use --max-tasks-per-child as per celery documentation

* Set --max-memory-per-child to 1/4th of total system memory

* Split exec command over multiple lines

* Fix memory variable typo
jezdez pushed a commit that referenced this pull request Dec 19, 2018
* Use --max-tasks-per-child as per celery documentation

* Set --max-memory-per-child to 1/4th of total system memory

* Split exec command over multiple lines

* Fix memory variable typo
jezdez pushed a commit that referenced this pull request Jan 25, 2019
* Use --max-tasks-per-child as per celery documentation

* Set --max-memory-per-child to 1/4th of total system memory

* Split exec command over multiple lines

* Fix memory variable typo
@jezdez
Copy link
Copy Markdown

jezdez commented Mar 22, 2019

Opened getredash#3625 to track this upstream.

jezdez pushed a commit that referenced this pull request Mar 25, 2019
* Use --max-tasks-per-child as per celery documentation

* Set --max-memory-per-child to 1/4th of total system memory

* Split exec command over multiple lines

* Fix memory variable typo
washort pushed a commit that referenced this pull request Mar 26, 2019
* Use --max-tasks-per-child as per celery documentation

* Set --max-memory-per-child to 1/4th of total system memory

* Split exec command over multiple lines

* Fix memory variable typo
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants