0
0
mirror of https://github.com/PostHog/posthog.git synced 2024-11-24 09:14:46 +01:00
posthog/bin
Karl-Aksel Puulmann bbd41ef04a
Use -Ofair for celery workers (#5063)
From https://medium.com/@taylorhughes/three-quick-tips-from-two-years-with-celery-c05ff9d7f9eb

> By default, preforking Celery workers distribute tasks to their worker processes as soon as they are received, regardless of whether the process is currently busy with other tasks.
> If you have a set of tasks that take varying amounts of time to complete — either deliberately or due to unpredictable network conditions, etc. — this will cause unexpected delays in total execution time for tasks in the queue.

This is 100% the case for us. This should "load balance" the tasks
better across workers.
2021-07-12 13:52:05 +03:00
..
check-typescript-strict
component-test-runner
docker
docker-backend
docker-dev
docker-dev-web
docker-frontend
docker-migrate
docker-server
docker-worker
docker-worker-beat
docker-worker-celery
e2e-test-runner
install-macosx_arm64
plugin-server
pull_production_db
start
start-backend
start-frontend
start-frontend-https
start-https
start-worker
tests