bookwyrm/celerywyrm/settings.py

""" bookwyrm settings and configuration """
# pylint: disable=wildcard-import
# pylint: disable=unused-wildcard-import
from bookwyrm.settings import *

QUERY_TIMEOUT = env.int("CELERY_QUERY_TIMEOUT", env.int("QUERY_TIMEOUT", 30))

# pylint: disable=line-too-long
REDIS_BROKER_PASSWORD = requests.compat.quote(env("REDIS_BROKER_PASSWORD", ""))
REDIS_BROKER_HOST = env("REDIS_BROKER_HOST", "redis_broker")
REDIS_BROKER_PORT = env.int("REDIS_BROKER_PORT", 6379)
REDIS_BROKER_DB_INDEX = env.int("REDIS_BROKER_DB_INDEX", 0)
REDIS_BROKER_URL = env(
    "REDIS_BROKER_URL",
    f"redis://:{REDIS_BROKER_PASSWORD}@{REDIS_BROKER_HOST}:{REDIS_BROKER_PORT}/{REDIS_BROKER_DB_INDEX}",
)

CELERY_BROKER_URL = REDIS_BROKER_URL.replace("unix:", "redis+socket:")
CELERY_RESULT_BACKEND = REDIS_BROKER_URL.replace("unix:", "redis+socket:")

CELERY_DEFAULT_QUEUE = "low_priority"
CELERY_CREATE_MISSING_QUEUES = True

CELERY_ACCEPT_CONTENT = ["json"]
CELERY_TASK_SERIALIZER = "json"
CELERY_RESULT_SERIALIZER = "json"

CELERY_BEAT_SCHEDULER = "django_celery_beat.schedulers:DatabaseScheduler"
CELERY_TIMEZONE = env("TIME_ZONE", "UTC")

CELERY_WORKER_CONCURRENCY = env("CELERY_WORKER_CONCURRENCY", None)
CELERY_TASK_SOFT_TIME_LIMIT = env("CELERY_TASK_SOFT_TIME_LIMIT", None)

FLOWER_PORT = env.int("FLOWER_PORT", 8888)

INSTALLED_APPS = INSTALLED_APPS + [
    "celerywyrm",
]

ROOT_URLCONF = "celerywyrm.urls"

WSGI_APPLICATION = "celerywyrm.wsgi.application"
Imports bookwyrm settings into celery settings It was redundant and super bug-prone! 2021-05-10 21:19:50 +00:00			`""" bookwyrm settings and configuration """`
Simply celery settings 2021-09-07 20:51:59 +00:00			`# pylint: disable=wildcard-import`
			`# pylint: disable=unused-wildcard-import`
Imports bookwyrm settings into celery settings It was redundant and super bug-prone! 2021-05-10 21:19:50 +00:00			`from bookwyrm.settings import *`
Move to redis and fix a bunch of things 2020-03-31 23:31:33 +00:00
Increase network timeout in Celery tasks Since Celery tasks don't affect interactive latency, we should have a more generous timeout. This also allows admins to set the timeout for Celery and the web frontend separately, without breaking backwards compatibility with the previous environment variable. 2023-04-06 05:18:35 +00:00			`QUERY_TIMEOUT = env.int("CELERY_QUERY_TIMEOUT", env.int("QUERY_TIMEOUT", 30))`

Schedules automod task 2022-02-26 18:13:44 +00:00			`# pylint: disable=line-too-long`
Added mypy to scripts and workflow, and some first annotations for celerywyrm 2023-07-22 11:27:43 +00:00			`REDIS_BROKER_PASSWORD = requests.compat.quote(env("REDIS_BROKER_PASSWORD", ""))`
Use redis with password in dev 2022-01-05 16:27:39 +00:00			`REDIS_BROKER_HOST = env("REDIS_BROKER_HOST", "redis_broker")`
Use typecasting env functions Many of these environment variables were probably not actually usable, since they would be strings if set in the env file. Using the typecasting functions fixes this, and generally shows the intention of the code more clearly. 2023-03-18 19:23:51 +00:00			`REDIS_BROKER_PORT = env.int("REDIS_BROKER_PORT", 6379)`
			`REDIS_BROKER_DB_INDEX = env.int("REDIS_BROKER_DB_INDEX", 0)`
style fixes 2023-01-14 23:44:10 +00:00			`REDIS_BROKER_URL = env(`
			`"REDIS_BROKER_URL",`
lint fixes 2023-01-15 02:20:37 +00:00			`f"redis://:{REDIS_BROKER_PASSWORD}@{REDIS_BROKER_HOST}:{REDIS_BROKER_PORT}/{REDIS_BROKER_DB_INDEX}",`
style fixes 2023-01-14 23:44:10 +00:00			`)`
Use redis with password in dev 2022-01-05 16:27:39 +00:00
style fixes 2023-01-14 23:44:10 +00:00			`CELERY_BROKER_URL = REDIS_BROKER_URL.replace("unix:", "redis+socket:")`
			`CELERY_RESULT_BACKEND = REDIS_BROKER_URL.replace("unix:", "redis+socket:")`
Simply celery settings 2021-09-07 20:51:59 +00:00
python formatting 2021-09-08 00:11:32 +00:00			`CELERY_DEFAULT_QUEUE = "low_priority"`
Adds auto-create queues option to config 2022-03-17 16:57:25 +00:00			`CELERY_CREATE_MISSING_QUEUES = True`
Adds priority queues to celery 2021-09-07 23:06:54 +00:00
Runs black 2021-03-08 16:49:10 +00:00			`CELERY_ACCEPT_CONTENT = ["json"]`
			`CELERY_TASK_SERIALIZER = "json"`
Simply celery settings 2021-09-07 20:51:59 +00:00			`CELERY_RESULT_SERIALIZER = "json"`
Schedules automod task 2022-02-26 18:13:44 +00:00
			`CELERY_BEAT_SCHEDULER = "django_celery_beat.schedulers:DatabaseScheduler"`
			`CELERY_TIMEZONE = env("TIME_ZONE", "UTC")`

Add env vars for celery concurrency and time limit 2023-03-07 18:52:02 +00:00			`CELERY_WORKER_CONCURRENCY = env("CELERY_WORKER_CONCURRENCY", None)`
			`CELERY_TASK_SOFT_TIME_LIMIT = env("CELERY_TASK_SOFT_TIME_LIMIT", None)`

Set default FLOWER_PORT 2023-03-18 19:33:24 +00:00			`FLOWER_PORT = env.int("FLOWER_PORT", 8888)`
Move to redis and fix a bunch of things 2020-03-31 23:31:33 +00:00
Imports bookwyrm settings into celery settings It was redundant and super bug-prone! 2021-05-10 21:19:50 +00:00			`INSTALLED_APPS = INSTALLED_APPS + [`
Runs black 2021-03-08 16:49:10 +00:00			`"celerywyrm",`
Move to redis and fix a bunch of things 2020-03-31 23:31:33 +00:00			`]`

Runs black 2021-03-08 16:49:10 +00:00			`ROOT_URLCONF = "celerywyrm.urls"`
Move to redis and fix a bunch of things 2020-03-31 23:31:33 +00:00
Runs black 2021-03-08 16:49:10 +00:00			`WSGI_APPLICATION = "celerywyrm.wsgi.application"`