bookwyrm/bookwyrm/tasks.py

""" background tasks """
import os
from celery import Celery

from celerywyrm import settings

# set the default Django settings module for the 'celery' program.
os.environ.setdefault("DJANGO_SETTINGS_MODULE", "celerywyrm.settings")
app = Celery(
    "tasks", broker=settings.CELERY_BROKER_URL, backend=settings.CELERY_RESULT_BACKEND
)

# priorities
LOW = "low_priority"
MEDIUM = "medium_priority"
HIGH = "high_priority"
# import items get their own queue because they're such a pain in the ass
IMPORTS = "imports"
# I keep making more queues?? this one broadcasting out
BROADCAST = "broadcast"
Runs black 2021-03-08 16:49:10 +00:00			`""" background tasks """`
Move to redis and fix a bunch of things 2020-03-31 23:31:33 +00:00			`import os`
Style fixes suggested by pylint. 2020-04-22 13:53:22 +00:00			`from celery import Celery`
Move to redis and fix a bunch of things 2020-03-31 23:31:33 +00:00
Simply celery settings 2021-09-07 20:51:59 +00:00			`from celerywyrm import settings`
Move to redis and fix a bunch of things 2020-03-31 23:31:33 +00:00
			`# set the default Django settings module for the 'celery' program.`
Runs black 2021-03-08 16:49:10 +00:00			`os.environ.setdefault("DJANGO_SETTINGS_MODULE", "celerywyrm.settings")`
Move to redis and fix a bunch of things 2020-03-31 23:31:33 +00:00			`app = Celery(`
Simply celery settings 2021-09-07 20:51:59 +00:00			`"tasks", broker=settings.CELERY_BROKER_URL, backend=settings.CELERY_RESULT_BACKEND`
Move to redis and fix a bunch of things 2020-03-31 23:31:33 +00:00			`)`
Adds enum for queue names 2021-11-12 03:10:22 +00:00
			`# priorities`
			`LOW = "low_priority"`
			`MEDIUM = "medium_priority"`
			`HIGH = "high_priority"`
Create a separate celery queue for imports 2022-12-16 22:20:50 +00:00			`# import items get their own queue because they're such a pain in the ass`
			`IMPORTS = "imports"`
Use a separate queue for broadcasts I think this will go a long way to solve the federation delay problems we're seeing on b.s. I'm not sure at what point adding more queues will create more problems than it solves, but I do think in this case the queues are out of balance and moving broadcasts (which are the most common type of `medium_priority` task at the moment) to their own queue will be an improvement. 2023-02-20 20:58:41 +00:00			`# I keep making more queues?? this one broadcasting out`
			`BROADCAST = "broadcast"`