Docs Celeryq Dev Django Celery en Latest
Docs Celeryq Dev Django Celery en Latest
Docs Celeryq Dev Django Celery en Latest
Release 2.5.5
Ask Solem
2 Getting Started 7
2.1 First steps with Django . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
4 Cookbook 11
4.1 Unit Testing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
5 API Reference 13
5.1 App - djcelery.app . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
5.2 Views - djcelery.views . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
5.3 URLs - djcelery.urls . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
5.4 Django Models - celery.models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13
5.5 Managers - djcelery.managers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
5.6 Celery Loaders - djcelery.loaders . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
5.7 Periodic Task Schedulers - djcelery.schedulers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
5.8 Event Snapshots - djcelery.snapshot . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
5.9 Database Backend - djcelery.backends.database . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
5.10 Cache Backend - djcelery.backends.cache . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
5.11 Contrib: Test Runner - djcelery.contrib.test_runner . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
5.12 Humanize utils - djcelery.humanize . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
5.13 Utilities - djcelery.utils . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
6 Change history 17
6.1 2.5.5 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
i
6.2 2.5.4 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
6.3 2.5.3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
6.4 2.5.2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
6.5 2.5.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
6.6 2.5.0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
6.7 2.4.2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
6.8 2.4.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
6.9 2.4.0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
6.10 2.3.3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
6.11 2.3.2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
6.12 2.3.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
6.13 2.3.0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
6.14 2.2.4 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
6.15 2.2.3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
6.16 2.2.2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
6.17 2.2.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
6.18 2.2.0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
6.19 2.1.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
6.20 2.1.0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
6.21 2.0.2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
6.22 2.0.0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
ii
django-celery Documentation, Release 2.5.5
Contents:
Contents 1
django-celery Documentation, Release 2.5.5
2 Contents
CHAPTER 1
Version 2.5.5
Web http://celeryproject.org/
Download http://pypi.python.org/pypi/django-celery/
Source http://github.com/ask/django-celery/
Keywords celery, task queue, job queue, asynchronous, rabbitmq, amqp, redis, python, django, web-
hooks, queue, distributed
–
django-celery provides Celery integration for Django; Using the Django ORM and cache backend for storing results,
autodiscovery of task modules for applications listed in INSTALLED_APPS, and more.
• Using django-celery
– Special note for mod_wsgi users
• Documentation
• Installation
– Downloading and installing from source
– Using the development version
• Getting Help
– Mailing list
– IRC
• Bug tracker
• Wiki
• Contributing
3
django-celery Documentation, Release 2.5.5
• License
To enable django-celery for your project you need to add djcelery to INSTALLED_APPS:
INSTALLED_APPS += ("djcelery", )
import djcelery
djcelery.setup_loader()
Everything works the same as described in the Celery User Manual, except you need to invoke the programs through
manage.py:
Program Replace with
celeryd python manage.py celeryd
celeryctl python manage.py celeryctl
celerybeat python manage.py celerybeat
camqadm python manage.py camqadm
celeryev python manage.py celeryev
celeryd-multi python manage.py celeryd_multi
The other main difference is that configuration values are stored in your Django projects’ settings.py module
rather than in celeryconfig.py.
If you’re trying celery for the first time you should start by reading Getting started with django-celery
If you’re using mod_wsgi to deploy your Django application you need to include the following in your .wsgi
module:
import djcelery
djcelery.setup_loader()
1.2 Documentation
The Celery User Manual contains user guides, tutorials and an API reference. Also the django-celery documentation,
contains information about the Django integration.
1.3 Installation
You can install django-celery either via the Python Package Index (PyPI) or from source.
To install using pip,:
$ easy_install django-celery
You will then want to create the necessary tables. If you are using south for schema migrations, you’ll want to:
For those who are not using south, a normal syncdb will work:
For discussions about the usage, development, and future of celery, please join the celery-users mailing list.
1.4.2 IRC
Come chat with us on IRC. The #celery channel is located at the Freenode network.
If you have any suggestions, bug reports or annoyances please report them to our issue tracker at http://github.com/
ask/django-celery/issues/
1.6 Wiki
http://wiki.github.com/ask/celery/
1.7 Contributing
1.8 License
This software is licensed under the New BSD License. See the LICENSE file in the top distribution directory for
the full license text.
Getting Started
This document has been moved into the main Celery documentation, you can find it at:;
http://ask.github.com/celery/django/first-steps-with-django.html
7
django-celery Documentation, Release 2.5.5
Answer: To enable the Django translation machinery you need to activate it with a language. Note: Be sure to reset
to the previous language when done.
The common pattern here would be for the task to take a language argument:
@task()
def generate_report(template="report.html", language=None):
prev_language = translation.get_language()
language and translation.activate(language)
try:
report = render_to_string(template)
finally:
translation.activate(prev_language)
save_report_somewhere(report)
9
django-celery Documentation, Release 2.5.5
Answer: If you’re running tests from your Django project, and the celery test suite is failing in that context, then
follow the steps below. If the celery tests are failing in another context, please report an issue to our issue tracker at
GitHub:
http://github.com/ask/celery/issues/
That Django is running tests for all applications in INSTALLED_APPS by default is a pet peeve for many. You should
use a test runner that either
1. Explicitly lists the apps you want to run tests for, or
2. Make a test runner that skips tests for apps you don’t want to run.
For example the test runner that celery is using:
http://github.com/ask/celery/blob/f90491fe0194aa472b5aecdefe5cc83289e65e69/celery/tests/runners.py
To use this test runner, add the following to your settings.py:
TEST_RUNNER = "djcelery.tests.runners.CeleryTestSuiteRunner",
TEST_APPS = (
"app1",
"app2",
"app3",
"app4",
)
INSTALLED_APPS = (.....)
TEST_RUNNER = "djcelery.tests.runners.CeleryTestSuiteRunner",
TEST_APPS = filter(lambda k: k != "celery", INSTALLED_APPS)
Cookbook
The first problem you’ll run in to when trying to write a test that runs a task is that Django’s test runner doesn’t use the
same database as your celery daemon is using. If you’re using the database backend, this means that your tombstones
won’t show up in your test database and you won’t be able to get the return value or check the status of your tasks.
There are two ways to get around this. You can either take advantage of CELERY_ALWAYS_EAGER = True to skip
the daemon, or you can avoid testing anything that needs to check the status or result of a task.
If you’re going the CELERY_ALWAYS_EAGER route, which is probably better than just never testing some parts
of your app, a custom Django test runner does the trick. Celery provides a simple test runner, but it’s easy enough
to roll your own if you have other things that need to be done. http://docs.djangoproject.com/en/dev/topics/testing/
#defining-a-test-runner
For this example, we’ll use the djcelery.contrib.test_runner to test the add task from the User Guide:
Tasks examples in the Celery documentation.
To enable the test runner, set the following settings:
TEST_RUNNER = 'djcelery.contrib.test_runner.CeleryTestSuiteRunner'
class AddTestCase(TestCase):
11
django-celery Documentation, Release 2.5.5
def testNoError(self):
"""Test that the ``add`` task runs with no errors,
and returns the correct result."""
result = add.delay(8, 8)
self.assertEquals(result.get(), 16)
self.assertTrue(result.successful())
This test assumes that you put your example add task in maypp.tasks so adjust the import for wherever you put
the class.
This page contains common recipes and techniques.
12 Chapter 4. Cookbook
CHAPTER 5
API Reference
Release 2.5
Date Nov 19, 2017
djcelery.app.app = None
The Django-Celery app instance.
13
django-celery Documentation, Release 2.5.5
TASK_STATUSES_CHOICES
Django tuple of possible values for the task statuses, for usage in model/form fields choices argument.
class TaskMeta
Model for storing the result and status of a task.
Note Only used if you’re running the database backend.
task_id
The unique task id.
status
The current status for this task.
result
The result after successful/failed execution. If the task failed, this contains the execption it raised.
date_done
The date this task changed status.
class PeriodicTaskMeta
Metadata model for periodic tasks.
name
The name of this task, as registered in the task registry.
last_run_at
The date this periodic task was last run. Used to find out when it should be run next.
total_run_count
The number of times this periodic task has been run.
task
The class/function for this task.
delay()
Delay the execution of a periodic task, and increment its total
run count.
djcelery.utils.make_aware(value)
djcelery.utils.make_naive(value)
djcelery.utils.now()
Change history
• 2.5.5
• 2.5.4
• 2.5.3
• 2.5.2
• 2.5.1
– Fixes
• 2.5.0
– Important Notes
– News
• 2.4.2
• 2.4.1
• 2.4.0
– Important Notes
– News
– Upgrading for south users
• 2.3.3
• 2.3.2
• 2.3.1
• 2.3.0
• 2.2.4
17
django-celery Documentation, Release 2.5.5
• 2.2.3
• 2.2.2
• 2.2.1
• 2.2.0
• 2.1.1
• 2.1.0
– Important Notes
– News
– Fixes
• 2.0.2
– Important notes
– News
• 2.0.0
6.1 2.5.5
6.2 2.5.4
6.3 2.5.3
6.4 2.5.2
by Ask Solem
• PeriodicTask admin now lists the enabled field in the list view
Contributed by Gabe Jackson.
• Fixed a compatibility issue with Django < 1.3
Fix contributed by Roman Barczyski
• Admin monitor now properly escapes args and kwargs.
Fix contributed by Serj Zavadsky
• PeriodicTask admin now gives error if no schedule set (or both set) (Issue #126).
• examples/demoproject has been updated to use the Django 1.4 template.
• Database connection is no longer closed for eager tasks (Issue #116).
Fix contributed by Mark Lavin.
• The first-steps document for django-celery has been moved to the main Celery documentation.
• djcelerymon command no longer worked properly, this has now been fixed (Issue #123).
6.5 2.5.1
6.5.1 Fixes
6.6 2.5.0
6.5. 2.5.1 19
django-celery Documentation, Release 2.5.5
If this is a new project that is also using South then you need to fake the migration:
$ python manage.y migrate djcelery –fake
Manual Migration
To manually add the new fields,
using PostgreSQL:
using MySQL:
using SQLite:
6.6.2 News
• Auto-discovered task modules now works with the new auto-reloader functionality.
• The database periodic task scheduler now tried to recover from operational database errors.
• The periodic task schedule entry now accepts both int and timedelta (Issue #100).
• ‘Connection already closed’ errors occurring while closing the database connection are now ignored (Issue #93).
• The djcelerymon command used to start a Django admin monitor instance outside of Django projects now
starts without a celery config module.
6.7 2.4.2
6.8 2.4.1
6.9 2.4.0
This release adds South migrations, which well assist users in automatically updating their database schemas with
each django-celery release.
6.9.2 News
6.7. 2.4.2 21
django-celery Documentation, Release 2.5.5
Migration 0001 is a snapshot from the previous stable release (2.3.3). For those who do not use
South, no action is required. South users will want to read the Upgrading for south users section
below.
Contributed by Greg Taylor.
• Test runner now compatible with Django 1.4.
Test runners are now classes instead of functions, so you have to change the TEST_RUNNER setting
to read:
TEST_RUNNER = "djcelery.contrib.test_runner.CeleryTestSuiteRunner"
For those that are already using django-celery 2.3.x, you’ll need to fake the newly added migration 0001, since your
database already has the current djcelery_* and celery_* tables:
If you’re upgrading from the 2.2.x series, you’ll want to drop/reset your celery_* and djcelery_* tables and
run the migration:
6.10 2.3.3
6.11 2.3.2
6.12 2.3.1
6.13 2.3.0
6.14 2.2.4
• celerybeat: DatabaseScheduler would not react to changes when using MySQL and the default transaction
isolation level REPEATABLE-READ (Issue #41).
It is still recommended that you use isolation level READ-COMMITTED (see the Celery FAQ).
6.15 2.2.3
6.16 2.2.2
6.17 2.2.1
6.18 2.2.0
6.13. 2.3.0 23
django-celery Documentation, Release 2.5.5
• celerycam: Django’s queryset.delete() fetches everything in memory THEN deletes, so we need to use raw SQL
to expire objects.
• djcelerymon: Added Command.stdout + Command.stderr (Issue #23).
• Need to close any open database connection after any embedded celerybeat process forks.
• Added contrib/requirements/py25.txt
• Demoproject now does djcelery.setup_loader in settings.py.
6.19 2.1.1
6.20 2.1.0
This release depends on Celery version 2.1.0. Be sure to read the Celery changelog before you upgrade: http://ask.
github.com/celery/changelog.html#version-2-1-0
6.20.2 News
• The periodic task schedule can now be stored in the database and edited via the Django Admin interface.
To use the new database schedule you need to start celerybeat with the following argument:
Note that you need to add your old periodic tasks to the database manually (using the Django admin
interface for example).
• New Celery monitor for the Django Admin interface.
To start monitoring your workers you have to start your workers in event mode:
This will take a snapshot of the events every 2 seconds and store it in the database.
6.20.3 Fixes
• database backend: Now shows warning if polling results with transaction isolation level repeatable-read on
MySQL.
See http://github.com/ask/django-celery/issues/issue/6
• database backend: get result does no longer store the default result to database.
See http://github.com/ask/django-celery/issues/issue/6
6.21 2.0.2
• Due to some applications loading the Django models lazily, it is recommended that you add the following lines
to your settings.py:
import djcelery
djcelery.setup_loader()
This will ensure the Django celery loader is set even though the
model modules haven't been imported yet.
6.21. 2.0.2 25
django-celery Documentation, Release 2.5.5
6.21.2 News
6.22 2.0.0
• genindex
• modindex
• search
27
django-celery Documentation, Release 2.5.5
d
djcelery.app, 13
djcelery.utils, 15
29
django-celery Documentation, Release 2.5.5
E
environment variable
DJCELERYMON_DEBUG, 19
L
last_run_at (PeriodicTaskMeta attribute), 14
M
make_aware() (in module djcelery.utils), 15
make_naive() (in module djcelery.utils), 15
N
name (PeriodicTaskMeta attribute), 14
now() (in module djcelery.utils), 15
P
PeriodicTaskMeta (built-in class), 14
R
result (TaskMeta attribute), 14
S
status (TaskMeta attribute), 14
T
task (PeriodicTaskMeta attribute), 14
task_id (TaskMeta attribute), 14
TASK_STATUS_DONE (built-in variable), 13
31