Usman Khalid
95a112a3dd
instructor_task: Distribute extra items among subtasks of last query.
...
When creating an instructor task total_num_items may change between the
time it and the number of subtasks is calculated and the time the
subtasks are actually queued (all of this cannot happen in one transaction).
In such a case the extra items are distributed among the subtasks of the
last query.
LMS-2090
2014-02-04 23:30:02 +05:00
Brian Wilson
7bef11a7f1
Add retries when encountering DatabaseError when updating InstructorTask.
2013-11-05 11:18:08 -05:00
Brian Wilson
782a07e0ea
Add datadog stats for duplicate subtask and subtask update errors.
2013-10-30 17:09:40 -04:00
Brian Wilson
5b48ed840b
Refactor subtask creation logic to be less email-specific.
2013-10-28 12:58:11 -04:00
Brian Wilson
0f8f82c845
Define and use SubtaskStatus class.
2013-10-28 12:57:41 -04:00
Brian Wilson
ed4b954a53
Remove the use of celery.group from bulk email subtasks.
2013-10-28 12:47:11 -04:00
Brian Wilson
16b85c0c2a
Check for requeued subtasks when in RETRY state.
2013-10-22 18:17:00 -04:00
Brian Wilson
ecb58e863f
Add cache-based locking to subtasks to ensure that the same task is not running in two workers at the same time.
2013-10-22 14:32:52 -04:00
Brian Wilson
a699674015
Check that a subtask has not already completed before running.
2013-10-17 13:32:44 -04:00
Brian Wilson
b8239068cb
Check that email subtasks are known to the InstructorTask before executing.
2013-10-16 13:02:41 -04:00
Brian Wilson
bc599a0662
Update tests with more complete coverage.
2013-10-16 13:02:40 -04:00
Brian Wilson
e75dd4654b
Move subtask update logic that was only needed for tests into the tests that needed it.
2013-10-16 13:02:40 -04:00
Brian Wilson
04f90fee41
Fix subtask code to handle (tests) running in eager mode.
2013-10-16 13:01:59 -04:00
Brian Wilson
a4c35ac4ff
Use separate retry count for calculating retry delay.
2013-10-16 13:01:59 -04:00
Brian Wilson
7b7afd472d
Incorporate changes in max_retry logic, adding subtask_status as bulk_email arg.
2013-10-16 13:01:59 -04:00
Brian Wilson
08a08448ee
Add some handling for SES exceptions.
2013-10-16 13:01:59 -04:00
Brian Wilson
0fd75181e3
Update handling of bulk-email retries to update InstructorTask before each retry.
2013-10-16 13:01:58 -04:00
Brian Wilson
5c29530db9
Factor out subtask-specific code into subtasks.py.
2013-10-16 13:01:58 -04:00
