Bug
_update_submission() in compute_worker/compute_worker.py performs a single HTTP PATCH to report submission status back to Django. On any non-200 response, it raises SubmissionException immediately with no retry:
resp = self.requests_session.patch(url, data=data, timeout=150)
if resp.status_code == 200:
logger.info("Submission updated successfully!")
else:
raise SubmissionException("Failure updating submission data.")
The caller _update_status() then catches all exceptions and silently discards them:
try:
self._update_submission(data)
except Exception as e:
# Always catch exception and never raise error
logger.exception(f"Failed to update submission status to {status}: {e}")
This means a single transient network error (502, timeout, connection reset) permanently loses the submission result. The compute worker moves on to the next job as if nothing happened, while Django never receives the status=Finished PATCH. The submission stays stuck in Scoring or Running forever.
How it happens
- Compute worker finishes scoring and sends
PATCH /api/submissions/{id}/ {status: Finished}
- The network returns a transient error (502, timeout, connection reset)
_update_submission() raises SubmissionException("Failure updating submission data.")
_update_status() catches the exception, logs it, and does not re-raise
- The compute worker proceeds to the next submission
- Django never receives the
Finished status → the submission stays stuck in Scoring indefinitely
- The participant sees a perpetually "processing" submission with no error message and no way to know it failed
Bug
_update_submission()incompute_worker/compute_worker.pyperforms a single HTTP PATCH to report submission status back to Django. On any non-200 response, it raisesSubmissionExceptionimmediately with no retry:The caller
_update_status()then catches all exceptions and silently discards them:This means a single transient network error (502, timeout, connection reset) permanently loses the submission result. The compute worker moves on to the next job as if nothing happened, while Django never receives the
status=FinishedPATCH. The submission stays stuck inScoringorRunningforever.How it happens
PATCH /api/submissions/{id}/ {status: Finished}_update_submission()raisesSubmissionException("Failure updating submission data.")_update_status()catches the exception, logs it, and does not re-raiseFinishedstatus → the submission stays stuck inScoringindefinitely