a8n: Persistent queues and workers for CampaignJob (!7614) · Merge requests · Warren Gifford / sourcegraph

Warren Gifford requested to merge a8n-persistent-queues into master Jan 09, 2020

Created by: ryanslade

When campaign jobs are created they are no longer run during the request phase. They are created and a background process monitors for pending jobs. This allows other frontend instances to pick up jobs and also protects us against frontend crashes.

It is implemented using row level locking and polling Postgres for pending jobs.

Part of https://github.com/sourcegraph/sourcegraph/issues/6723

a8n: Persistent queues and workers for CampaignJob

Merge request reports