Created by: rvantonder
Looks like the alert addition somehow breaks backend integration tests (wow?): https://buildkite.com/sourcegraph/sourcegraph/builds/153113#018144cb-c641-4005-b816-c100039fb466
Will reland stack after debugging.
Revert.