monitoring: ensure critical alerts are a reliable signal of Sourcegraph instance health

Created by: bobheadxi

As a follow-up to https://github.com/sourcegraph/sourcegraph/pull/36423 , we should audit existing critical alerts that for their signal-to-noise ratio and the completeness of the PossibleSolutions (or next steps docs).