Code Insights: Unify Insights Tracking issue

Created by: chwarwick

Plan

Search-based Code Insights run either over an explicit list of repos or all repos. If the former, the data is generated by just-in-time searches. If the latter, the data is generated on a delay in the backend with results persisted in the database. These methods have different costs and benefits. We need to unify them to unblock developer velocity so we don’t have to build two versions of new features, and also to get the benefits of each across all insights while removing some of these costs.

Tracking issues for identified items in rfc 677

Live Preview for all search insights

• https://github.com/sourcegraph/sourcegraph/issues/35307
• https://github.com/sourcegraph/sourcegraph/issues/35366
• https://github.com/sourcegraph/sourcegraph/issues/35368

All search insights load equally fast after initial creation/backfill

• https://github.com/sourcegraph/sourcegraph/issues/30635
• https://github.com/sourcegraph/sourcegraph/issues/35397
• https://github.com/sourcegraph/sourcegraph/issues/35479
• https://github.com/sourcegraph/sourcegraph/issues/35469
• https://github.com/sourcegraph/sourcegraph/issues/35655
• https://github.com/sourcegraph/sourcegraph/issues/35580
• https://github.com/sourcegraph/sourcegraph/issues/35581
• https://github.com/sourcegraph/sourcegraph/issues/36097

All search insights share common features (filtering/sorting)

• https://github.com/sourcegraph/sourcegraph/issues/35306
• https://github.com/sourcegraph/sourcegraph/issues/35711
• https://github.com/sourcegraph/sourcegraph/issues/35816

All search insights can get additional data points and snapshots

• https://github.com/sourcegraph/sourcegraph/issues/30635
• https://github.com/sourcegraph/sourcegraph/issues/35397
• https://github.com/sourcegraph/sourcegraph/issues/35469
• https://github.com/sourcegraph/sourcegraph/issues/35655
• https://github.com/sourcegraph/sourcegraph/issues/35581
• https://github.com/sourcegraph/sourcegraph/issues/35580
• https://github.com/sourcegraph/sourcegraph/issues/36097
• https://github.com/sourcegraph/sourcegraph/issues/36094

Frontend Updates

• https://github.com/sourcegraph/sourcegraph/issues/35450
• https://github.com/sourcegraph/sourcegraph/issues/36094

Post Feature Flag Enabled

• https://github.com/sourcegraph/sourcegraph/issues/35817
• https://github.com/sourcegraph/sourcegraph/issues/35818
• https://github.com/sourcegraph/sourcegraph/issues/36498