Automation Tracking Issue 3.12

Created by: mrnugget

Goals

Allow customers to gradually roll out campaigns by implementing draft mode.

Availability

Start of iteration is December 16th. Branch cut will be on January 15th.

• @mrnugget available December 16th to 20th (5d) and January 6th to 15th (8d)
• @eseliger available until Dec 23, and from presumably 8th to 15th (6d)

Features

• Add createCampaignPlanFromPatches mutation to allow creation of campaigns with user-generated diffs https://github.com/sourcegraph/sourcegraph/pull/7250 (see this Slack thread) @sqs 0.5d
• Allow creating campaigns as drafts https://github.com/sourcegraph/sourcegraph/issues/7217 (See: RFC36: Drafts & previewing campaign creation and updates) @mrnugget 5d @eseliger 3d
• UI for closing a campaign and showing that a campaign is closed @eseliger 0,5d
• UI for closing a campaigns changesets when closing/deleting the campaign @eseliger 0,5d
• Upsert ChangesetEvents from Bitbucket Server webhooks https://github.com/sourcegraph/sourcegraph/issues/6726 @kzh 3d
• Gracefully handle changeset deletion in code hosts #6396 (closed) @mrnugget 1d
• Cancel the previous preview using switchMap @eseliger 2h
• Split CampaignDetails component into more manageable components @eseliger 0,5d
• Hide burndown chart if data is empty @eseliger 0,5d
• UI polish #7329 (closed) @eseliger

Stretch Goals

Extracted from a8n: Status of Automation RFCs and here for priotization for next iteration and as possible stretch goals for 3.12:

• 🏃When updating a campaign (i.e. changing the plan so that a new diff will be computed), users can see a preview of the delta for existing changesets and new changesets. RFC 95
• Show commit statuses (CI) status of all changesets in the campaign #7093 (closed) (RFC 20 - Leftover), a8n feedback and for https://app.hubspot.com/contacts/2762526/company/608245740
• An overall campaign list shows all active campaigns (globally, and for a specific namespace) and some indication of their progress #7553 (closed) (RFC 20 - Leftover)
• Show the set of participant users involved in the campaign #7552 (closed) (RFC 20 - Leftover)
• Show labels of all changesets in campaign #7549 (closed)(RFC 20 - Leftover)
• Allow users to specify branch name before Campaign creation and provide great default value https://github.com/sourcegraph/sourcegraph/issues/7646

Backlog

@christinaforney wrote on Slack: "The backlog items are things I don't think we should tackle before stacking diffs and additional edge smoothing. In testing this morning I have already found a few small UI bugs."

• Show comments of all changesets in campaign #7548 (closed) (RFC 20 - Leftover)
• Querying/filtering by all of those criteria (including open/merged/close & review status) #7550 (closed) (RFC 20 - Leftover)
• Show combined event timeline from all threads, with PR/issue comments #7551 (closed) (RFC 20 - Leftover)
• Integrate permission model into Automation #7559 (closed) (RFC 36 - Idea)
• Updating Ruby gem dependency #7557 (closed) (RFC 36 - Idea)
• Upgrading Guava in a Gradle project and rewriting call sites using Comby syntax #7558 (closed) (RFC 36 - Idea)
• Support all other token types #7561 (closed) (RFC 73 - Stretch goal)
• Support deleting and gitignoring .npmrc files as an option instead of always just removing the portion that is a token. #7562 (closed) (RFC 73 - Stretch goal)
• A way to automatically revoke tokens that are found (similar to GitHub's token scanning for public repositories). #7563 (closed) (RFC 73 - Stretch goal)
• A way to include additional information about the token in the changeset description, such as when the token was created, who created it, what its scope is, where it is used, etc. This information would be helpful to assess the severity of the leak. #7564 (closed) (RFC 73 - Stretch goal)
• A way to periodically (in the background) run this, so that it doesn't only re-scan all repositories when a user interactively visits and updates the campaign in their web browser. #7565 (closed) (RFC 73 - Stretch goal)
• A way to detect tokens proactively (e.g., pre-push). #7566 (closed) (RFC 73 - Stretch goal)