[dotcom] Small changes to support killing of private code on dotcom

Created by: kopancek

Screenshot

resolves: #39266 (closed)

Another change, that was thrown into this PR: https://sourcegraph.slack.com/archives/C03D4H7UBEV/p1658872943783169?thread_ts=1658524781.528869&cid=C03D4H7UBEV

Test plan

Tested locally.

App preview:

• Web
• Storybook

Check out the client app preview documentation to learn more.