Track Puppeteer coverage
Created by: felixfbecker
Track test coverage of e2e tests and record it under a separate e2e
flag. Especially with enforcing coverage thresholds, it's important that we track all actual test coverage (else codecov may reject a PR even though it's covered by integration tests). This currently only includes e2e, but this PR is also required for web integration tests because they will run in Puppeteer too, as well as Percy storybook tests #9565.
The different "kinds" of coverage can be toggled in the codecov UI. Example: https://codecov.io/gh/sourcegraph/sourcegraph/src/istanbul-e2e-coverage/web/src/nav/UserNavItem.tsx
New stats on this branch:
Category | Coverage |
---|---|
Total | |
E2E tests | |
Unit tests |
This works by creating a special instrumented image for e2e tests using babel-plugin-istanbul
. I moved building the actual release image back into the main pipeline. Since we're going to disable e2e tests this is needed anyway