Skip to content

Add automated regression tests

Warren Gifford requested to merge bl/regression-test into master

Created by: beyang

This adds a regression test file regression.test.tsx that defines regression tests. This is separate from the index.e2e.test.tsx file, which defines e2e tests that run in CI. The reason that the two are separate is that we expect there to be a lot of regression tests and it would be prohibitively expensive to run them each time in CI and they might be flakier than our tolerance for the in-CI e2e tests.

Run it with GITHUB_TOKEN=$TOKEN yarn run test-regression in the web directory.

regression.test.tsx currently includes test for one of the search use cases, but will eventually grow to cover most of the Release test grid.

cc @lguychard because you made a suggestion to use Cucumber.io. This PR does not use Cucumber. It may be the right solution for us down the road, but first I wanted to implement the tests directly in JS to see if this adequately addresses our needs.

Merge request reports