3.18 Failing regression tests
Created by: daxmc99
We currently have some release-blocking issues found during regression testing.
The suites that are not passing are and we require assistance with are:
-
Onboarding
-
External Services (needs the most work)
Steps to reproduce:
-
Setup a regression testing environment: README Please ping me with any difficulties in setting up these tests.
-
SLOWMO=10 KEEP_BROWSER=true yarn run test:regression:onboarding
-
SLOWMO=10 KEEP_BROWSER=true yarn run test:regression:external-services
Expected behavior:
These tests pass and we can release 3.18.0
Actual behavior:
The onboarding tests has some strange behavior with being unable to select a .e2e-query-input
selector. I was unable to find this selector in Chrome but it was present in Firefox.
Could the @sourcegraph/web team take a look at this?
For the external-services test, we are tracking down expired tokens as a likely culprit and would appreciate help updating 1password of tokens. cc @unknwon @beyang
Please see the PR https://github.com/sourcegraph/sourcegraph/pull/12228 here for the current steps we are taking to fix the other regression tests.