qa: add sourcegraph/server upgrade test, candidate images in QA
Created by: bobheadxi
- Adds a new step in QA pipeline to attempt a Sourcegraph upgrade from defined previous version
- Change QA steps to run after candidate images publish, so that the candidate images themselves can be used in testing
- Change QA tests that use
insiders
images to use the appropriate candidate image for the commit being tested instead. - Unify test scripts (
init-server.go
,setup-*.sh
,cleanup-*.sh
) shared amongst the tests - Prevent secrets from being revealed on
source /root/.profile
- Move Code-Intel tests to QA
- Add labels with descriptions for all tests
Closes https://github.com/sourcegraph/sourcegraph/issues/13877
TODO
-
Make sure candidate images are always available for QA tests -
Credentials for pulling candidate images in QA vagrant -
Automation for updating MINIMUM_UPGRADEABLE_VERSION
on release (probably via a new config option in https://github.com/sourcegraph/sourcegraph/pull/15154, likeminimumSupportedVersion
? or just do some maths from the current release) => will open a follow-up issue, hardcoded for now