ci: gnu parallel set --memfree 100M (!9136) · Merge requests · Administrator / sourcegraph

Administrator requested to merge fix-ci-lint into master Mar 19, 2020

Created by: ggilmore

See https://github.com/golangci/golangci-lint/issues/994

It seems like golang-ci lint uses a fair amount of memory. Running that in parallel with yarn steps might be causing memory issues / flakes. Downgrading golang-ci doens't seem to help.

I discovered a new flag for gnu parallel, --memfree $SIZE that prevents queuing new tasks if < $SIZE memory is free and will kill and restart tasks if < $SIZE/2 memory remains. Let's see if this fixes things.

see https://www.gnu.org/software/parallel/man.html

Believed to be the cause of flakes like https://buildkite.com/sourcegraph/sourcegraph/builds/58560#a827d10a-4c85-4822-bc1d-f3e3f9571792

ci: gnu parallel set --memfree 100M

Merge request reports