zoekt: build updates to enable multiple branch indexing
Created by: keegancsmith
This does not enable indexing of multiple branches. The main purpose of this change is to build zoekt-git-index. zoekt-git-index is used instead of zoekt-archive-index when we want to index multiple branches.
See individual commits, summaries included below with git log --pretty=format:'### %s%n%n%b%n'
Part of #6728
all: build and include zoekt-git-index
If you are indexing multiple branches this command is required. This adds the command to our dev and single docker image environments. The docker images for cluster already include the command (see zoekt repo).
zoekt: set cpu_fraction flag for indexserver
The default was 0.25, but was bumped to 1.0. This bump was done to align the flag defaults with how we run indexserver in cluster environments. We update our dev and single image environments to use the same value. Those environmemts don't have resource isolation so we need to continue using 0.25 rather than allowing indexing to use all cores.
gomod: update zoekt
Includes the following commits
- https://github.com/sourcegraph/zoekt/commit/9d90c1c gitindex: allocate buffer of correct size
- https://github.com/sourcegraph/zoekt/commit/aa0e667 zoekt: verbose flag prints shard metadata
- https://github.com/sourcegraph/zoekt/commit/ddddd93 gitindex: do not resolve HEAD ref
- https://github.com/sourcegraph/zoekt/commit/8c0aee7 build: handle nil Options in largeFilesFlag
- https://github.com/sourcegraph/zoekt/commit/36a801c indexserver: use temp directory on same mount as indexes
- https://github.com/sourcegraph/zoekt/commit/070c191 indexserver: align flag defaults with dockerfile
- https://github.com/sourcegraph/zoekt/commit/35dabc7 indexserver: optionally shallow clone and use zoekt-git-index
- https://github.com/sourcegraph/zoekt/commit/f89b8e3 indexserver: inline CmdArgs into archiveIndex
- https://github.com/sourcegraph/zoekt/commit/ef52f4b indexserver: consistently use a pointer to indexArgs
- https://github.com/sourcegraph/zoekt/commit/e407d68 indexserver: store root in indexArgs
- https://github.com/sourcegraph/zoekt/commit/70628e0 indexserver: factor out index logic
- https://github.com/sourcegraph/zoekt/commit/4961ee9 indexserver: add cli flags to debug indexing and listing
- https://github.com/sourcegraph/zoekt/commit/4abd60f indexserver: log success
- https://github.com/sourcegraph/zoekt/commit/605d890 indexserver: metrics track if we skipped indexing
- https://github.com/sourcegraph/zoekt/commit/1a62bb8 indexserver: rename metric vars to have metric prefix
- https://github.com/sourcegraph/zoekt/commit/a2233e1 indexserver: check incremental in process
- https://github.com/sourcegraph/zoekt/commit/ddccdf9 indexserver: use build.Options to generate flags
- https://github.com/sourcegraph/zoekt/commit/8463ade Do not ignore large files.