Skip to content

codeintel: Send tar files via SendDB

Administrator requested to merge tar-bundle-payloads into master

Created by: efritz

This PR allows us more flexibility on our choice of storage engine in the future by allowing a database payload to span multiple files (leveldb, badger) instead of being restricted to a single file (sqlite). See https://github.com/sourcegraph/sourcegraph/pull/11079 for the change in bundle manager to allow multiple files by the janitor process.

Relevant code changes:

  • Addition of internal/tar package (extract was taken from the precise-code-intel-indexer)
  • Modification of the bundle manager client to call Archive on the SendDB parameter
  • Modification of bundle-manager handler to extract tar once db transfer is complete
  • Modification of worker to pass a containing directory instead of a filename to SendDB

Merge request reports