Skip to content

API docs: codeintel: begin indexing API docs for search

Administrator requested to merge sg/apidocs-search-indexing into main

Created by: slimsag

This brings back #25206 - which was reverted in #25315 due to an issue with querying from the wrong DB (missed in dev, since codeintel and main app DBs are the same in dev this was an easy mistake to make despite me consciously trying to avoid it.)

First commit brings back the change in original state; next commits fix the actual underlying issue:

Instead of relying on the lsif_dumps table, which is in the main app DB, to locate the dumps we should delete (i.e. all rows which came from a dump for the same upload root and LSIF indexer/language), we instead introduce a dump_root column which duplicates this info on the lsif_data_documentation_search_* tables.

This is duplicative/repetitive data across rows, similar to other rows in this table. This is not optimal, but the size of the table is constrained, the duplicated data is very small, and I will improve this later once queries against these tables have solidified a bit.

Merge request reports

Loading