codeintel: More intelligently page/paginate lsifstore diagnostic results

Created by: efritz

We read all diagnostics into memory and paginate on the application side. We should instead use the count used in https://github.com/sourcegraph/sourcegraph/issues/18248 to skip the documents we don't need to decode.