diskcache: ignore files that go missing during filepath.Walk

Created by: keegancsmith

For example this can happen when diskcache renames a temporary file. We shouldn't bail out early, but rather lets work on best effort information.

Test Plan: this is tough to reproduce, so instead I am relying on tests to catch any possible regressions.

Part of https://github.com/sourcegraph/sourcegraph/issues/34828

Created by: efritz

Review: Approved

Created by: Strum355

Review: Approved

Should we consider using flock syscall on the top directory? Would probably help but I dont know if you want that contention

Merged by: keegancsmith at 2022-05-27 13:53:40 UTC