insights: update backend dev docs

Created by: leonore

closes #38478 (closed) (removes a lot of outdated stuff)

open https://github.com/sourcegraph/sourcegraph/issues/39674 for architecture diagram, which is a bit more involved than just a docs change.

Test plan

sg run docsite and check everything looks fine