gitserver: Make batch-log concurrency configurable
Created by: efritz
This PR adds configurable concurrent limits around the git
command in the batch-log
endpoint. Super open to listening to other suggestion for default values.
Helps reduce impact of gitserver call in #32328 (closed).
New dashboard showing time spent waiting for global semaphore:
Test plan
Existing unit/integration tests.