batches: prototype server side execution "CI runner" approach

Created by: LawnGnome

Timebox to 2 days: let's ensure we're not missing something super obvious in this plan.