dev/ci: go back to only setting goproxy on non-baremetal agents
Created by: bobheadxi
Looks like direct
isn't working out consistently, so back to only setting these on non-baremetal agents
Test plan
This is a revert back to a previously working state