search: Addressing search reference improvements after hallway testing
Created by: fkling
This PR covers most of the issues listed in #22801 (closed), except metrics collections which I would do in a separate PR.
https://user-images.githubusercontent.com/179026/125958795-dd63d6ec-0637-4fd9-bb1a-01b8d361dfb6.mp4