search frontend: annotate whether patterns are delimited
Created by: rvantonder
Stacked on https://github.com/sourcegraph/sourcegraph/pull/37898
We need to know whether a scanned pattern was delimited (e.g., with quotes or /.../) to know whether to highlight these specially. This exposes a delimited field on the pattern token to store the info.
Test plan
Semantics-preserving, updated tests.
App preview:
Check out the client app preview documentation to learn more.