Tracking issue: improve worker observability
Created by: Strum355
Goal
Make the worker service provide more useful information that customers can provide us with to debug issues without having to engage in a sync call. High-level problems to be addressed include:
- Difficulties in filtering and grouping logs, their sources and responsible teams
- Complex to navigate and cluttered dashboard
- Lack of documentation/playbooks for diagnosing issues besides a reference to the Grafana dashboard
- ???