observability: add container monitoring in docker-compose / pure docker deployments
Created by: slimsag
This adds container monitoring for restarts (e.g. due to OOM), and for high CPU / memory usage. Warning alerts will fire when restarts occur, or CPU/memory usage is at 90%.
This only applies to Docker Compose / Pure Docker deployments for now. In 3.16 I will explore making these same cadvisor metrics available in Kubernetes deployments.
How it looks
On instances WITHOUT cadvisor (kubernetes, server, dev), it looks like this and the alerts will never fire:
On instances WITH cadvisor (docker-compose, pure docker), it looks like this and the alerts will fire (warning only for now):
Helps https://github.com/sourcegraph/sourcegraph/issues/9791 Helps https://github.com/sourcegraph/sourcegraph/issues/9793