Brief #07 · DevOps & SRE

Monitoring Stack: Prometheus + Grafana

Easy⏱ 8-12 hSoon

Metrics, logs and alerts for two small services, so you know something broke before a user tells you.

Outlines are free · building with tracking needs Pro

MThe briefFrom the team

We have an orders service and a payments service. When something goes wrong we SSH in and grep logs, usually after a customer complains on Facebook. Give us dashboards that show health at a glance and alerts that wake the right person.

What you'll build

  1. 1Two small services (any language) that expose /metrics with request count, errors and latency.
  2. 2Prometheus, Grafana and Loki in Docker Compose, scraping and collecting both.
  3. 3A dashboard with the four golden signals: traffic, errors, latency, saturation.
  4. 4Structured JSON logs with a request ID that appears in both services.
  5. 5Two alerts: error rate above 5% for 5 minutes, and p95 latency above 1 second.

Step-by-step walkthrough

Walkthrough coming soon

This project's step-by-step walkthrough, with real outputs at every step, is still being written. You can read the brief and try it on your own meanwhile; tracking opens when the walkthrough is ready.

Done when

  • docker compose up brings up everything, dashboards included.
  • Breaking a service on purpose fires the right alert within 5 minutes.
  • From a single request ID you can find its logs in both services.
  • A screenshot of each dashboard in the README.

Stretch goals

  • Add distributed tracing with OpenTelemetry.
  • Define an SLO and an error-budget panel.

Show it off