Skip to content

Conversation

MoralCode
Copy link
Contributor

Description
this adds some containers to the stack to enable better monitoring of the postgres DB

This is intended to be something similar to flower in that its mainly (for now) intended for development use.

Grafana in particular takes a hot sec to start up (probably about a minute) before its accessible via the web interface (it has db migrations to do apparrently - the logs for this should be hidden by the instruction to only show error logs)

Usage:

  1. start up the augur stack
  2. navigate to http://localhost:3000 in your browser
  3. login with the credentials admin/password
  4. navigate to http://localhost:3000/d/000000039/postgresql-database (or via the UI: Dashboards > services >PostgreSQL)

Observe: data

Screenshot_20250911_151351

The usecases for this is to generally provide more observability into what is going on with postgres. This may specifically help with debugging facade things, especially with respect to how many deadlock events are happening, how frequently postgres is checkpointing, how many idle processes/connections there are, etc.

I also hope that, in the future we can add some openTelemetry type reporting into augur so that augur itself can be monitored through a dashboard like this (maybe we can pipe Celery data into this?)

Signed commits

  • Yes, I signed my commits.

@MoralCode MoralCode requested a review from sgoggins as a code owner September 11, 2025 19:47
@MoralCode
Copy link
Contributor Author

Reviewers: if you want i can comment out the new config in the dockerfile to match the convention we use for flower

@MoralCode MoralCode marked this pull request as draft September 12, 2025 15:06
sgoggins
sgoggins previously approved these changes Sep 16, 2025
Copy link
Member

@sgoggins sgoggins left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Excellent!

@MoralCode
Copy link
Contributor Author

current status (as a draft): postgres monitoring seems to work (just do docker compose up in the monitoring directory once augur is running (it assumes you use the compose file in the root of the repo).

Flower also (apparrently) ships with a /metrics endpoint that prometheus can ingest so im working on getting that hooked up.

feel free to play with this if anyone is interested!

…orter

Signed-off-by: Adrian Edwards <adredwar@redhat.com>
@MoralCode
Copy link
Contributor Author

Seems to be working under both podman and docker environments

@MoralCode
Copy link
Contributor Author

MoralCode commented Sep 19, 2025

This also includes both postgres and celery monitoring dashboards.

To use this you need to add a .env file in the monitoring folder containing augur db credentials (AUGUR_DATABASE, AUGUR_HOST, AUGUR_DB_USER, AUGUR_DB_PASSWORD), then you can just do a regular <tool> compose up -d in the monitoring dir and it will start the monitoring stack.

this is intended to run independently of augur so you can take augur down and back up and the monitoring should keep going and simply reflect a gap in the data

@MoralCode MoralCode requested a review from sgoggins September 19, 2025 15:38
Signed-off-by: Adrian Edwards <adredwar@redhat.com>
Signed-off-by: Adrian Edwards <adredwar@redhat.com>
Signed-off-by: Adrian Edwards <adredwar@redhat.com>
Signed-off-by: Adrian Edwards <adredwar@redhat.com>
…n the host

Signed-off-by: Adrian Edwards <adredwar@redhat.com>
Signed-off-by: Adrian Edwards <adredwar@redhat.com>
Signed-off-by: Adrian Edwards <adredwar@redhat.com>
Signed-off-by: Adrian Edwards <adredwar@redhat.com>
Signed-off-by: Adrian Edwards <adredwar@redhat.com>
Signed-off-by: Adrian Edwards <adredwar@redhat.com>
Signed-off-by: Adrian Edwards <adredwar@redhat.com>
Signed-off-by: Adrian Edwards <adredwar@redhat.com>
Signed-off-by: Adrian Edwards <adredwar@redhat.com>
@MoralCode
Copy link
Contributor Author

@sgoggins i think my force pushing dismissed your review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants