Skip to content
This repository was archived by the owner on Dec 17, 2024. It is now read-only.

Conversation

@kmoppel-cognite
Copy link
Collaborator

This PR is non-breaking and add basically a new "--prometheus-async-mode" flag that will enable Prom mode also be used with dozens of instances under monitoring instead of the usual one. When flag is enabled we basically run as normally with Postgres storage but with the difference that nothing is stored but latest metrics cached in memory so that they could immediately presented when a scrape request comes in. Otherwise one would soon start to get timeouts...

Also add some 5 most commonly used dashboards for Prometheus, basically clones of PG ones.

… collection

In async mode metrics are collected as with say Postgres storage, but only the last dataset is kept in memory for each DB+metric pair.
General goal of this feature is to support scraping dozens of DBs without timeouts which is impossible in current sync / serial mode.
So that they could be rolled out with the import_all.sh script
similar to PG implementation but with less fields
Copy link
Collaborator

@pashagolub pashagolub left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! 👍

When restarting Prom scraper pods for a short time there can be 2 pods
collecting same data with different labels that can mess up the graphs.
Also some other visual adjustments.
@kmoppel-cognite kmoppel-cognite merged commit 7ac2eac into cybertec-postgresql:master Sep 23, 2021
@kmoppel-cognite kmoppel-cognite deleted the prometheus-mode-optimization branch September 23, 2021 15:14
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants