Skip to content

C210K: Long-term Prometheus data storage #150

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
stirby opened this issue Oct 24, 2024 · 1 comment
Closed

C210K: Long-term Prometheus data storage #150

stirby opened this issue Oct 24, 2024 · 1 comment
Assignees
Labels
l estimated at 1 week of work project/observability

Comments

@stirby
Copy link

stirby commented Oct 24, 2024

Related: #146

The 10k user scale test should provide data for scaling formulae and performance enhancements for months after the test. We can use the in-product Prometheus metrics to collect performance data while the test(s) run.

This means we need a long-lived Prometheus instance for the duration of our scaletesting development and execution. This will scrape snapshots from the control plane during tests and stay alive in between them.

Instead of automated bucketing or any automation around scaling, we'll keep it simple and generously provision the disk on this instance.

This fortunately simulates real-world data collection load that an administrator may conduct in production.

@stirby stirby added this to the C210K: Phase 1 milestone Oct 24, 2024
@f0ssel f0ssel added the s estimated at 1-2 days of work label Oct 25, 2024
@f0ssel f0ssel self-assigned this Nov 4, 2024
f0ssel added a commit to coder/coder that referenced this issue Jan 23, 2025
Part of coder/internal#150

- Stop creating the VPC since we rely on an existing VPC in the
scaletest GCP project now
- Add prometheus remote writer to the new prometheus deployment
f0ssel added a commit to coder/coder that referenced this issue Jan 23, 2025
Part of coder/internal#150

- Adds postgres exporter that gets picked up by the prometheus remote
writer
@f0ssel f0ssel added l estimated at 1 week of work and removed s estimated at 1-2 days of work labels Jan 23, 2025
@f0ssel
Copy link

f0ssel commented Jan 30, 2025

Closed with the creation of https://github.com/coder/scaletest

@f0ssel f0ssel closed this as completed Jan 30, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
l estimated at 1 week of work project/observability
Projects
None yet
Development

No branches or pull requests

2 participants