Skip to content

Create load generator for Dynamic Parameters #912

@ethanndickson

Description

@ethanndickson

From the plan:

Goal:

  • To observe how Coder handles dynamic parameters being manipulated at scale.
User target coderd replicas Concurrent evaluations
1k 3 100
2k 3 200
3k 4 300
10k 10 1000

Implementation:

  • Re-evaluate template parameters via the API, no workspace builds.
  • Template with a 5 level dependency chain:
    • Provider → Region → Zone → Instance Type → Storage(?)
    • We only need a single template uploaded on coderd, as I don't believe there's any per-template caching.

Run sequence:

  1. Create users.
  2. Create a complex template.
  3. Establish baseline (<5 minutes)
  4. Have each user client manipulate the 'root' parameter via the API.
  5. Await responses on all requests.

Key Results:

  • API response times.
  • API errors (%).

Other Results:

  • Coder deployment + database resource utilization (incl. pprofs, Grafana Pyroscope).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions