Skip to content

Coder pods running out of memory #14881

@mambon2

Description

@mambon2

We've noticed over the past several months the coder pods gradually run out of memory over time. Typically around 30 day mark but can't really say for sure. Here is our memory allocation for a 5 replica set in k8s.

    resources:
      limits:
        cpu: 4000m
        memory: 8Gi
      requests:
        cpu: 4000m
        memory: 8Gi

and here is a datadog screenshot of the memory usage around 30 day mark

Screenshot 2024-09-23 at 7 15 33 PM

Coder V2.13.4
We don't keep the k8s logs so not able to share those.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bug riskProne to bugsobservabilityIssues related to observability (metrics, dashboards, alerts, opentelemetry)s2Broken use cases or features (with a workaround). Only humans may set this.

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions