Skip to content

Using BLOCK_DIRECT=true with single_tailnet experiment results in no connectivity #10391

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
Tracked by #8507
ericpaulsen opened this issue Oct 23, 2023 · 0 comments
Closed
Tracked by #8507
Assignees
Labels
networking Area: networking s2 Broken use cases or features (with a workaround). Only humans may set this.

Comments

@ericpaulsen
Copy link
Member

ericpaulsen commented Oct 23, 2023

i'm creating this issue to track an issue experienced by a strategic customer that returned 504s on the /listening-ports API route with the single_tailnet experiment enabled and CODER_BLOCK_DIRECT=true. this happened upon upgrade from 2.2.x to 2.3.1. the agent and workspace displayed as healthy in the dashboard.

coderd logs returned:

2023-10-20 17:15:22.614 [warn] coderd: GET host=coder.<REDACTED DOMAIN> path=/api/v2/workspaceagents/0fcbe2cb-f591-49b2-89f5-df0bbea137e1/listening-ports proto=HTTP/1.1 remote_addr=<REDACTED IP  start="2023-10-20T17:14:22.610280152Z" took=1m0.004586037s status_code=500 latency_ms=60004
response_body="{\"message\":\"Internal error dialing workspace agent.\",\"detail\":\"agent is unreachable\"}\n" request_id=c83a5819-db40-429b-880d-624e834b53eb

removing the single_tailnet resolved things. here's their full env var to help debug:

env:
    - name: CODER_PG_CONNECTION_URL
      valueFrom:
        secretKeyRef:
          name: <REDACTED>
          key: url
    - name: CODER_ACCESS_URL
      value: "https://coder/.<REDACTED>"
    - name: CODER_WILDCARD_ACCESS_URL
      value: "*.[coder.<](http://coder.REDACTED)/REDACTED>"
    - name: CODER_OIDC_IGNORE_USERINFO
      value: "true"
    - name: CODER_OIDC_ISSUER_URL
      value: "https://login.microsoftonline.com/<REDACTED>"
    - name: CODER_OIDC_EMAIL_DOMAIN
      value: "[<](http://<REDACTED>.com/)REDACTED>"
    - name: CODER_OIDC_CLIENT_ID
      value: "<REDACTED>"
    - name: CODER_OIDC_CLIENT_SECRET
      valueFrom:
        secretKeyRef:
          name: <REDACTED>
          key: secret
    - name: CODER_OIDC_SCOPES
      value: "openid,email,profile"
    - name: CODER_OIDC_GROUP_MAPPING
      value: <REDACTED>
    - name: CODER_PROMETHEUS_ENABLE
      value: "true"
    - name: CODER_PROMETHEUS_COLLECT_AGENT_STATS
      value: "true"
    - name: CODER_PROMETHEUS_ADDRESS
      value: "0.0.0.0:2112"
    - name: CODER_BLOCK_DIRECT
      value: "true"
    # - name: CODER_VERBOSE
    #   value: "true"
    # - name: TF_LOG
    #   value: "DEBUG"
    - name: CODER_EXPERIMENTS
      value: "deployment_health_page"
@ericpaulsen ericpaulsen added bug networking Area: networking labels Oct 23, 2023
@sreya sreya changed the title 504s on web terminal and apps despite healthy agent, workspace Using BLOCK_DIRECT=true with single_tailnet experiment results in no connectivity Oct 30, 2023
@sreya sreya mentioned this issue Oct 30, 2023
5 tasks
@matifali matifali added the s2 Broken use cases or features (with a workaround). Only humans may set this. label Nov 3, 2023
spikecurtis added a commit that referenced this issue Dec 13, 2023
Adds a test case for #10391 with single tailnet out of experimental
@coadler coadler closed this as completed Feb 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
networking Area: networking s2 Broken use cases or features (with a workaround). Only humans may set this.
Projects
None yet
Development

No branches or pull requests

3 participants