Skip to content

tweak instructions for accessing inference service on kind cluster #56

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Apr 24, 2025

Conversation

elevran
Copy link
Collaborator

@elevran elevran commented Apr 24, 2025

provide instructions for accessing the inference service

Signed-off-by: Etai Lev Ran <elevran@gmail.com>
@shaneutt shaneutt merged commit 071f8cc into neuralmagic:dev Apr 24, 2025
1 of 2 checks passed

**Port forward**:
```sh
$ kubectl --context kind-gie-dev port-forward service/inference-gateway 8080:80
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

using this option, whenever I send a query to localhost:80, the port-forward command breaks and I get this:

kubectl --context kind-gie-dev port-forward pod/inference-gateway-6684967464-kl4n2 808
0:8080
Forwarding from 127.0.0.1:8080 -> 8080
Forwarding from [::1]:8080 -> 8080
Handling connection for 8080
E0424 13:25:05.107789   34543 portforward.go:424] "Unhandled Error" err="an error occurred forwarding 8080 -> 8080: error forwarding port 8080 to pod bf8bce30617155f1a8059b8a04e5bb5532f0e1297108018ec4c467975a94521a, uid : failed to execute portforward in network namespace \"/var/run/netns/cni-3d11808e-4c1e-1e4b-2b06-d9c97bcbb5b1\": failed to connect to localhost:8080 inside namespace \"bf8bce30617155f1a8059b8a04e5bb5532f0e1297108018ec4c467975a94521a\", IPv4: dial tcp4 127.0.0.1:8080: connect: connection refused IPv6 dial tcp6 [::1]:8080: connect: connection refused "
error: lost connection to pod

any clue?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just checking: does the service port-forward work?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants