Skip to content

Fixes Kgateway in Quickstart Guide #616

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Apr 1, 2025

Conversation

danehans
Copy link
Contributor

@danehans danehans commented Mar 31, 2025

  • Previously the Kgateway-specific steps referred to $VERSION which defines the Inference Extension version and not the Kgateway version.
  • Due to InferencePool BackendRef Requires Port Definition kgateway-dev/kgateway#10987, Kgateway requires port to be defined for an InferencePool backendRef.
  • Removes Envoy Gateway reference in the Prerequisites section.
  • Updates Kgateway to use the v2.0.0-rc.1 release tag since v2.0.0 has not been released yet.

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
@k8s-ci-robot k8s-ci-robot added the cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. label Mar 31, 2025
@k8s-ci-robot k8s-ci-robot requested a review from ahg-g March 31, 2025 03:45
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: danehans

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot requested a review from robscott March 31, 2025 03:45
@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Mar 31, 2025
Copy link

netlify bot commented Mar 31, 2025

Deploy Preview for gateway-api-inference-extension ready!

Name Link
🔨 Latest commit b8cd126
🔍 Latest deploy log https://app.netlify.com/sites/gateway-api-inference-extension/deploys/67eb21b56dc82f0008365059
😎 Deploy Preview https://deploy-preview-616--gateway-api-inference-extension.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@k8s-ci-robot k8s-ci-robot added the size/S Denotes a PR that changes 10-29 lines, ignoring generated files. label Mar 31, 2025
@ahg-g
Copy link
Contributor

ahg-g commented Mar 31, 2025

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Mar 31, 2025
@danehans
Copy link
Contributor Author

@robscott @LiorLieberman can you confirm that specifying port in an InferencePool backendRef is not an issue for your respective implementations?

@ahg-g
Copy link
Contributor

ahg-g commented Mar 31, 2025

/hold

@k8s-ci-robot k8s-ci-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Mar 31, 2025
@LiorLieberman
Copy link
Member

@robscott @LiorLieberman can you confirm that specifying port in an InferencePool backendRef is not an issue for your respective implementations?

for istio it wont matter - will be best to figure out a way to communicate its doesnt impact anything

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
@k8s-ci-robot k8s-ci-robot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. and removed lgtm "Looks good to me", indicates that a PR is ready to be merged. size/S Denotes a PR that changes 10-29 lines, ignoring generated files. labels Mar 31, 2025
@@ -114,7 +133,7 @@ This quickstart guide is intended for engineers familiar with k8s and model serv

- Gateway API [CRDs](https://gateway-api.sigs.k8s.io/guides/#installing-gateway-api) installed.

1. Install Istio
2. Install Istio
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

using 1. is better since it should automatically increment I believe

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
@ahg-g
Copy link
Contributor

ahg-g commented Apr 1, 2025

/lgtm
/hold cancel

@k8s-ci-robot k8s-ci-robot added lgtm "Looks good to me", indicates that a PR is ready to be merged. and removed do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. labels Apr 1, 2025
@k8s-ci-robot k8s-ci-robot merged commit 39c1ff5 into kubernetes-sigs:main Apr 1, 2025
8 checks passed
kfswain pushed a commit to kfswain/llm-instance-gateway that referenced this pull request Apr 29, 2025
* Fixes Kgateway in Quickstart Guide

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>

* Moves HTTPRoutes to implementations

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>

* Bumps kgtw to rc.2

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>

---------

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
kfswain pushed a commit to kfswain/llm-instance-gateway that referenced this pull request Apr 29, 2025
* Fixes Kgateway in Quickstart Guide

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>

* Moves HTTPRoutes to implementations

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>

* Bumps kgtw to rc.2

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>

---------

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
kfswain pushed a commit to kfswain/llm-instance-gateway that referenced this pull request Apr 29, 2025
* Fixes Kgateway in Quickstart Guide

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>

* Moves HTTPRoutes to implementations

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>

* Bumps kgtw to rc.2

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>

---------

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants