forked from kubernetes-sigs/gateway-api-inference-extension
-
Notifications
You must be signed in to change notification settings - Fork 7
Rebased latest K8S Main into dev #61
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
…-sigs#731) Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
…netes-sigs#729) * Move filters and scorers registration to filter/scorer specific files * Default scheduler config contains empty list of scorers Signed-off-by: Maya Barnea <mayab@il.ibm.com> * Default plugin is not a scorer any more Signed-off-by: Maya Barnea <mayab@il.ibm.com> * fix scheduler test + lint comments Signed-off-by: Maya Barnea <mayab@il.ibm.com> --------- Signed-off-by: Maya Barnea <mayab@il.ibm.com>
* Update issue templates * Updates artifacts for v0.3.0-rc.1 release Signed-off-by: Kellen Swain <kfswain@google.com> * Updates bbr chart for v0.3.0-rc.1 release Signed-off-by: Kellen Swain <kfswain@google.com> * Updates artifacts for v0.3.0 release Signed-off-by: Kellen Swain <kfswain@google.com> * Adding blank issue template so that all issues start with label --------- Signed-off-by: Kellen Swain <kfswain@google.com>
Signed-off-by: Shane Utt <shaneutt@linux.com>
* Add unit test coverage for pod APIs under datastore/pkg * Add unit test coverage for pod APIs under datastore/pkg * Add unit test coverage for pod APIs under datastore/pkg * Add unit test coverage for pod APIs under datastore/pkg * EPP Architecture proposal (kubernetes-sigs#683) * initial changes * Adding to proposal to give a quick barebones definition to refactor * feedback changes * more feedback addressing * removed unused Fake struct (kubernetes-sigs#723) Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * epp: return correct response for trailers (kubernetes-sigs#726) This looks like a copy paste error. * Refactor scheduler to run plugins (kubernetes-sigs#677) * Refactor scheduler to run plugins * Add scheduler plugin latency metric * Address comments * Address comments * Complete the InferencePool documentation (kubernetes-sigs#673) * Initial guide for inference pool * Add extensionReference to the InferencePool spec * Fix list formatting * Remove unused labels * Autogenerate the spec * Update site-src/api-types/inferencepool.md Co-authored-by: Rob Scott <rob.scott87@gmail.com> * Update site-src/api-types/inferencepool.md Co-authored-by: Rob Scott <rob.scott87@gmail.com> * Update site-src/api-types/inferencepool.md Co-authored-by: Rob Scott <rob.scott87@gmail.com> * Update site-src/api-types/inferencepool.md Co-authored-by: Rob Scott <rob.scott87@gmail.com> * Update site-src/api-types/inferencepool.md Co-authored-by: Rob Scott <rob.scott87@gmail.com> * Update site-src/api-types/inferencepool.md Co-authored-by: Rob Scott <rob.scott87@gmail.com> * Rename llm-pool names in rollout example * Add use cases for replacing an inference pool * Rewording the background section * Create replacing-inference-pool.md * Replace instructions with a link for how to replace an inference pool * Update replacing-inference-pool.md * Update mkdocs.yml * Update replacing-inference-pool.md * Update inferencemodel_types.go * Update inferencepool.md * Update site-src/guides/replacing-inference-pool.md Co-authored-by: Rob Scott <rob.scott87@gmail.com> --------- Co-authored-by: Rob Scott <rob.scott87@gmail.com> * reduce log level in metrics logger not to trash the log (kubernetes-sigs#708) * reduce log level in metrics logger not to trash the log Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * rename flush metrics to refresh metrics Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * revert log level Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> --------- Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * few updates in datastore (kubernetes-sigs#713) * few updates in datastore Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * PoolSet documentation Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * error phrasing Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * removed unused pool arg from PodUpdateOrAddIfNotExist Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * linter Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> --------- Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * scheduler refactoring (kubernetes-sigs#730) Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * filter irrelevant pod in pod_reconciler (kubernetes-sigs#696) * EPP: Update GetRandomPod() to return nil if no pods exist (kubernetes-sigs#731) Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io> * Move filter and scorer plugins registration to a separate file (kubernetes-sigs#729) * Move filters and scorers registration to filter/scorer specific files * Default scheduler config contains empty list of scorers Signed-off-by: Maya Barnea <mayab@il.ibm.com> * Default plugin is not a scorer any more Signed-off-by: Maya Barnea <mayab@il.ibm.com> * fix scheduler test + lint comments Signed-off-by: Maya Barnea <mayab@il.ibm.com> --------- Signed-off-by: Maya Barnea <mayab@il.ibm.com> * Update issue templates (kubernetes-sigs#738) * Update issue templates * Updates artifacts for v0.3.0-rc.1 release Signed-off-by: Kellen Swain <kfswain@google.com> * Updates bbr chart for v0.3.0-rc.1 release Signed-off-by: Kellen Swain <kfswain@google.com> * Updates artifacts for v0.3.0 release Signed-off-by: Kellen Swain <kfswain@google.com> * Adding blank issue template so that all issues start with label --------- Signed-off-by: Kellen Swain <kfswain@google.com> * Add unit test coverage for pod APIs under datastore/pkg * few updates in datastore (kubernetes-sigs#713) * few updates in datastore Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * PoolSet documentation Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * error phrasing Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * removed unused pool arg from PodUpdateOrAddIfNotExist Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * linter Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> --------- Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * few updates in datastore (kubernetes-sigs#713) * few updates in datastore Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * PoolSet documentation Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * error phrasing Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * removed unused pool arg from PodUpdateOrAddIfNotExist Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * linter Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> --------- Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> * Add unit test coverage for pod APIs under datastore/pkg --------- Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com> Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io> Signed-off-by: Maya Barnea <mayab@il.ibm.com> Signed-off-by: Kellen Swain <kfswain@google.com> Co-authored-by: Kellen Swain <kfswain@google.com> Co-authored-by: Nir Rozenbaum <nirro@il.ibm.com> Co-authored-by: John Howard <john.howard@solo.io> Co-authored-by: Cong Liu <conliu@google.com> Co-authored-by: Nicole Xin <nxin@google.com> Co-authored-by: Rob Scott <rob.scott87@gmail.com> Co-authored-by: nayihz <smartczy@outlook.com> Co-authored-by: Daneyon Hansen <daneyon.hansen@solo.io> Co-authored-by: Maya Barnea <mayab@il.ibm.com>
* main: fixing errors in new template & disabling the default blank template (kubernetes-sigs#742) Updating proposal directories to match their PR number (kubernetes-sigs#741) added a target dedicated for running unit-test only (kubernetes-sigs#739) Add unit tests for pod APIs under pkg/datastore (kubernetes-sigs#712) docs: add concepts and definitions to README.md (kubernetes-sigs#734) Update issue templates (kubernetes-sigs#738) Move filter and scorer plugins registration to a separate file (kubernetes-sigs#729) EPP: Update GetRandomPod() to return nil if no pods exist (kubernetes-sigs#731) filter irrelevant pod in pod_reconciler (kubernetes-sigs#696) scheduler refactoring (kubernetes-sigs#730) # Conflicts: # pkg/epp/scheduling/plugins/picker.go # pkg/epp/scheduling/plugins/picker/random_picker.go # pkg/epp/scheduling/plugins/pickers/random.go # pkg/epp/scheduling/scheduler.go # pkg/epp/scheduling/scheduler_test.go
Approved by Maroun (via Slack) |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.