Skip to content

Rebased latest K8S Main into dev #61

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 14 commits into from
Apr 27, 2025
Merged

Rebased latest K8S Main into dev #61

merged 14 commits into from
Apr 27, 2025

Conversation

shmuelk
Copy link
Collaborator

@shmuelk shmuelk commented Apr 27, 2025

No description provided.

nirrozenbaum and others added 14 commits April 23, 2025 10:15
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
…-sigs#731)

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
…netes-sigs#729)

* Move filters and scorers registration to filter/scorer specific files

* Default scheduler config contains empty list of scorers

Signed-off-by: Maya Barnea <mayab@il.ibm.com>

* Default plugin is not a scorer any more

Signed-off-by: Maya Barnea <mayab@il.ibm.com>

* fix scheduler test + lint comments

Signed-off-by: Maya Barnea <mayab@il.ibm.com>

---------

Signed-off-by: Maya Barnea <mayab@il.ibm.com>
* Update issue templates

* Updates artifacts for v0.3.0-rc.1 release

Signed-off-by: Kellen Swain <kfswain@google.com>

* Updates bbr chart for v0.3.0-rc.1 release

Signed-off-by: Kellen Swain <kfswain@google.com>

* Updates artifacts for v0.3.0 release

Signed-off-by: Kellen Swain <kfswain@google.com>

* Adding blank issue template so that all issues start with  label

---------

Signed-off-by: Kellen Swain <kfswain@google.com>
Signed-off-by: Shane Utt <shaneutt@linux.com>
* Add unit test coverage for pod APIs under datastore/pkg

* Add unit test coverage for pod APIs under datastore/pkg

* Add unit test coverage for pod APIs under datastore/pkg

* Add unit test coverage for pod APIs under datastore/pkg

* EPP Architecture proposal (kubernetes-sigs#683)

* initial changes

* Adding to proposal to give a quick barebones definition to refactor

* feedback changes

* more feedback addressing

* removed unused Fake struct (kubernetes-sigs#723)

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* epp: return correct response for trailers (kubernetes-sigs#726)

This looks like a copy paste error.

* Refactor scheduler to run plugins (kubernetes-sigs#677)

* Refactor scheduler to run plugins

* Add scheduler plugin latency metric

* Address comments

* Address comments

* Complete the InferencePool documentation (kubernetes-sigs#673)

* Initial guide for inference pool

* Add extensionReference to the InferencePool spec

* Fix list formatting

* Remove unused labels

* Autogenerate the spec

* Update site-src/api-types/inferencepool.md

Co-authored-by: Rob Scott <rob.scott87@gmail.com>

* Update site-src/api-types/inferencepool.md

Co-authored-by: Rob Scott <rob.scott87@gmail.com>

* Update site-src/api-types/inferencepool.md

Co-authored-by: Rob Scott <rob.scott87@gmail.com>

* Update site-src/api-types/inferencepool.md

Co-authored-by: Rob Scott <rob.scott87@gmail.com>

* Update site-src/api-types/inferencepool.md

Co-authored-by: Rob Scott <rob.scott87@gmail.com>

* Update site-src/api-types/inferencepool.md

Co-authored-by: Rob Scott <rob.scott87@gmail.com>

* Rename llm-pool names in rollout example

* Add use cases for replacing an inference pool

* Rewording the background section

* Create replacing-inference-pool.md

* Replace instructions with a link for how to replace an inference pool

* Update replacing-inference-pool.md

* Update mkdocs.yml

* Update replacing-inference-pool.md

* Update inferencemodel_types.go

* Update inferencepool.md

* Update site-src/guides/replacing-inference-pool.md

Co-authored-by: Rob Scott <rob.scott87@gmail.com>

---------

Co-authored-by: Rob Scott <rob.scott87@gmail.com>

* reduce log level in metrics logger not to trash the log (kubernetes-sigs#708)

* reduce log level in metrics logger not to trash the log

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* rename flush metrics to refresh metrics

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* revert log level

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* few updates in datastore (kubernetes-sigs#713)

* few updates in datastore

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* PoolSet documentation

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* error phrasing

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* removed unused pool arg from PodUpdateOrAddIfNotExist

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* linter

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* scheduler refactoring (kubernetes-sigs#730)

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* filter irrelevant pod in pod_reconciler (kubernetes-sigs#696)

* EPP: Update GetRandomPod() to return nil if no pods exist (kubernetes-sigs#731)

Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>

* Move filter and scorer plugins registration to a separate file (kubernetes-sigs#729)

* Move filters and scorers registration to filter/scorer specific files

* Default scheduler config contains empty list of scorers

Signed-off-by: Maya Barnea <mayab@il.ibm.com>

* Default plugin is not a scorer any more

Signed-off-by: Maya Barnea <mayab@il.ibm.com>

* fix scheduler test + lint comments

Signed-off-by: Maya Barnea <mayab@il.ibm.com>

---------

Signed-off-by: Maya Barnea <mayab@il.ibm.com>

* Update issue templates (kubernetes-sigs#738)

* Update issue templates

* Updates artifacts for v0.3.0-rc.1 release

Signed-off-by: Kellen Swain <kfswain@google.com>

* Updates bbr chart for v0.3.0-rc.1 release

Signed-off-by: Kellen Swain <kfswain@google.com>

* Updates artifacts for v0.3.0 release

Signed-off-by: Kellen Swain <kfswain@google.com>

* Adding blank issue template so that all issues start with  label

---------

Signed-off-by: Kellen Swain <kfswain@google.com>

* Add unit test coverage for pod APIs under datastore/pkg

* few updates in datastore (kubernetes-sigs#713)

* few updates in datastore

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* PoolSet documentation

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* error phrasing

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* removed unused pool arg from PodUpdateOrAddIfNotExist

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* linter

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* few updates in datastore (kubernetes-sigs#713)

* few updates in datastore

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* PoolSet documentation

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* error phrasing

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* removed unused pool arg from PodUpdateOrAddIfNotExist

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* linter

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* Add unit test coverage for pod APIs under datastore/pkg

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
Signed-off-by: Daneyon Hansen <daneyon.hansen@solo.io>
Signed-off-by: Maya Barnea <mayab@il.ibm.com>
Signed-off-by: Kellen Swain <kfswain@google.com>
Co-authored-by: Kellen Swain <kfswain@google.com>
Co-authored-by: Nir Rozenbaum <nirro@il.ibm.com>
Co-authored-by: John Howard <john.howard@solo.io>
Co-authored-by: Cong Liu <conliu@google.com>
Co-authored-by: Nicole Xin <nxin@google.com>
Co-authored-by: Rob Scott <rob.scott87@gmail.com>
Co-authored-by: nayihz <smartczy@outlook.com>
Co-authored-by: Daneyon Hansen <daneyon.hansen@solo.io>
Co-authored-by: Maya Barnea <mayab@il.ibm.com>
)

* added a target dedicated for running unit-test only.

this is very useful during development.

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* code review

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
* main:
  fixing errors in new template & disabling the default blank template (kubernetes-sigs#742)
  Updating proposal directories to match their PR number (kubernetes-sigs#741)
  added a target dedicated for running unit-test only (kubernetes-sigs#739)
  Add unit tests for pod APIs under pkg/datastore (kubernetes-sigs#712)
  docs: add concepts and definitions to README.md (kubernetes-sigs#734)
  Update issue templates (kubernetes-sigs#738)
  Move filter and scorer plugins registration to a separate file (kubernetes-sigs#729)
  EPP: Update GetRandomPod() to return nil if no pods exist (kubernetes-sigs#731)
  filter irrelevant pod in pod_reconciler (kubernetes-sigs#696)
  scheduler refactoring (kubernetes-sigs#730)

# Conflicts:
#	pkg/epp/scheduling/plugins/picker.go
#	pkg/epp/scheduling/plugins/picker/random_picker.go
#	pkg/epp/scheduling/plugins/pickers/random.go
#	pkg/epp/scheduling/scheduler.go
#	pkg/epp/scheduling/scheduler_test.go
@shmuelk
Copy link
Collaborator Author

shmuelk commented Apr 27, 2025

Approved by Maroun (via Slack)

@shmuelk shmuelk merged commit c60f877 into neuralmagic:dev Apr 27, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants