22 Pull requests merged by 10 people

• [UPSTREAM-SYNC] Add LLMResponse object and RequestId to LLMRequest

  #138 merged May 8, 2025

• Sync upstream-sync

  #136 merged May 8, 2025

• Add Support for OpenAI ChatCompletions API - PrefixAware Scoring

  #137 merged May 7, 2025

• [UPSTREAM] Break up scheduling to allow calling with an existing context

  #134 merged May 7, 2025

• Fix PD Scorers Configurations

  #133 merged May 7, 2025

• Update Istio release

  #125 merged May 7, 2025

• [UPSTREAM-SYNC] Added support for mutating headers

  #129 merged May 6, 2025

• Temporarily Switch to PostSchedule for Prefix-Store Updates

  #126 merged May 6, 2025

• [docs]: Add prefix flags to the README file

  #123 merged May 6, 2025

• Session affinity scorer

  #117 merged May 5, 2025

• Implemented PrefixAwareScorer Based On Ricardo's Work

  #118 merged May 5, 2025

• Prefix Aware Scorer

  #48 merged May 5, 2025

• Add decode filter to the default filters list in case pd is enabled

  #119 merged May 5, 2025

• Add P/D scheduler

  #115 merged May 5, 2025

• [build]: Updating vllm deployment to support the latest images and scorers.

  #112 merged May 5, 2025

• feat: Add the invocation of the Post response plugins

  #113 merged May 4, 2025

• Fix Buildah Workspaces

  #109 merged May 2, 2025

• Fix Buildah Task

  #108 merged May 2, 2025

• Fix Build

  #107 merged May 2, 2025

• add log lines

  #105 merged May 2, 2025

• Update pod labels to match those supplied by ModelService

  #106 merged May 2, 2025

• Provide a way to enable the PDFilter

  #104 merged May 1, 2025

4 Pull requests opened by 3 people

• [DO NOT MERGE] Renamed Scheduler APIs to better reflect their usage.

  #116 opened May 4, 2025

• Promote Dev

  #122 opened May 5, 2025

• [UPSTREAM-SYNC] Feat: Add invocation of Post response plugins

  #132 opened May 7, 2025

• test: Test server

  #139 opened May 8, 2025

3 Issues closed by 3 people

• Prefix Aware Routing

  #42 closed May 7, 2025

• Add PD scheduler

  #114 closed May 5, 2025

• Pod labels

  #103 closed May 2, 2025

6 Issues opened by 3 people

• Prefix Score logging percentage

  #131 opened May 7, 2025

• Post Response does not keep prompt

  #130 opened May 7, 2025

• [UPSTREAM] Document PRs on upstream-sync

  #128 opened May 6, 2025

• [PR #118 Followup] PrefixStore Block Hashing Fix

  #121 opened May 5, 2025

• [PR #118 Followup] Refactor Scorer Namings

  #120 opened May 5, 2025

• Context Aware Scorers OpenAI Chat-Completions Support

  #111 opened May 4, 2025

1 Unresolved conversation

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• [DO NOT MERGE] Added unit test for pod role loading

  #99 commented on May 8, 2025 • 0 new comments