Skip to content

Commit 33cae36

Browse files
authored
Update run-vllm.md: pin vllm version (#1990)
1 parent a78a055 commit 33cae36

File tree

1 file changed

+4
-1
lines changed

1 file changed

+4
-1
lines changed

articles/gpt-oss/run-vllm.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,10 @@ Both models are **MXFP4 quantized** out of the box.
2626
```shell
2727
uv venv --python 3.12 --seed
2828
source .venv/bin/activate
29-
uv pip install vllm --torch-backend=auto
29+
uv pip install --pre vllm==0.10.1+gptoss \
30+
--extra-index-url https://wheels.vllm.ai/gpt-oss/ \
31+
--extra-index-url https://download.pytorch.org/whl/nightly/cu128 \
32+
--index-strategy unsafe-best-match
3033
```
3134

3235
2. **Start up a server and download the model**

0 commit comments

Comments
 (0)