vLLM deployment example with SkyPilot #2002
Open
+218
−0
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Add guide for deploying gpt-oss models using SkyPilot and vLLM across multiple cloud providers with automatic GPU provisioning, cost optimization, and production scaling. This is a follow-up to https://cookbook.openai.com/articles/gpt-oss/run-vllm
Motivation
Provides multi-cloud deployment option for gpt-oss models, complementing the existing single-cloud vLLM guide. Enables users to deploy across 16+ cloud providers with automatic failover, spot instance support, and production-ready autoscaling through SkyServe.
For new content
When contributing new content, read through our contribution guidelines, and mark the following action items as completed:
We will rate each of these areas on a scale from 1 to 4, and will only accept contributions that score 3 or higher on all areas. Refer to our contribution guidelines for more details.