Skip to content

[PROBLEM]Vllm serve gpt-oss will download all the files from huggingface repo #1998

@Howe829

Description

@Howe829

[optional format]

Identify the file to be fixed

vllm serve openai/gpt-oss-20b

vllm serve openai/gpt-oss-120b

Describe the problem
vllm serve gpt-oss command will download all the files from huggingface repo, but i think metal/model.bin is not required to run the model with vllm

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions