Skip to content

我想量化deepseek-vl2-small模型到deepseek-vl2-small-Q4-K #15741

@DuDuBear1086

Description

@DuDuBear1086

想通过convert_hf_to_gguf_update.py去量化deepseek-vl2-small模型到deepseek-vl2-small-q4-k
但通过记事本格式打开convert_hf_to_gguf_update.py去查找,发现llama.cpp 的转换脚本 convert_hf_to_gguf.py 尚未在代码层面添加对 deepseek_vl_v2 架构的解析和支持
能请作者早日把对 deepseek_vl_v2 架构的解析和支持编写进convert_hf_to_gguf_update.py吗?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions