Name and Version

python convert_hf_to_gguf.py --model /Users/xiaoyaojun/Desktop/models3/jina-reranker-v2-base-multilingual --outtype f16 --outfile /Users/xiaoyaojun/Desktop/models3/output

Traceback (most recent call last):
File "/Users/xiaoyaojun/Desktop/demos/model_middle-sdk/convert/convert_hf_to_gguf.py", line 1761, in
class Llama4Model(LlamaModel):
File "/Users/xiaoyaojun/Desktop/demos/model_middle-sdk/convert/convert_hf_to_gguf.py", line 1762, in Llama4Model
model_arch = gguf.MODEL_ARCH.LLAMA4
File "/opt/miniconda3/envs/pythonProject/lib/python3.9/enum.py", line 429, in getattr
raise AttributeError(name) from None
AttributeError: LLAMA4
(pythonProject) xiaoyaojun@xiaoyaojundeMacBook-Pro convert %

Operating systems

Mac

GGML backends

CPU

Hardware

mac and linux

Models

No response

Problem description & steps to reproduce

python convert_hf_to_gguf.py --model /Users/xiaoyaojun/Desktop/models3/jina-reranker-v2-base-multilingual --outtype f16 --outfile /Users/xiaoyaojun/Desktop/models3/output

Traceback (most recent call last):
File "/Users/xiaoyaojun/Desktop/demos/model_middle-sdk/convert/convert_hf_to_gguf.py", line 1761, in
class Llama4Model(LlamaModel):
File "/Users/xiaoyaojun/Desktop/demos/model_middle-sdk/convert/convert_hf_to_gguf.py", line 1762, in Llama4Model
model_arch = gguf.MODEL_ARCH.LLAMA4
File "/opt/miniconda3/envs/pythonProject/lib/python3.9/enum.py", line 429, in getattr
raise AttributeError(name) from None
AttributeError: LLAMA4
(pythonProject) xiaoyaojun@xiaoyaojundeMacBook-Pro convert %

First Bad Commit

No response

Relevant log output

Traceback (most recent call last):
  File "/Users/xiaoyaojun/Desktop/demos/model_middle-sdk/convert/convert_hf_to_gguf.py", line 1761, in <module>
    class Llama4Model(LlamaModel):
  File "/Users/xiaoyaojun/Desktop/demos/model_middle-sdk/convert/convert_hf_to_gguf.py", line 1762, in Llama4Model
    model_arch = gguf.MODEL_ARCH.LLAMA4
  File "/opt/miniconda3/envs/pythonProject/lib/python3.9/enum.py", line 429, in __getattr__
    raise AttributeError(name) from None
AttributeError: LLAMA4
(pythonProject) xiaoyaojun@xiaoyaojundeMacBook-Pro convert %