Gbnf checker + validator #9825
-
|
Hi there, Currently I'm using a gbnf file I've generated myself and the only way I currently have to test it is to ask the LLM to mirror what I say and then see if it emits the same content. Fairly flaky at best. I'd like to (a) validate my gbnf by running some command (rather than wait for and try to spot a stderr message on the console) I've been through https://github.com/ggerganov/llama.cpp/blob/master/grammars/README.md which isn't entirely clear on some aspects of character escaping (I found the answer in the parser code), Any help or pointers would be much appreciated. |
Beta Was this translation helpful? Give feedback.
Replies: 3 comments 6 replies
-
|
It is called |
Beta Was this translation helpful? Give feedback.
-
|
Duh, my bad. Wasn't using my own build. |
Beta Was this translation helpful? Give feedback.
-
|
Did anyone else also have this issue ? I followed:
I can use llama.cpp with no issues and use it actively but I don't know why I can't build the gbnf-validator, actually need it a lot. If somebody has any idea 🙏 |
Beta Was this translation helpful? Give feedback.
-
|
It was renamed to |
Beta Was this translation helpful? Give feedback.
-
|
Still get an |
Beta Was this translation helpful? Give feedback.
-
|
Actually noticed in the CMakeLists for the tests, that Windows is not supported and will automatically not build the .\llama.cpp\tests\CMakeLists.txt
if (NOT WIN32) So there no way to use this tool on Windows ? |
Beta Was this translation helpful? Give feedback.
-
|
With #13980 you should be able to build it by configuring cmake with |
Beta Was this translation helpful? Give feedback.
-
|
Ok perfect it works, thanks a lot! |
Beta Was this translation helpful? Give feedback.
-
|
I've been working on a VSCode LSP plugin (https://marketplace.visualstudio.com/items?itemName=ReinderVosdeWael.gbnf-engine) for That being said, I'm not aware of any invalid GBNF that isn't caught by the LSP. Feedback would be helpful if you run into issues (https://github.com/ReinderVosDeWael/gbnf-lsp)! |
Beta Was this translation helpful? Give feedback.
It is called
llama-gbnf-validator, and you don't need to build it separately.