Skip to content

Tags: sroecker/llama.cpp

Tags

b2773

Toggle b2773's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
metal : remove deprecated error code (ggml-org#7008)

b2769

Toggle b2769's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Improve usability of --model-url & related flags (ggml-org#6930)

* args: default --model to models/ + filename from --model-url or --hf-file (or else legacy models/7B/ggml-model-f16.gguf)

* args: main & server now call gpt_params_handle_model_default

* args: define DEFAULT_MODEL_PATH + update cli docs

* curl: check url of previous download (.json metadata w/ url, etag & lastModified)

* args: fix update to quantize-stats.cpp

* curl: support legacy .etag / .lastModified companion files

* curl: rm legacy .etag file support

* curl: reuse regex across headers callback calls

* curl: unique_ptr to manage lifecycle of curl & outfile

* curl: nit: no need for multiline regex flag

* curl: update failed test (model file collision) + gitignore *.gguf.json

b2755

Toggle b2755's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Fix more int overflow during quant (PPL/CUDA). (ggml-org#6563)

* Fix more int overflow during quant.

* Fix some more int overflow in softmax.

* Revert back to int64_t.