Skip to content

Llama.cpp 30B runs with only 6GB of RAM now - update ? #182

New issue
New issue
Closed
Closed
Llama.cpp 30B runs with only 6GB of RAM now - update ?#182
@magicmars35

Description

@magicmars35
magicmars35
opened on Apr 1, 2023

Llama.cpp 30B runs with only 6GB of RAM now :

ggml-org#613

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions