base_model: | |
- xai-org/grok-2 | |
static quants of https://huggingface.co/xai-org/grok-2 | |
To run these quants before https://github.com/ggml-org/llama.cpp/pull/15539 is merged you will need to build llama.cpp from https://github.com/ggml-org/llama.cpp/tree/cisc/grok-2 |