File size: 998 Bytes
04deaba ae51d53 04deaba ae51d53 04deaba ae51d53 04deaba ae51d53 1b15dde ae51d53 1b15dde ae51d53 2880060 ae51d53 1b15dde ae51d53 2880060 ae51d53 f03a63f ae51d53 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 |
---
language:
- en
license: other
library_name: sglang
pipeline_tag: text-generation
tags:
- grok-2
- xai
- sglang
- inference
- triton
base_model: xai-org/grok-2
model-index:
- name: grok-2
results: []
---
# Grok 2
This repository contains the weights of Grok 2, a model trained and used at xAI in 2024.
- License: Grok 2 Community License Agreement (./LICENSE)
- Ownership: xAI (this document does not change license or weights)
## Weights
Download from the Hub (≈500 GB total; 42 files):
```bash
hf download xai-org/grok-2 --local-dir /local/grok-2
python3 -m sglang.launch_server \
--model /local/grok-2 \
--tokenizer-path /local/grok-2/tokenizer.tok.json \
--tp 8 \
--quantization fp8 \
--attention-backend triton
python3 -m sglang.test.send_one --prompt \
"Human: What is your name?<|separator|>\n\nAssistant:"
https://github.com/sgl-project/sglang/blob/97a38ee85ba62e268bde6388f1bf8edfe2ca9d76/python/sglang/srt/tokenizer/tiktoken_tokenizer.py#L106
|