pglo commited on
Commit
38463b6
·
verified ·
1 Parent(s): c4e58e9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -5
README.md CHANGED
@@ -23,11 +23,18 @@ Zamba2-2.7B-Instruct is a hybrid model composed of state-space ([Mamba2](https:/
23
 
24
  ### Prerequisites
25
 
26
- To download Zamba2-2.7B-instruct, clone Zyphra's fork of transformers:
27
- 1. `git clone https://github.com/Zyphra/transformers_zamba2.git`
28
- 2. `cd transformers_zamba2`
29
- 3. Install the repository: `pip install -e .`
30
- 4. `pip install accelerate`
 
 
 
 
 
 
 
31
 
32
 
33
  ### Inference
 
23
 
24
  ### Prerequisites
25
 
26
+ To use Zamba2-1.2B-instruct, install `transformers`:
27
+
28
+ `pip install transformers`
29
+
30
+ To install dependencies necessary to run Mamba2 kernels, install `mamba-ssm` from source (due to compatibility issues with PyTorch) as well as `causal-conv1d`:
31
+
32
+ 1. `git clone https://github.com/state-spaces/mamba.git`
33
+ 2. `cd mamba && git checkout v2.1.0 && pip install .`
34
+ 3. `pip install causal-conv1d`
35
+
36
+
37
+ You can run the model without using the optimized Mamba2 kernels, but it is **not** recommended as it will result in significantly higher latency and memory usage.
38
 
39
 
40
  ### Inference