Update README.md
Browse files
README.md
CHANGED
@@ -23,11 +23,18 @@ Zamba2-2.7B-Instruct is a hybrid model composed of state-space ([Mamba2](https:/
|
|
23 |
|
24 |
### Prerequisites
|
25 |
|
26 |
-
To
|
27 |
-
|
28 |
-
|
29 |
-
|
30 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
31 |
|
32 |
|
33 |
### Inference
|
|
|
23 |
|
24 |
### Prerequisites
|
25 |
|
26 |
+
To use Zamba2-1.2B-instruct, install `transformers`:
|
27 |
+
|
28 |
+
`pip install transformers`
|
29 |
+
|
30 |
+
To install dependencies necessary to run Mamba2 kernels, install `mamba-ssm` from source (due to compatibility issues with PyTorch) as well as `causal-conv1d`:
|
31 |
+
|
32 |
+
1. `git clone https://github.com/state-spaces/mamba.git`
|
33 |
+
2. `cd mamba && git checkout v2.1.0 && pip install .`
|
34 |
+
3. `pip install causal-conv1d`
|
35 |
+
|
36 |
+
|
37 |
+
You can run the model without using the optimized Mamba2 kernels, but it is **not** recommended as it will result in significantly higher latency and memory usage.
|
38 |
|
39 |
|
40 |
### Inference
|