update README (#8)
Browse files- update README (69d920a02dcc70c228fdc5cf2085d28e4ff14d9b)
Co-authored-by: Ethannwan <[email protected]>
README.md
CHANGED
|
@@ -126,14 +126,20 @@ Checkout [vLLM HunyuanOCR Usage Guide](https://docs.vllm.ai/projects/recipes/en/
|
|
| 126 |
|
| 127 |
### Installation
|
| 128 |
|
| 129 |
-
Using pip:
|
| 130 |
```bash
|
| 131 |
-
|
| 132 |
-
|
| 133 |
|
| 134 |
-
|
| 135 |
```
|
| 136 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 137 |
```
|
| 138 |
|
| 139 |
### Model Deploy
|
|
|
|
| 126 |
|
| 127 |
### Installation
|
| 128 |
|
|
|
|
| 129 |
```bash
|
| 130 |
+
uv venv hunyuanocr
|
| 131 |
+
source hunyuanocr/bin/activate
|
| 132 |
|
| 133 |
+
uv pip install -U vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
|
| 134 |
```
|
| 135 |
+
|
| 136 |
+
Note: We suggest to install [cuda-compat-12-9](https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/):
|
| 137 |
+
```bash
|
| 138 |
+
sudo dpkg -i cuda-compat-12-9_575.57.08-0ubuntu1_amd64.deb
|
| 139 |
+
echo 'export LD_LIBRARY_PATH=/usr/local/cuda-12.9/compat:$LD_LIBRARY_PATH' >> ~/.bashrc
|
| 140 |
+
source ~/.bashrc
|
| 141 |
+
# verify cuda-compat-12-9
|
| 142 |
+
ls /usr/local/cuda-12.9/compat
|
| 143 |
```
|
| 144 |
|
| 145 |
### Model Deploy
|