aleclyu EthannW commited on
Commit
e268223
·
verified ·
1 Parent(s): e412ba1

update README (#8)

Browse files

- update README (69d920a02dcc70c228fdc5cf2085d28e4ff14d9b)


Co-authored-by: Ethannwan <[email protected]>

Files changed (1) hide show
  1. README.md +11 -5
README.md CHANGED
@@ -126,14 +126,20 @@ Checkout [vLLM HunyuanOCR Usage Guide](https://docs.vllm.ai/projects/recipes/en/
126
 
127
  ### Installation
128
 
129
- Using pip:
130
  ```bash
131
- pip install vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
132
- ```
133
 
134
- Using uv:
135
  ```
136
- uv pip install vllm --extra-index-url https://wheels.vllm.ai/nightly
 
 
 
 
 
 
 
137
  ```
138
 
139
  ### Model Deploy
 
126
 
127
  ### Installation
128
 
 
129
  ```bash
130
+ uv venv hunyuanocr
131
+ source hunyuanocr/bin/activate
132
 
133
+ uv pip install -U vllm --pre --extra-index-url https://wheels.vllm.ai/nightly
134
  ```
135
+
136
+ Note: We suggest to install [cuda-compat-12-9](https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/):
137
+ ```bash
138
+ sudo dpkg -i cuda-compat-12-9_575.57.08-0ubuntu1_amd64.deb
139
+ echo 'export LD_LIBRARY_PATH=/usr/local/cuda-12.9/compat:$LD_LIBRARY_PATH' >> ~/.bashrc
140
+ source ~/.bashrc
141
+ # verify cuda-compat-12-9
142
+ ls /usr/local/cuda-12.9/compat
143
  ```
144
 
145
  ### Model Deploy