tc-mb
commited on
Commit
·
7fee240
1
Parent(s):
bee21bd
update readme
Browse filesSigned-off-by: tc-mb <[email protected]>
README.md
CHANGED
|
@@ -161,6 +161,25 @@ We deploy MiniCPM-V 4.5 on iPad M4 with [iOS demo](https://github.com/tc-mb/Mini
|
|
| 161 |
<img src="https://raw.githubusercontent.com/openbmb/MiniCPM-o/main/assets/minicpmv4_5/v45_cn_travel.gif" width="45%" style="display: inline-block; margin: 0 10px;"/>
|
| 162 |
</div>
|
| 163 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 164 |
|
| 165 |
## Usage
|
| 166 |
|
|
|
|
| 161 |
<img src="https://raw.githubusercontent.com/openbmb/MiniCPM-o/main/assets/minicpmv4_5/v45_cn_travel.gif" width="45%" style="display: inline-block; margin: 0 10px;"/>
|
| 162 |
</div>
|
| 163 |
|
| 164 |
+
## Framework Support Matrix
|
| 165 |
+
| Category | Framework | Cookbook Link | Upstream PR | Supported since (branch) | Supported since (release) |
|
| 166 |
+
|---|---|---|---|---|---|
|
| 167 |
+
| **Edge (On-device)** | | | | | |
|
| 168 |
+
| | Llama.cpp | [Llama.cpp Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/deployment/llama.cpp/minicpm-v4_5_llamacpp.md) | [#15575](https://github.com/ggml-org/llama.cpp/pull/15575) (2025-08-26) | master (2025-08-26) | [b6282](https://github.com/ggml-org/llama.cpp/releases/tag/b6282) |
|
| 169 |
+
| | Ollama | [Ollama Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/deployment/ollama/minicpm-v4_5_ollama.md) | [#12078](https://github.com/ollama/ollama/pull/12078) (2025-08-26) | Merging | Waiting for official release |
|
| 170 |
+
| **Serving (Cloud)** | | | | | |
|
| 171 |
+
| | vLLM | [vLLM Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/deployment/vllm/minicpm-v4_5_vllm.md) | [#23586](https://github.com/vllm-project/vllm/pull/23586) (2025-08-26) | main (2025-08-27) | Waiting for official release |
|
| 172 |
+
| | SGLang | [SGLang Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/deployment/sglang/MiniCPM-v4_5_sglang.md) | [#9610](https://github.com/sgl-project/sglang/pull/9610) (2025-08-26) | Merging | Waiting for official release |
|
| 173 |
+
| **Finetuning** | | | | | |
|
| 174 |
+
| | LLaMA-Factory | [LLaMA-Factory Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/finetune/finetune_llamafactory.md) | [#9022](https://github.com/hiyouga/LLaMA-Factory/pull/9022) (2025-08-26) | main (2025-08-26) | Waiting for official release |
|
| 175 |
+
| **Quantization** | | | | | |
|
| 176 |
+
| | GGUF | [GGUF Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/quantization/gguf/minicpm-v4_5_gguf_quantize.md) | — | — | — |
|
| 177 |
+
| | BNB | [BNB Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/quantization/bnb/minicpm-v4_5_bnb_quantize.md) | — | — | — |
|
| 178 |
+
| | AWQ | [AWQ Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/quantization/awq/minicpm-v4_5_awq_quantize.md) | — | — | — |
|
| 179 |
+
| **Demos** | | | | | |
|
| 180 |
+
| | Gradio Demo | [Gradio Demo Doc](https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/demo/web_demo/gradio/README.md) | — | — | — |
|
| 181 |
+
|
| 182 |
+
> Note: If you'd like us to prioritize support for another open-source framework, please let us know via this [short form](https://docs.google.com/forms/d/e/1FAIpQLSdyTUrOPBgWqPexs3ORrg47ZcZ1r4vFQaA4ve2iA7L9sMfMWw/viewform).
|
| 183 |
|
| 184 |
## Usage
|
| 185 |
|