如何将模型转换为gguf格式？
How to convert models  microsoft/Phi-3-vision-128k-instruct to GGUF format. One for Windows and macOS (silicon and intel), The original installation method never worked on my end, I needed a more convenient method. interchip machine.
2024-07-26T08:50:40Z
use llama.cpp， for example，python convert-hf-to-gguf.py Qwen/Qwen1.5-7B-Chat --outfile models/7B/qwen1_5-7b-chat-fp16.gguf