cecibas
/

Midnight-Miqu-70B-v1.5-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

awq quant made with lmdeploy v0.4.2:

lmdeploy lite auto_awq sophosympatheia/Midnight-Miqu-70B-v1.5 --work-dir Midnight-Miqu-70B-v1.5-4bit

Downloads last month: 656,543

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported Inference Providers.