Model Card for subhajit17/Qwen2-7B-Instruct-4bit-quantized

This repo contains 4-bit quantized (using bitsandbytes) model of Qwen2-7B-Instruct

Model Details

How to Get Started with the Model

Use the code below to get started with the model.

Downloads last month
6
Safetensors
Model size
4.46B params
Tensor type
FP16
F32
U8
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.