NeverSleep
/

Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (1)

A new HQQ Quantization in <16GB VRAM

#8 opened 10 months ago by

Silly Tavern Settings

#7 opened about 1 year ago by

What is the correct prompt format for this model?

#6 opened about 1 year ago by

Peak

#5 opened about 1 year ago by

1.64-upmanship (2 bit HQQ quantize)

#3 opened about 1 year ago by

ProphetOfBostrom

EXL2 - 3.64 bpw

#2 opened about 1 year ago by

Recommended settings?

#1 opened about 1 year ago by