Pratyush
perceptron-743
AI & ML interests
None yet
Organizations
None yet
perceptron-743's activity
How do I use this model along with HuggingfaceInference ?
#31 opened 4 months ago
by
perceptron-743
Missing pytorch_model.bin?
1
#1 opened 8 months ago
by
mapto

The model doesn't load into Google colab with 4bit nf4 quantization. Why?
1
#12 opened 6 months ago
by
perceptron-743
Cannot load quantized version of the model into a 15 GB VRAM gpu?
2
#3 opened 6 months ago
by
perceptron-743