Where does "bnb" in Finetune-opt-bnb-peft.ipynb come from?
Sorry for the newbie question. Where does the meaning of “bnb” inFinetune-opt-bnb-peft.ipynbcome from? I couldn’t figure it out by looking at the source code.
2023-07-12T03:31:18Z
Perhaps it comes from the author’s name “Benjamin Bossan”?
2023-07-12T07:29:03Z
It comes from the name of the library ‘bitsandbytes’ (GitHub - TimDettmers/bitsandbytes: 8-bit CUDA functions for PyTorch) that implements (among other stuff) 8bit quantization
2023-07-12T08:16:33Z
Sorry I’m a newbie in this field. Thank you.