JoseCarlosGarcia95 commited on
Commit
a0e6d37
·
1 Parent(s): c92c3c5

update readme

Browse files

Signed-off-by: José Carlos García <[email protected]>

Files changed (1) hide show
  1. README.md +34 -0
README.md CHANGED
@@ -1,5 +1,39 @@
1
  ---
 
 
 
 
 
2
  license: other
3
  license_name: falcon-llm-license
4
  license_link: https://falconllm.tii.ae/falcon-terms-and-conditions.html
5
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ library_name: transformers
3
+ tags:
4
+ - bitnet
5
+ - falcon3
6
+ base_model: tiiuae/Falcon3-3B-Base
7
  license: other
8
  license_name: falcon-llm-license
9
  license_link: https://falconllm.tii.ae/falcon-terms-and-conditions.html
10
  ---
11
+
12
+ # Model Card for Falcon3-3B-Base-1.58bit-q2b0
13
+
14
+ ### Falcon3-3B-1.58 Models
15
+
16
+ The **Falcon3-3B-1.58bit-q2b0** is a quantized version of **Falcon3-3B-Base**, leveraging the **q2b0 quantization method** from Candle. This enables extreme compression while maintaining strong performance across various NLP tasks.
17
+
18
+ ## Model Details
19
+
20
+ ### Model Sources
21
+
22
+ - **Repository:** [tiiuae/Falcon3-3B-Base](https://huggingface.co/tiiuae/Falcon3-3B-Base)
23
+ - **Quantization PR:** [Candle q2b0 Quantization](https://github.com/huggingface/candle/pull/2683)
24
+
25
+ ## Quantization Details
26
+
27
+ The model has been quantized using the **q2b0** method from Candle. This approach reduces model size significantly while preserving performance. For more details on this quantization technique, refer to the [Candle PR #2683](https://github.com/huggingface/candle/pull/2683).
28
+
29
+ ## Training Details
30
+
31
+ For details on the dataset and training process, refer to the original [Falcon3-3B-Base repository](https://huggingface.co/tiiuae/Falcon3-3B-Base).
32
+
33
+ ## License
34
+
35
+ This model is licensed under the [Falcon LLM License](https://falconllm.tii.ae/falcon-terms-and-conditions.html).
36
+
37
+ ---
38
+
39
+ For additional information or questions, please refer to the main [Falcon3-3B-Base repository](https://huggingface.co/tiiuae/Falcon3-3B-Base).