Update README.md
Browse files
README.md
CHANGED
@@ -7,7 +7,7 @@ inference: false
|
|
7 |
---
|
8 |
|
9 |
<div style="width: 100%;">
|
10 |
-
<img src="https://i.imgur.com/
|
11 |
</div>
|
12 |
<div style="display: flex; justify-content: space-between; width: 100%;">
|
13 |
<div style="display: flex; flex-direction: column; align-items: flex-start;">
|
@@ -18,9 +18,10 @@ inference: false
|
|
18 |
</div>
|
19 |
</div>
|
20 |
|
21 |
-
# Falcon-7B-Instruct GPTQ
|
22 |
|
23 |
-
|
|
|
|
|
24 |
|
25 |
It is the result of quantising to 4bit using [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ).
|
26 |
|
@@ -28,6 +29,8 @@ It is the result of quantising to 4bit using [AutoGPTQ](https://github.com/PanQi
|
|
28 |
|
29 |
Join me at: https://discord.gg/UBgz4VXf
|
30 |
|
|
|
|
|
31 |
## EXPERIMENTAL
|
32 |
|
33 |
Please note this is an experimental first model. Support for it is currently quite limited.
|
|
|
7 |
---
|
8 |
|
9 |
<div style="width: 100%;">
|
10 |
+
<img src="https://i.imgur.com/vDd8l6K.jpg" alt="TheBlokeAI" style="width: 100%; min-width: 400px; display: block; margin: auto;">
|
11 |
</div>
|
12 |
<div style="display: flex; justify-content: space-between; width: 100%;">
|
13 |
<div style="display: flex; flex-direction: column; align-items: flex-start;">
|
|
|
18 |
</div>
|
19 |
</div>
|
20 |
|
|
|
21 |
|
22 |
+
# Falcon-40B-Instruct GPTQ
|
23 |
+
|
24 |
+
This repo contains an experimantal GPTQ 4bit model for [Falcon-40B-Instruct](https://huggingface.co/tiiuae/falcon-40b-instruct).
|
25 |
|
26 |
It is the result of quantising to 4bit using [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ).
|
27 |
|
|
|
29 |
|
30 |
Join me at: https://discord.gg/UBgz4VXf
|
31 |
|
32 |
+
Want to support me and help pay my cloud computing bill? I also now have a Patreon! https://www.patreon.com/TheBlokeAI
|
33 |
+
|
34 |
## EXPERIMENTAL
|
35 |
|
36 |
Please note this is an experimental first model. Support for it is currently quite limited.
|