Initial GGML model commit

README.md

@@ -23,9 +23,9 @@ tags:
 </div>
 <!-- header end -->
 
-# NousResearch's Redmond Puffin 13B GGML
+# NousResearch's Redmond Puffin 13B V1.3 GGML
 
-These files are GGML format model files for [NousResearch's Redmond Puffin 13B](https://huggingface.co/NousResearch/Redmond-Puffin-13B).
+These files are GGML format model files for [NousResearch's Redmond Puffin 13B V1.3](https://huggingface.co/NousResearch/Redmond-Puffin-13B).
 
 GGML files are for CPU + GPU inference using [llama.cpp](https://github.com/ggerganov/llama.cpp) and libraries and UIs which support this format, such as:
 * [KoboldCpp](https://github.com/LostRuins/koboldcpp), a powerful GGML web UI with full GPU acceleration out of the box. Especially good for story telling.
@@ -35,6 +35,8 @@ GGML files are for CPU + GPU inference using [llama.cpp](https://github.com/gger
 * [ctransformers](https://github.com/marella/ctransformers), a Python library with LangChain support and OpenAI-compatible AI server.
 * [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with OpenAI-compatible API server.
 
+Many thanks to William Beauchamp from [Chai](https://chai-research.com/) for providing the hardware used to make and upload these files!
+
 ## Repositories available
 
 * [GPTQ models for GPU inference, with multiple quantisation parameter options.](https://huggingface.co/TheBloke/Redmond-Puffin-13B-GPTQ)
@@ -102,7 +104,7 @@ Refer to the Provided Files table below to see what files use which methods, and
 I use the following command line; adjust for your tastes and needs:
 
 ```
-./main -t 10 -ngl 32 -m redmond-puffin-13b.ggmlv3.q4_0.bin --color -c 2048 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "###Human: Write a story about llamas\n###Gpt:"
+./main -t 10 -ngl 32 -m redmond-puffin-13b.ggmlv3.q4_0.bin --color -c 2048 --temp 0.7 --repeat_penalty 1.1 -n -1 -p "### Instruction: Write a story about llamas\n### Response:"
 ```
 Change `-t 10` to the number of physical CPU cores you have. For example if your system has 8 cores/16 threads, use `-t 8`.
 
@@ -136,17 +138,19 @@ Donaters will get priority support on any and all AI/LLM/model questions and req
 
 **Special thanks to**: Luke from CarbonQuill, Aemon Algiz.
 
-**Patreon special mentions**: Space Cruiser, Nikolai Manek, Sam, Chris McCloskey, Rishabh Srivastava, Kalila, Spiking Neurons AB, Khalefa Al-Ahmad, WelcomeToTheClub, Chadd, Lone Striker, Viktor Bowallius, Edmond Seymore, Ai Maven, Chris Smitley, Dave, Alexandros Triantafyllidis, Luke @flexchar, Elle, ya boyyy, Talal Aujan, Alex , Jonathan Leane, Deep Realms, Randy H, subjectnull, Preetika Verma, Joseph William Delisle, Michael Levine, chris gileta, K, Oscar Rangel, LangChain4j, Trenton Dambrowitz, Eugene Pentland, Johann-Peter Hartmann, Femi Adebogun, Illia Dulskyi, senxiiz, Daniel P. Andersen, Sean Connelly, Artur Olbinski, RoA, Mano Prime, Derek Yates, Raven Klaugh, David Flickinger, Willem Michiel, Pieter, Willian Hasse, vamX, Luke Pendergrass, webtim, Ghost , Rainer Wilmers, Nathan LeClaire, Will Dee, Cory Kujawski, John Detwiler, Fred von Graf, biorpg, Iucharbius , Imad Khwaja, Pierre Kircher, terasurfer , Asp the Wyvern, John Villwock, theTransient, zynix , Gabriel Tamborski, Fen Risland, Gabriel Puliatti, Matthew Berman, Pyrater, SuperWojo, Stephen Murray, Karl Bernard, Ajan Kanaga, Greatston Gnanesh, Junyu Yang.
+**Patreon special mentions**: Slarti, Chadd, John Detwiler, Pieter, zynix, K, Mano Prime, ReadyPlayerEmma, Ai Maven, Leonard Tan, Edmond Seymore, Joseph William Delisle, Luke @flexchar, Fred von Graf, Viktor Bowallius, Rishabh Srivastava, Nikolai Manek, Matthew Berman, Johann-Peter Hartmann, ya boyyy, Greatston Gnanesh, Femi Adebogun, Talal Aujan, Jonathan Leane, terasurfer, David Flickinger, William Sang, Ajan Kanaga, Vadim, Artur Olbinski, Raven Klaugh, Michael Levine, Oscar Rangel, Randy H, Cory Kujawski, RoA, Dave, Alex, Alexandros Triantafyllidis, Fen Risland, Eugene Pentland, vamX, Elle, Nathan LeClaire, Khalefa Al-Ahmad, Rainer Wilmers, subjectnull, Junyu Yang, Daniel P. Andersen, SuperWojo, LangChain4j, Mandus, Kalila, Illia Dulskyi, Trenton Dambrowitz, Asp the Wyvern, Derek Yates, Jeffrey Morgan, Deep Realms, Imad Khwaja, Pyrater, Preetika Verma, biorpg, Gabriel Tamborski, Stephen Murray, Spiking Neurons AB, Iucharbius, Chris Smitley, Willem Michiel, Luke Pendergrass, Sebastain Graf, senxiiz, Will Dee, Space Cruiser, Karl Bernard, Clay Pascal, Lone Striker, transmissions 11, webtim, WelcomeToTheClub, Sam, theTransient, Pierre Kircher, chris gileta, John Villwock, Sean Connelly, Willian Hasse
+
 
 Thank you to all my generous patrons and donaters!
 
 <!-- footer end -->
 
-# Original model card: NousResearch's Redmond Puffin 13B
+# Original model card: NousResearch's Redmond Puffin 13B V1.3
+
 
 ![puffin](https://i.imgur.com/R2xTHMb.png)
 
-## **Redmond-Puffin-13b (Currently available as a Preview edition)**
+## **Redmond-Puffin-13b-V1.3**
 
 **The first commercially available language model released by Nous Research!**
 
@@ -160,25 +164,39 @@ Notable mentions for assisting in some of the training issues goes to: Caseus an
 
 ## Model Training
 
-Redmond-Puffin-13B is a new model trained for multiple epochs on a dataset of 3,000 carefully curated GPT-4 examples, most of which are long context conversations between a real human and GPT-4. 
+Redmond-Puffin-13B-V1.3 is a new model trained for multiple epochs on a dataset of 3,000 carefully curated GPT-4 examples, most of which are long context conversations between a real human and GPT-4. 
 
-Additional data came from carefully curated subsections of datasets such as CamelAI's Physics, Chemistry, Biology and Math.
+Additional data came from carefully curated sub sections of datasets such as CamelAI's Physics, Chemistry, Biology and Math.
 
 ## Prompt Format
 
-The model follows the Vicuna ShareGPT prompt format:
+The reccomended model usage is:
 
 ```
 ### human:
 
-### gpt:
+### response:
+
+```
+Optional reccomended pre-prompt / system prompt:
+
 ```
+### human: Interact in conversation to the best of your ability, please be concise, logical, intelligent and coherent.
+
+### response: Sure! sounds good.
+```
+
+## Improvements over previous version:
+
+The original Puffin model was loved by many, however it was quickly discovered to have dataset errors in a significant amount of the conversations.
+Puffin-V1.3 dataset solves this issue and the resulting fixed model has now fully finished training!
+
 
 ## Notable Features:
 
  - The first Llama-2 based fine-tuned model released by Nous Research.
 
- - Ability to recall information from upto late 2022 without internet. (ChatGPT cut off date is in 2021)
+ - Ability to recall information upto 2023 without internet (ChatGPT cut off date is in 2021)
 
  - Pretrained on 2 trillion tokens of text. (This is double the amount of most Open LLM's)
 
@@ -196,10 +214,14 @@ We plan to have these solved in an updated Puffin model in the very near future,
 
 This is a relatively early build amongst the grand plans for the future of Puffin! 
 
-Current limitations: Some token mismatch problems and formatting issues have been idenitifed, these may very possibly effect the current output quality, we plan to have these solved in an updated Puffin model in the near future.
+Current limitations: Some token mismatch problems have been identified, these may effect the current output quality, we plan to have this solved in Puffin V2 along with other improvements.
+
+## How you can help!
+
+In the near future we plan on leveraging the help of domain specific expert volunteers to eliminate any mathematically/verifiably incorrect answers from our training curations. 
 
-In the near future we plan on releasing an improved version of the model with the help of domain specific expert volunteers, which will help eliminate any wrong data from this curation and improve the further ones.
+If you have at-least a bachelors in mathematics, physics, biology or chemistry and would like to volunteer even just 30 minutes of your expertise time, please contact ldj on discord!
 
 ## Benchmarks coming soon
 
-benchmarks coming soon!
+benchmarks coming soon!