Update README.md

README.md

@@ -3,57 +3,30 @@ license: apache-2.0
 datasets:
 - open-thoughts/OpenThoughts-114k
 - prithivMLmods/Deepthink-Reasoning-Ins
-base_model: XeTute/SaplingDream_V0.5-0.5B
+base_model:
+- Qwen/Qwen2.5-0.5B-Instruct
 language:
 - en
 - zh
 new_version: XeTute/SaplingDream_V1-0.5B
 library_name: transformers
-tags:
-- llama-cpp
-- gguf-my-repo
 ---
 
-# XeTute/SaplingDream_V0.5-0.5B-Q8_0-GGUF
-This model was converted to GGUF format from [`XeTute/SaplingDream_V0.5-0.5B`](https://huggingface.co/XeTute/SaplingDream_V0.5-0.5B) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
-Refer to the [original model card](https://huggingface.co/XeTute/SaplingDream_V0.5-0.5B) for more details on the model.
+# Sapling Dream V0.5
+This is a finetune ontop of the model mentioned below using the datasets mentioned below through 60% of the training process from V1. V1 will be released of **Feb. 22 2025**, and it will have better performance than this one. Consider this a demo.  
 
-## Use with llama.cpp
-Install llama.cpp through brew (works on Mac and Linux)
+We are currently in the process of training our model, with an official release scheduled for **February 22, 2025 at 17:00 according to the timezone of the Islamic Republic of Pakistan**. 
 
-```bash
-brew install llama.cpp
+Introducing **SaplingDream**, a compact GPT model with 0.5 billion parameters, based on the [Qwen/Qwen2.5-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2.5-0.5B-Instruct) architecture. This model has been fine-tuned on reasoning datasets with meticulous attention to detail, ensuring the highest quality—hence the name "SaplingDream." See this as advanced "instruction" tuning for the base model to support reasoning to make up for its size efficiently.  
 
-```
-Invoke the llama.cpp server or the CLI.
+To enhance generalization, we are fine-tuning the base model using Stochastic Gradient Descent (SGD) alongside a "Polynomial" learning rate scheduler, starting with a learning rate of 1e-4. Our goal is to ensure that the model not only learns the tokens but also develops the ability to reason through problems effectively.
 
-### CLI:
-```bash
-llama-cli --hf-repo XeTute/SaplingDream_V0.5-0.5B-Q8_0-GGUF --hf-file saplingdream_v0.5-0.5b-q8_0.gguf -p "The meaning to life and the universe is"
-```
+For training, we are utilizing the [open-thoughts/OpenThoughts-114k](https://huggingface.co/datasets/open-thoughts/OpenThoughts-114k) and [prithivMLmods/Deepthink-Reasoning-Ins](https://huggingface.co/datasets/prithivMLmods/Deepthink-Reasoning-Ins) datasets across the entire epoch.
+[You can find the FP32 version here.](https://huggingface.co/XeTute/SaplingDream_V0.5-0.5B)
 
-### Server:
-```bash
-llama-server --hf-repo XeTute/SaplingDream_V0.5-0.5B-Q8_0-GGUF --hf-file saplingdream_v0.5-0.5b-q8_0.gguf -c 2048
-```
-
-Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
-
-Step 1: Clone llama.cpp from GitHub.
-```
-git clone https://github.com/ggerganov/llama.cpp
-```
-
-Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
-```
-cd llama.cpp && LLAMA_CURL=1 make
-```
+---
+# Our Apps & Socials
+[Chat with our Assistant](https://xetute.com/) | [Support us Financially](https://ko-fi.com/XeTute) | [Visit our GitHub](https://github.com/XeTute)  
 
-Step 3: Run inference through the main binary.
-```
-./llama-cli --hf-repo XeTute/SaplingDream_V0.5-0.5B-Q8_0-GGUF --hf-file saplingdream_v0.5-0.5b-q8_0.gguf -p "The meaning to life and the universe is"
-```
-or 
-```
-./llama-server --hf-repo XeTute/SaplingDream_V0.5-0.5B-Q8_0-GGUF --hf-file saplingdream_v0.5-0.5b-q8_0.gguf -c 2048
-```
+Long live the Islamic Republic of Pakistan; Glory to the Islamic Republic of Pakistan 🇵🇰  
+![The Flag of the Islamic Federal Republic of Pakistan](https://upload.wikimedia.org/wikipedia/commons/3/32/Flag_of_Pakistan.svg)