theone049 commited on
Commit
dbc305d
·
verified ·
1 Parent(s): 11ba6a3

Update Readme.md

Browse files
Files changed (1) hide show
  1. README.md +41 -0
README.md CHANGED
@@ -49,3 +49,44 @@ What is the control measure for aphid infestation in mustard crops?
49
  inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
50
  outputs = model.generate(**inputs, max_new_tokens=100)
51
  print(tokenizer.decode(outputs[0], skip_special_tokens=True))
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
  inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
50
  outputs = model.generate(**inputs, max_new_tokens=100)
51
  print(tokenizer.decode(outputs[0], skip_special_tokens=True))
52
+ ```
53
+
54
+ ## 📊 Training
55
+
56
+ - **Epochs:** 3
57
+ - **Batch Size:** 8
58
+ - **Learning Rate:** 2e-5
59
+ - **Precision:** bf16
60
+ - **Training Framework:** 🤗 `transformers` + `peft`
61
+ - **Compute:** Google Colab T4 GPU
62
+
63
+ ## 📁 Files
64
+
65
+ - `adapter_config.json`: Configuration of LoRA adapter.
66
+ - `adapter_model.safetensors`: The trained adapter weights.
67
+ - `README.md`: This file.
68
+
69
+ ## 🛑 Limitations
70
+
71
+ - **Domain-Specific**: Works best on agri-related questions. Not suited for general conversation.
72
+ - **Small Dataset**: Initial training was done on a subset (~5k samples). Accuracy may improve with full dataset.
73
+ - **Not Merged**: Requires base model for usage.
74
+
75
+ ## 📚 Citation
76
+
77
+ ```bibtex
78
+ @misc{nithyanandam2024agriqa,
79
+ title={AgriQA TinyLlama LoRA Adapter},
80
+ author={Nithyanandam Venu},
81
+ year={2024},
82
+ howpublished={\url{https://huggingface.co/theone049/agriqa-tinyllama-lora-adapter}}
83
+ }
84
+ ```
85
+
86
+ ## ✉️ Contact
87
+
88
+ For questions or collaborations: [[email protected]](mailto:[email protected])
89
+
90
+ ---
91
+
92
+ *This is part of an experimental project to improve AI Q&A for agriculture. Not for medical or pesticide advice.*