Update Readme.md
Browse files
README.md
CHANGED
|
@@ -49,3 +49,44 @@ What is the control measure for aphid infestation in mustard crops?
|
|
| 49 |
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
|
| 50 |
outputs = model.generate(**inputs, max_new_tokens=100)
|
| 51 |
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 49 |
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
|
| 50 |
outputs = model.generate(**inputs, max_new_tokens=100)
|
| 51 |
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
| 52 |
+
```
|
| 53 |
+
|
| 54 |
+
## 馃搳 Training
|
| 55 |
+
|
| 56 |
+
- **Epochs:** 3
|
| 57 |
+
- **Batch Size:** 8
|
| 58 |
+
- **Learning Rate:** 2e-5
|
| 59 |
+
- **Precision:** bf16
|
| 60 |
+
- **Training Framework:** 馃 `transformers` + `peft`
|
| 61 |
+
- **Compute:** Google Colab T4 GPU
|
| 62 |
+
|
| 63 |
+
## 馃搧 Files
|
| 64 |
+
|
| 65 |
+
- `adapter_config.json`: Configuration of LoRA adapter.
|
| 66 |
+
- `adapter_model.safetensors`: The trained adapter weights.
|
| 67 |
+
- `README.md`: This file.
|
| 68 |
+
|
| 69 |
+
## 馃洃 Limitations
|
| 70 |
+
|
| 71 |
+
- **Domain-Specific**: Works best on agri-related questions. Not suited for general conversation.
|
| 72 |
+
- **Small Dataset**: Initial training was done on a subset (~5k samples). Accuracy may improve with full dataset.
|
| 73 |
+
- **Not Merged**: Requires base model for usage.
|
| 74 |
+
|
| 75 |
+
## 馃摎 Citation
|
| 76 |
+
|
| 77 |
+
```bibtex
|
| 78 |
+
@misc{nithyanandam2024agriqa,
|
| 79 |
+
title={AgriQA TinyLlama LoRA Adapter},
|
| 80 |
+
author={Nithyanandam Venu},
|
| 81 |
+
year={2024},
|
| 82 |
+
howpublished={\url{https://huggingface.co/theone049/agriqa-tinyllama-lora-adapter}}
|
| 83 |
+
}
|
| 84 |
+
```
|
| 85 |
+
|
| 86 |
+
## 鉁夛笍 Contact
|
| 87 |
+
|
| 88 |
+
For questions or collaborations: [nithyanandam.venu@gmail.com](mailto:nithyanandam.venu@gmail.com)
|
| 89 |
+
|
| 90 |
+
---
|
| 91 |
+
|
| 92 |
+
*This is part of an experimental project to improve AI Q&A for agriculture. Not for medical or pesticide advice.*
|