Instructions to use Lakshmi12/tiny-chatbot-dpo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Lakshmi12/tiny-chatbot-dpo with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("TinyLlama/TinyLlama-1.1B-Chat-v1.0") model = PeftModel.from_pretrained(base_model, "Lakshmi12/tiny-chatbot-dpo") - Notebooks
- Google Colab
- Kaggle
Training in progress, epoch 0
Browse files
adapter_model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4517152
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d35ce61b3ae69532247054d2ce94bb8b353c80ec12700a43b696ecfd166cfc3e
|
| 3 |
size 4517152
|
runs/May19_07-03-25_53d25b049a82/events.out.tfevents.1716102210.53d25b049a82.21267.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f3c879417c63a658f1b2bed26c75b9b81c7de1ae2ccd568e376e61347a98f70e
|
| 3 |
+
size 6919
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4984
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:57b9f051c0d11eb3631453c46b684e542cc6f59e132ffb833092b3600c54a489
|
| 3 |
size 4984
|