johnsmith4096 commited on
Commit
aa44cc6
·
1 Parent(s): b5ac7fb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -1
README.md CHANGED
@@ -1,4 +1,4 @@
1
- LoRA for OPT-1.3b, finetuned for chat
2
 
3
  Trained on a selection of data from https://www.kaggle.com/datasets/jef1056/discord-data
4
 
@@ -9,6 +9,20 @@ Prompting format:
9
  [Person 1]:
10
  ```
11
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  Training params:
13
  ```py
14
  transformers.TrainingArguments(
 
1
+ LoRA for OPT-1.3b, finetuned for chatting. Note that this model is meant to be conversation tuned, NOT instruct tuned.
2
 
3
  Trained on a selection of data from https://www.kaggle.com/datasets/jef1056/discord-data
4
 
 
9
  [Person 1]:
10
  ```
11
 
12
+ Example chat:
13
+ ```
14
+ human: hello
15
+ bot: hi how are you?
16
+ human: good, you?
17
+ bot: I'm doing alright. How about yourself?
18
+ human: what are you doing now?
19
+ bot: just watching netflix and playing games. What about you?
20
+ human: nothing much
21
+ bot: same here
22
+ human: write me a poem
23
+ bot: ok i will do it when im not on my phone
24
+ ```
25
+
26
  Training params:
27
  ```py
28
  transformers.TrainingArguments(