Update README.md
Browse files
README.md
CHANGED
|
@@ -4,4 +4,40 @@ datasets:
|
|
| 4 |
- cardiffnlp/tweet_eval
|
| 5 |
base_model:
|
| 6 |
- OuteAI/Lite-Oute-1-300M-Instruct
|
| 7 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
- cardiffnlp/tweet_eval
|
| 5 |
base_model:
|
| 6 |
- OuteAI/Lite-Oute-1-300M-Instruct
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
Дообученая модель `OuteAI/Lite-Oute-1-300M-Instruct` на задаче определения сентимента текста
|
| 10 |
+
|
| 11 |
+
Для дообучения использовался датасет `OuteAI/Lite-Oute-1-300M-Instruct` с 3 типами эмоций: положительный, нейтральный и негативный
|
| 12 |
+
|
| 13 |
+
Для дообучения использовался кастомный LoRA-адаптер с параметрами:
|
| 14 |
+
|
| 15 |
+
```json
|
| 16 |
+
config = {
|
| 17 |
+
r: 32
|
| 18 |
+
alpha: 16
|
| 19 |
+
target_submodules: ["q_proj", "k_proj", "v_proj"],
|
| 20 |
+
lr: 5e-5,
|
| 21 |
+
batch_size: 2,
|
| 22 |
+
num_epoches: 2
|
| 23 |
+
}
|
| 24 |
+
```
|
| 25 |
+
|
| 26 |
+
Итоговая модель получила значение f-score = 0.52
|
| 27 |
+
|
| 28 |
+
|
| 29 |
+

|
| 30 |
+
|
| 31 |
+
# Примеры генерации:
|
| 32 |
+
|
| 33 |
+
Текст: Chase Headley's RBI double in the 8th inning off David Price snapped a Yankees streak of 33 consecutive scoreless innings against Blue Jays
|
| 34 |
+
|
| 35 |
+
Ответ модели: neutral
|
| 36 |
+
|
| 37 |
+
Текст: QT @user In the original draft of the 7th book, Remus Lupin survived the Battle of Hogwarts. #HappyBirthdayRemusLupin
|
| 38 |
+
|
| 39 |
+
Ответ модели: positive
|
| 40 |
+
|
| 41 |
+
Текст: Amazon prime is literally a lie....I ordered a book LAST MONDAY & it still isn't here. do better @user
|
| 42 |
+
|
| 43 |
+
Ответ модели: negative
|