KLUE-BERT ํ•œ๊ตญ์–ด ๊ฐ์ • ๋ถ„๋ฅ˜ (6-class)

klue/bert-base๋ฅผ AI Hubใ€Œ๊ณต๊ฐํ˜• ๋Œ€ํ™”ใ€๋ฐ์ดํ„ฐ๋กœ ๋ฏธ์„ธ์กฐ์ •ํ•œ ํ•œ๊ตญ์–ด ๊ฐ์ • ๋ถ„๋ฅ˜ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.

๋ผ๋ฒจ

id ๊ฐ์ •
0 ๊ธฐ์จ
1 ์Šฌํ””
2 ๋ถ„๋…ธ
3 ๋ถˆ์•ˆ
4 ๋‹นํ™ฉ
5 ์ƒ์ฒ˜

์„ฑ๋Šฅ (๊ฒ€์ฆ ์„ธํŠธ)

  • Accuracy: 0.7375
  • F1 (macro): 0.7291

ํ•™์Šต ์ •๋ณด

  • Base: klue/bert-base
  • ๋ฐ์ดํ„ฐ: AI Hub ๊ณต๊ฐํ˜• ๋Œ€ํ™” (ํ™”์ž ๋ฐœํ™” 24,250๋ฌธ์žฅ, 8:2 ๋ถ„ํ• )
  • 3 epochs, batch 8 (grad accum 2), lr 2e-5, max_length 128, fp16, RTX 3060

์‚ฌ์šฉ๋ฒ•

import torch
from transformers import AutoTokenizer, AutoModelForSequenceClassification

REPO = "YMmim/klue-bert-emotion-6"
labels = ["๊ธฐ์จ", "์Šฌํ””", "๋ถ„๋…ธ", "๋ถˆ์•ˆ", "๋‹นํ™ฉ", "์ƒ์ฒ˜"]
tok = AutoTokenizer.from_pretrained(REPO)
model = AutoModelForSequenceClassification.from_pretrained(REPO)
model.eval()

x = tok("์‹œํ—˜ ๊ฒฐ๊ณผ๊ฐ€ ๊ฑฑ์ •๋ผ์„œ ์ž ์ด ์•ˆ ์™€.", return_tensors="pt", truncation=True, max_length=128)
with torch.no_grad():
    print(labels[int(model(**x).logits.argmax())])

ํ•œ๊ณ„

๊ฐ์ • ๋ผ๋ฒจ์ด ๋ฐœํ™” ๋‹จ์œ„๊ฐ€ ์•„๋‹ˆ๋ผ ๋Œ€ํ™” ๋‹จ์œ„๋กœ ๋ถ€์—ฌ๋œ ๋ฐ์ดํ„ฐ ํŠน์„ฑ์ƒ, ํ•œ ๋Œ€ํ™” ๋‚ด ๋ชจ๋“  ํ™”์ž ๋ฐœํ™”์— ๋™์ผ ๊ฐ์ •์ด ์ ์šฉ๋˜์–ด ์„ฑ๋Šฅ ์ƒํ•œ์— ์ œ์•ฝ์ด ์žˆ์Šต๋‹ˆ๋‹ค.

์ถœ์ฒ˜

AI Hub ใ€Œ๊ณต๊ฐํ˜• ๋Œ€ํ™”ใ€ ๋ฐ์ดํ„ฐ์…‹ ๊ธฐ๋ฐ˜. ๋น„์ƒ์—…์  ์šฉ๋„๋กœ ์‚ฌ์šฉํ•˜์„ธ์š”.

Downloads last month
16
Safetensors
Model size
0.1B params
Tensor type
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for YMmim/klue-bert-emotion-6

Base model

klue/bert-base
Finetuned
(173)
this model