metadata
library_name: transformers
datasets:
- thainq107/vi-ntc-scv
language:
- vi
metrics:
- accuracy
base_model:
- vinai/phobert-base-v2
🇻🇳 PhoBERT Vietnamese Sentiment Analysis (with LoRA)
This model is a fine-tuned version of VinAI/phobert-base using LoRA (Low-Rank Adaptation) for Vietnamese sentiment classification.
It is trained on a Vietnamese dataset to classify sentiments into positive, negative.
🧠 Model Architecture
- Base:
PhoBERT(VinAI/phobert-base) - Fine-tuning technique: LoRA via PEFT
- Task: Sequence Classification (
TaskType.SEQ_CLS)
🔧 LoRA Config
LoraConfig(
r=16,
lora_alpha=32,
target_modules=["query", "value"],
lora_dropout=0.1,
bias="none",
task_type=TaskType.SEQ_CLS
)