edith81/phobert_vietnamese_sentiment_analysis

🇻🇳 PhoBERT Vietnamese Sentiment Analysis (with LoRA)

This model is a fine-tuned version of VinAI/phobert-base using LoRA (Low-Rank Adaptation) for Vietnamese sentiment classification.

It is trained on a Vietnamese dataset to classify sentiments into positive, negative.

---

🧠 Model Architecture

• Base: PhoBERT (VinAI/phobert-base)
• Fine-tuning technique: LoRA via PEFT
• Task: Sequence Classification (TaskType.SEQ_CLS)

🔧 LoRA Config

LoraConfig(
    r=16,
    lora_alpha=32,
    target_modules=["query", "value"],
    lora_dropout=0.1,
    bias="none",
    task_type=TaskType.SEQ_CLS
)