🇻🇳 PhoBERT Vietnamese Sentiment Analysis (with LoRA)

This model is a fine-tuned version of VinAI/phobert-base using LoRA (Low-Rank Adaptation) for Vietnamese sentiment classification.

It is trained on a Vietnamese dataset to classify sentiments into positive, negative.

🧠 Model Architecture

Base: PhoBERT (VinAI/phobert-base)
Fine-tuning technique: LoRA via PEFT
Task: Sequence Classification (TaskType.SEQ_CLS)

🔧 LoRA Config

LoraConfig(
    r=16,
    lora_alpha=32,
    target_modules=["query", "value"],
    lora_dropout=0.1,
    bias="none",
    task_type=TaskType.SEQ_CLS
)

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for edith81/phobert_vietnamese_sentiment_analysis

Base model

vinai/phobert-base-v2

Finetuned

(312)

this model

Dataset used to train edith81/phobert_vietnamese_sentiment_analysis

Paper for edith81/phobert_vietnamese_sentiment_analysis

LoRA: Low-Rank Adaptation of Large Language Models

Paper • 2106.09685 • Published Jun 17, 2021 • 61