vit-ckplus-emotion / README.md
ChristopherLi's picture
Upload README.md with huggingface_hub
0391721 verified
|
Raw
History Blame Contribute Delete
1.67 kB
---
license: apache-2.0
library_name: transformers
tags:
- vision
- image-classification
- emotion-recognition
- facial-expression
- vit
- ck+
datasets:
- AlirezaF138/ckplus-dataset
metrics:
- accuracy
- f1
base_model: google/vit-base-patch16-224-in21k
pipeline_tag: image-classification
model-index:
- name: vit-ckplus-emotion
results:
- task:
type: image-classification
name: Facial Emotion Recognition
dataset:
name: CK+
type: AlirezaF138/ckplus-dataset
metrics:
- type: accuracy
value: 0.980
name: Test Accuracy
- type: f1
value: 0.965
name: Macro F1
---
# ViT Emotion Recognition (CK+)
Vision Transformer fine-tuned for **7-class facial emotion recognition** on [CK+](https://huggingface.co/datasets/AlirezaF138/ckplus-dataset).
Initialized from a FER2013-tuned ViT, then fine-tuned on CK+. Best for **clean, frontal, posed** lab faces. Prefer the FER2013 model for webcam / in-the-wild use.
## Labels
`anger`, `contempt`, `disgust`, `fear`, `happy`, `sadness`, `surprise`
## Usage
```python
from transformers import pipeline
clf = pipeline("image-classification", model="ChristopherLi/vit-ckplus-emotion")
print(clf("face.jpg"))
```
## Training
- Base: FER2013 fine-tune of `google/vit-base-patch16-224-in21k`
- 10 epochs on CK+ (stratified 80/10/10), fp16, lr `3e-5`
## Results (held-out test)
| Metric | Value |
|---|---|
| Accuracy | 98.0% |
| Macro F1 | 0.965 |
See the [project README](https://github.com/ChristopherLI2002/Emotion-Recognition-by-VIT) for caveats about CK+ generalization.