IIC/socialdisner
Viewer • Updated • 7.48k • 28
How to use IIC/XLM_R_Galen-socialdisner with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("token-classification", model="IIC/XLM_R_Galen-socialdisner") # Load model directly
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained("IIC/XLM_R_Galen-socialdisner")
model = AutoModelForSequenceClassification.from_pretrained("IIC/XLM_R_Galen-socialdisner")This model is a finetuned version of XLM_R_Galen for the socialdisner dataset used in a benchmark in the paper TODO. The model has a F1 of 0.919
Please refer to the original publication for more information TODO LINK
| parameter | Value |
|---|---|
| batch size | 16 |
| learning rate | 4e-05 |
| classifier dropout | 0.1 |
| warmup ratio | 0 |
| warmup steps | 0 |
| weight decay | 0 |
| optimizer | AdamW |
| epochs | 10 |
| early stopping patience | 3 |
TODO