Sebastian Urrea commited on
Commit ·
a30310e
1
Parent(s): 6c0e796
update
Browse files
README.md
CHANGED
|
@@ -1,31 +1,18 @@
|
|
| 1 |
---
|
| 2 |
-
language:
|
| 3 |
-
|
| 4 |
-
datasets:
|
| 5 |
-
- sst-2
|
| 6 |
-
---
|
| 7 |
-
|
| 8 |
-
# DistilBERT base uncased finetuned SST-2
|
| 9 |
-
|
| 10 |
-
This model is a fine-tune checkpoint of [DistilBERT-base-uncased](https://huggingface.co/distilbert-base-uncased), fine-tuned on SST-2.
|
| 11 |
-
This model reaches an accuracy of 91.3 on the dev set (for comparison, Bert bert-base-uncased version reaches an accuracy of 92.7).
|
| 12 |
|
| 13 |
-
|
|
|
|
|
|
|
| 14 |
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
- batch_size = 32
|
| 19 |
-
- warmup = 600
|
| 20 |
-
- max_seq_length = 128
|
| 21 |
-
- num_train_epochs = 3.0
|
| 22 |
-
|
| 23 |
-
# Bias
|
| 24 |
|
| 25 |
-
|
| 26 |
|
| 27 |
-
For instance, for sentences like `This film was filmed in COUNTRY`, this binary classification model will give radically different probabilities for the positive label depending on the country (0.89 if the country is France, but 0.08 if the country is Afghanistan) when nothing in the input indicates such a strong semantic shift. In this [colab](https://colab.research.google.com/gist/ageron/fb2f64fb145b4bc7c49efc97e5f114d3/biasmap.ipynb), [Aurélien Géron](https://twitter.com/aureliengeron) made an interesting map plotting these probabilities for each country.
|
| 28 |
|
| 29 |
-
|
| 30 |
|
| 31 |
-
|
|
|
|
| 1 |
---
|
| 2 |
+
language:
|
| 3 |
+
- es
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 4 |
|
| 5 |
+
tags:
|
| 6 |
+
- twitter
|
| 7 |
+
- sentiment-analysis
|
| 8 |
|
| 9 |
+
---
|
| 10 |
+
# Sentiment Analysis in Spanish
|
| 11 |
+
## robertuito-sentiment-analysis
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 12 |
|
| 13 |
+
Repository: [https://github.com/pysentimiento/pysentimiento/](https://github.com/finiteautomata/pysentimiento/)
|
| 14 |
|
|
|
|
| 15 |
|
| 16 |
+
Model trained with TASS 2020 corpus (around ~5k tweets) of several dialects of Spanish. Base model is [RoBERTuito](https://github.com/pysentimiento/robertuito), a RoBERTa model trained in Spanish tweets.
|
| 17 |
|
| 18 |
+
Uses `POS`, `NEG`, `NEU` labels.
|