rasyosef commited on
Commit
5cf2f0f
·
verified ·
1 Parent(s): dc81b10

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -21
README.md CHANGED
@@ -56,27 +56,23 @@ You can use this model directly with a pipeline for masked language modeling:
56
  'sequence': 'ከሀገራቸው ከኢትዮጵያ ከወጡ ግማሽ ምዕተ ዘመናት ተቆጥሯል ።'}]
57
  ```
58
 
59
- ### Sentiment Classification
60
- The model was finetuned on the [amharic-sentiment](https://huggingface.co/datasets/rasyosef/amharic-sentiment)
61
- dataset to classify the given text as having `positive` or `negative` sentiment
62
 
63
- |Model|Size (# params)| Accuracy | Precision | Recall | F1 |
64
- | --- | ------------- | -------- | --------- | ------ | -- |
65
- |bert-medium-amharic|40.5M|0.83|0.83|0.82|0.83|
66
- |bert-small-amharic|27.8M|0.83|0.83|0.82|0.83|
67
- |bert-mini-amharic|10.7M|0.81|0.81|0.81|0.81|
68
- |**bert-tiny-amharic**|4.18M|0.79|0.79|0.79|0.79|
69
- |xlm-roberta-base|279M|0.83|0.83|0.83|0.83|
70
- |am-roberta|443M|0.82|0.83|0.82|0.82|
71
 
72
- ### Named Entity Recognition
73
- The model was finetuned on the [amharic-named-entity-recognition](https://huggingface.co/datasets/rasyosef/amharic-named-entity-recognition) dataset.
 
 
74
 
75
- |Model|Size (# params)| Precision | Recall | F1 |
76
- | --- | ------------- | --------- |------- | -- |
77
- |bert-medium-amharic|40.5M|0.64|0.73|0.68|
78
- |bert-small-amharic|27.8M|0.64|0.72|0.68|
79
- |bert-mini-amharic|10.7M|0.60|0.67|0.64|
80
- |**bert-tiny-amharic**|4.18M|0.50|0.59|0.54|
81
- |xlm-roberta-base|279M|0.69|0.79|0.73|
82
- |am-roberta|443M|0.67|0.72|0.69|
 
 
 
 
56
  'sequence': 'ከሀገራቸው ከኢትዮጵያ ከወጡ ግማሽ ምዕተ ዘመናት ተቆጥሯል ።'}]
57
  ```
58
 
59
+ # Finetuning
 
 
60
 
61
+ This model was finetuned and evaluated on the following **Amharic NLP** tasks
 
 
 
 
 
 
 
62
 
63
+ - Sentiment Classification
64
+ - Dataset: [amharic-sentiment](https://huggingface.co/datasets/rasyosef/amharic-sentiment)
65
+ - Named Entity Recognition
66
+ - Dataset: [amharic-named-entity-recognition](https://huggingface.co/datasets/rasyosef/amharic-named-entity-recognition)
67
 
68
+ ### Finetuned Model Performance
69
+ The reported F1 scores are macro averages.
70
+
71
+ |Model|Size (# params)| Perplexity|Sentiment (F1)| Named Entity Recognition (F1)|
72
+ |-----|---------------|-----------|--------------|------------------------------|
73
+ |bert-medium-amharic|40.5M|13.74|0.83|0.68|
74
+ |bert-small-amharic|27.8M|15.96|0.83|0.68|
75
+ |bert-mini-amharic|10.7M|22.42|0.81|0.64|
76
+ |**bert-tiny-amharic**|**4.18M**|**71.52**|**0.79**|**0.54**|
77
+ |xlm-roberta-base|279M||0.83|0.73|
78
+ |am-roberta|443M||0.82|0.69|