Spaces:
Running
Running
Add the evaluation notebook
Browse files- README.md +7 -1
- notebooks/evaluation.ipynb +0 -0
- setup.py +1 -0
README.md
CHANGED
|
@@ -18,7 +18,7 @@ app_port: 8000
|
|
| 18 |
|
| 19 |
`git push hub` to deploy to huggingface hub, after adding a remote
|
| 20 |
|
| 21 |
-
Multi-stage build brings down the size from 9GB+ to around 7GB.
|
| 22 |
Less not possible most likely, due to the size of torch and models.
|
| 23 |
|
| 24 |
Reported token classification F1 scores on commas for different languages, on a political speeches' dataset:
|
|
@@ -27,3 +27,9 @@ Reported token classification F1 scores on commas for different languages, on a
|
|
| 27 |
|---------|--------|--------|---------|
|
| 28 |
| 0.819 | 0.945 | 0.831 | 0.798 |
|
| 29 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 18 |
|
| 19 |
`git push hub` to deploy to huggingface hub, after adding a remote
|
| 20 |
|
| 21 |
+
Multi-stage build brings down the size from 9GB+ to around 7GB.
|
| 22 |
Less not possible most likely, due to the size of torch and models.
|
| 23 |
|
| 24 |
Reported token classification F1 scores on commas for different languages, on a political speeches' dataset:
|
|
|
|
| 27 |
|---------|--------|--------|---------|
|
| 28 |
| 0.819 | 0.945 | 0.831 | 0.798 |
|
| 29 |
|
| 30 |
+
Evaluation of the baseline model on the wikitext-103-raw-v1 validation dataset:
|
| 31 |
+
|
| 32 |
+
| precision | recall | F1 | support |
|
| 33 |
+
|-----------|--------|------|---------|
|
| 34 |
+
| 0.79 | 0.71 | 0.75 | 10079 |
|
| 35 |
+
|
notebooks/evaluation.ipynb
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|
setup.py
CHANGED
|
@@ -21,6 +21,7 @@ setup(
|
|
| 21 |
extras_require={
|
| 22 |
'training': [
|
| 23 |
'datasets==2.14.4',
|
|
|
|
| 24 |
'notebook'
|
| 25 |
],
|
| 26 |
'test': [
|
|
|
|
| 21 |
extras_require={
|
| 22 |
'training': [
|
| 23 |
'datasets==2.14.4',
|
| 24 |
+
'seqeval'
|
| 25 |
'notebook'
|
| 26 |
],
|
| 27 |
'test': [
|