Update README.md
Browse files
README.md
CHANGED
|
@@ -5,12 +5,45 @@ base_model:
|
|
| 5 |
- KB/bert-base-swedish-cased
|
| 6 |
pipeline_tag: text-classification
|
| 7 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
# Model Card for Model ID
|
| 9 |
|
| 10 |
This model was developed as part of the [Computational SLA](https://spraakbanken.gu.se/en/projects/computational-sla) working group at Språkbanken Text.
|
| 11 |
It takes essays written in Swedish by second language learners and assigns them one of the [CEFR levels](https://en.wikipedia.org/wiki/Common_European_Framework_of_Reference_for_Languages).
|
| 12 |
Of note is that it only uses the first five levels of the scale (A1 to C1), ignoring level C2 due to both lack of training data and it measuring things differently than the other levels do.
|
| 13 |
|
|
|
|
|
|
|
| 14 |
|
| 15 |
## Model Details
|
| 16 |
|
|
@@ -31,9 +64,8 @@ Of note is that it only uses the first five levels of the scale (A1 to C1), igno
|
|
| 31 |
|
| 32 |
<!-- Provide the basic links for the model. -->
|
| 33 |
|
| 34 |
-
- **Repository:**
|
| 35 |
- **Paper:** Jingle BERT, Jingle BERT, Frozen All the Way: Freezing Layers to Identify CEFR Levels of Second Language Learners Using BERT ([link](https://aclanthology.org/2024.nlp4call-1.11/))
|
| 36 |
-
- **Demo [optional]:** [More Information Needed]
|
| 37 |
|
| 38 |
## Uses
|
| 39 |
|
|
@@ -75,7 +107,7 @@ Use the code below to get started with the model.
|
|
| 75 |
|
| 76 |
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|
| 77 |
|
| 78 |
-
|
| 79 |
|
| 80 |
### Training Procedure
|
| 81 |
|
|
@@ -90,11 +122,6 @@ Use the code below to get started with the model.
|
|
| 90 |
|
| 91 |
- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
|
| 92 |
|
| 93 |
-
#### Speeds, Sizes, Times [optional]
|
| 94 |
-
|
| 95 |
-
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
|
| 96 |
-
|
| 97 |
-
[More Information Needed]
|
| 98 |
|
| 99 |
## Evaluation
|
| 100 |
|
|
@@ -188,4 +215,6 @@ Ricardo Muñoz Sánchez ([rimusa](https://huggingface.co/rimusa))
|
|
| 188 |
|
| 189 |
## Model Card Contact
|
| 190 |
|
| 191 |
-
|
|
|
|
|
|
|
|
|
| 5 |
- KB/bert-base-swedish-cased
|
| 6 |
pipeline_tag: text-classification
|
| 7 |
---
|
| 8 |
+
|
| 9 |
+
<!--
|
| 10 |
+
TODO:
|
| 11 |
+
- Add model description
|
| 12 |
+
- Add license
|
| 13 |
+
- Add URL to the repo
|
| 14 |
+
- Clean and comment thesis repo
|
| 15 |
+
- Publish thesis repo
|
| 16 |
+
- Add _Uses_ section
|
| 17 |
+
- Edit _Direct Use_
|
| 18 |
+
- Edit _Out-of-Scope Use_
|
| 19 |
+
- Edit _Bias, Risks, and Limitations_
|
| 20 |
+
- Edit _Recommendations_
|
| 21 |
+
- Edit _How to Get Started_
|
| 22 |
+
- Edit _Training Details_
|
| 23 |
+
- Edit _Training Data_
|
| 24 |
+
- Edit _Training Procedure_
|
| 25 |
+
- Edit _Preprocessing_
|
| 26 |
+
- Edit _Training Hyperparameters_
|
| 27 |
+
- Edit _Evaluation_
|
| 28 |
+
- Edit _Testing Data, Factors & Metrics_
|
| 29 |
+
- Edit _Testing Data_
|
| 30 |
+
- Edit _Factors_
|
| 31 |
+
- Edit _Metrics_
|
| 32 |
+
- Edit _Results_
|
| 33 |
+
- Edit _Summary_
|
| 34 |
+
- Edit _Model Examination_
|
| 35 |
+
- Edit _Environmental Impact_
|
| 36 |
+
-->
|
| 37 |
+
|
| 38 |
+
|
| 39 |
# Model Card for Model ID
|
| 40 |
|
| 41 |
This model was developed as part of the [Computational SLA](https://spraakbanken.gu.se/en/projects/computational-sla) working group at Språkbanken Text.
|
| 42 |
It takes essays written in Swedish by second language learners and assigns them one of the [CEFR levels](https://en.wikipedia.org/wiki/Common_European_Framework_of_Reference_for_Languages).
|
| 43 |
Of note is that it only uses the first five levels of the scale (A1 to C1), ignoring level C2 due to both lack of training data and it measuring things differently than the other levels do.
|
| 44 |
|
| 45 |
+
Most of the information contained in this Model Card comes from [the paper that introduced the present model](https://aclanthology.org/2024.nlp4call-1.11/).
|
| 46 |
+
Feel free to check it out for more in-depth information.
|
| 47 |
|
| 48 |
## Model Details
|
| 49 |
|
|
|
|
| 64 |
|
| 65 |
<!-- Provide the basic links for the model. -->
|
| 66 |
|
| 67 |
+
- **Repository:** _coming soon_ <!-- Need to update and publish thesis repos -->
|
| 68 |
- **Paper:** Jingle BERT, Jingle BERT, Frozen All the Way: Freezing Layers to Identify CEFR Levels of Second Language Learners Using BERT ([link](https://aclanthology.org/2024.nlp4call-1.11/))
|
|
|
|
| 69 |
|
| 70 |
## Uses
|
| 71 |
|
|
|
|
| 107 |
|
| 108 |
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|
| 109 |
|
| 110 |
+
We used essays from the SweLL-Pilot
|
| 111 |
|
| 112 |
### Training Procedure
|
| 113 |
|
|
|
|
| 122 |
|
| 123 |
- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
|
| 124 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 125 |
|
| 126 |
## Evaluation
|
| 127 |
|
|
|
|
| 215 |
|
| 216 |
## Model Card Contact
|
| 217 |
|
| 218 |
+
For more information about the model or the present Model Card, you can reach out to:
|
| 219 |
+
- Ricardo Muñoz Sánchez ([mailto:ricardo.munoz.sanchez@gu.se])
|
| 220 |
+
- Elena Volodina ([mailto:elena.volodina@gu.se])
|