CodeTed commited on
Commit
394c1d1
·
1 Parent(s): 6f76bf8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -27,6 +27,19 @@ This model was obtained by `instruction-tuning` the corresponding `ClueAI/Prompt
27
  ### Model Sources
28
  - Repository: [https://github.com/TedYeh/Chinese_spelling_Correction](https://github.com/TedYeh/Chinese_spelling_Correction)
29
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
  ## Usage
31
  ```python
32
  from transformers import AutoTokenizer, T5ForConditionalGeneration
 
27
  ### Model Sources
28
  - Repository: [https://github.com/TedYeh/Chinese_spelling_Correction](https://github.com/TedYeh/Chinese_spelling_Correction)
29
 
30
+ ### Evaluation
31
+ accuracy recall precision F1 FPR
32
+ - Chinese spelling error correction task(SIGHAN2015):
33
+
34
+ | Model | Base Model | accuracy | recall | precision | F1 | FPR |
35
+ |:--------------:|:---------------------------:|:---------:|:---------:|:---------:|:-----:|:-----:|
36
+ | GECToR | hfl/chinese-macbert-base | 71.7 | 71.6 | 71.8 | 71.7 | 28.2 |
37
+ | GECToR_large | hfl/chinese-macbert-large | 73.7 | 76.5 | 72.5 | 74.4 | 29.1 |
38
+ | T5 w/ pretrain | ClueAI/PromptCLUE-base-v1-5 | 79.2 | 69.2 | 85.8 | 76.6 | 11.1 |
39
+ | T5 w/o pretrain| ClueAI/PromptCLUE-base-v1-5 | 75.1 | 63.1 | 82.2 | 71.4 | 13.3 |
40
+ | PTCSpell | | N/A | 79.0 | 89.4 | 83.8 | N/A |
41
+ | MDCSpell | | N/A | 77.2 | 81.5 | 79.3 | N/A |
42
+
43
  ## Usage
44
  ```python
45
  from transformers import AutoTokenizer, T5ForConditionalGeneration