Update spaCy pipeline

.gitattributes

@@ -14,3 +14,7 @@
 *.pb filter=lfs diff=lfs merge=lfs -text
 *.pt filter=lfs diff=lfs merge=lfs -text
 *.pth filter=lfs diff=lfs merge=lfs -text
+*.whl filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*strings.json filter=lfs diff=lfs merge=lfs -text
+vectors filter=lfs diff=lfs merge=lfs -text

LICENSE

@@ -0,0 +1,19 @@
+Copyright 2021 ExplosionAI GmbH
+
+Permission is hereby granted, free of charge, to any person obtaining a copy of
+this software and associated documentation files (the "Software"), to deal in
+the Software without restriction, including without limitation the rights to
+use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies
+of the Software, and to permit persons to whom the Software is furnished to do
+so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

LICENSES_SOURCES

@@ -0,0 +1,36 @@
+# OntoNotes 5
+
+* Author: Ralph Weischedel, Martha Palmer, Mitchell Marcus, Eduard Hovy, Sameer Pradhan, Lance Ramshaw, Nianwen Xue, Ann Taylor, Jeff Kaufman, Michelle Franchini, Mohammed El-Bachouti, Robert Belvin, Ann Houston
+* URL: https://catalog.ldc.upenn.edu/LDC2013T19
+* License: commercial (licensed by Explosion)
+
+```
+```
+
+
+
+
+# CoreNLP Universal Dependencies Converter
+
+* Author: Stanford NLP Group
+* URL: https://nlp.stanford.edu/software/stanford-dependencies.html
+* License: Citation provided for reference, no code packaged with model
+
+```
+```
+
+
+
+
+# bert-base-chinese
+
+* Author: Hugging Face
+* URL: https://huggingface.co/bert-base-chinese
+* License: 
+
+```
+```
+
+
+
+

README.md

@@ -0,0 +1,102 @@
+---
+tags:
+- spacy
+- token-classification
+language:
+- zh
+license: MIT
+model-index:
+- name: zh_core_web_trf
+  results:
+  - tasks:
+      name: NER
+      type: token-classification
+      metrics:
+      - name: Precision
+        type: precision
+        value: 0.6744976507
+      - name: Recall
+        type: recall
+        value: 0.7414285714
+      - name: F Score
+        type: f_score
+        value: 0.7063811967
+  - tasks:
+      name: POS
+      type: token-classification
+      metrics:
+      - name: Accuracy
+        type: accuracy
+        value: 0.92444533
+  - tasks:
+      name: SENTER
+      type: token-classification
+      metrics:
+      - name: Precision
+        type: precision
+        value: 0.6917940608
+      - name: Recall
+        type: recall
+        value: 0.655402031
+      - name: F Score
+        type: f_score
+        value: 0.6731065139
+  - tasks:
+      name: UNLABELED_DEPENDENCIES
+      type: token-classification
+      metrics:
+      - name: Accuracy
+        type: accuracy
+        value: 0.7661671924
+  - tasks:
+      name: LABELED_DEPENDENCIES
+      type: token-classification
+      metrics:
+      - name: Accuracy
+        type: accuracy
+        value: 0.7661671924
+---
+### Details: https://spacy.io/models/zh#zh_core_web_trf
+
+Chinese transformer pipeline (bert-base-chinese). Components: transformer, tagger, parser, ner, attribute_ruler.
+
+| Feature | Description |
+| --- | --- |
+| **Name** | `zh_core_web_trf` |
+| **Version** | `3.1.0` |
+| **spaCy** | `>=3.1.0,<3.2.0` |
+| **Default Pipeline** | `transformer`, `tagger`, `parser`, `attribute_ruler`, `ner` |
+| **Components** | `transformer`, `tagger`, `parser`, `attribute_ruler`, `ner` |
+| **Vectors** | 0 keys, 0 unique vectors (0 dimensions) |
+| **Sources** | [OntoNotes 5](https://catalog.ldc.upenn.edu/LDC2013T19) (Ralph Weischedel, Martha Palmer, Mitchell Marcus, Eduard Hovy, Sameer Pradhan, Lance Ramshaw, Nianwen Xue, Ann Taylor, Jeff Kaufman, Michelle Franchini, Mohammed El-Bachouti, Robert Belvin, Ann Houston)<br />[CoreNLP Universal Dependencies Converter](https://nlp.stanford.edu/software/stanford-dependencies.html) (Stanford NLP Group)<br />[bert-base-chinese](https://huggingface.co/bert-base-chinese) (Hugging Face) |
+| **License** | `MIT` |
+| **Author** | [Explosion](https://explosion.ai) |
+
+### Label Scheme
+
+<details>
+
+<summary>View label scheme (99 labels for 3 components)</summary>
+
+| Component | Labels |
+| --- | --- |
+| **`tagger`** | `AD`, `AS`, `BA`, `CC`, `CD`, `CS`, `DEC`, `DEG`, `DER`, `DEV`, `DT`, `ETC`, `FW`, `IJ`, `INF`, `JJ`, `LB`, `LC`, `M`, `MSP`, `NN`, `NR`, `NT`, `OD`, `ON`, `P`, `PN`, `PU`, `SB`, `SP`, `URL`, `VA`, `VC`, `VE`, `VV`, `X` |
+| **`parser`** | `ROOT`, `acl`, `advcl:loc`, `advmod`, `advmod:dvp`, `advmod:loc`, `advmod:rcomp`, `amod`, `amod:ordmod`, `appos`, `aux:asp`, `aux:ba`, `aux:modal`, `aux:prtmod`, `auxpass`, `case`, `cc`, `ccomp`, `compound:nn`, `compound:vc`, `conj`, `cop`, `dep`, `det`, `discourse`, `dobj`, `etc`, `mark`, `mark:clf`, `name`, `neg`, `nmod`, `nmod:assmod`, `nmod:poss`, `nmod:prep`, `nmod:range`, `nmod:tmod`, `nmod:topic`, `nsubj`, `nsubj:xsubj`, `nsubjpass`, `nummod`, `parataxis:prnmod`, `punct`, `xcomp` |
+| **`ner`** | `CARDINAL`, `DATE`, `EVENT`, `FAC`, `GPE`, `LANGUAGE`, `LAW`, `LOC`, `MONEY`, `NORP`, `ORDINAL`, `ORG`, `PERCENT`, `PERSON`, `PRODUCT`, `QUANTITY`, `TIME`, `WORK_OF_ART` |
+
+</details>
+
+### Accuracy
+
+| Type | Score |
+| --- | --- |
+| `TOKEN_ACC` | 97.88 |
+| `TAG_ACC` | 92.44 |
+| `DEP_UAS` | 76.62 |
+| `DEP_LAS` | 72.80 |
+| `ENTS_P` | 67.45 |
+| `ENTS_R` | 74.14 |
+| `ENTS_F` | 70.64 |
+| `SENTS_P` | 69.18 |
+| `SENTS_R` | 65.54 |
+| `SENTS_F` | 67.31 |

accuracy.json

@@ -0,0 +1,332 @@
+{
+  "token_acc": 0.9788303388,
+  "tag_acc": 0.92444533,
+  "dep_uas": 0.7661671924,
+  "dep_las": 0.727981345,
+  "ents_p": 0.6744976507,
+  "ents_r": 0.7414285714,
+  "ents_f": 0.7063811967,
+  "sents_p": 0.6917940608,
+  "sents_r": 0.655402031,
+  "sents_f": 0.6731065139,
+  "speed": 4304.7686585922,
+  "dep_las_per_type": {
+    "dep": {
+      "p": 0.5611908839,
+      "r": 0.4304334647,
+      "f": 0.4871912168
+    },
+    "case": {
+      "p": 0.9069435432,
+      "r": 0.8472356935,
+      "f": 0.8760734658
+    },
+    "nmod:tmod": {
+      "p": 0.8046448087,
+      "r": 0.8013605442,
+      "f": 0.8029993183
+    },
+    "nummod": {
+      "p": 0.9012345679,
+      "r": 0.583610926,
+      "f": 0.7084512738
+    },
+    "mark:clf": {
+      "p": 0.9517326733,
+      "r": 0.5736665423,
+      "f": 0.7158482662
+    },
+    "auxpass": {
+      "p": 0.9293478261,
+      "r": 0.9243243243,
+      "f": 0.9268292683
+    },
+    "nsubj": {
+      "p": 0.8733342307,
+      "r": 0.7969536912,
+      "f": 0.8333975594
+    },
+    "acl": {
+      "p": 0.8216805645,
+      "r": 0.7104825291,
+      "f": 0.762046401
+    },
+    "advmod": {
+      "p": 0.8829383266,
+      "r": 0.7643391521,
+      "f": 0.819369342
+    },
+    "mark": {
+      "p": 0.865225391,
+      "r": 0.82427695,
+      "f": 0.8442549372
+    },
+    "xcomp": {
+      "p": 0.8221343874,
+      "r": 0.67752443,
+      "f": 0.7428571429
+    },
+    "nmod:assmod": {
+      "p": 0.8709787817,
+      "r": 0.7920946156,
+      "f": 0.8296658517
+    },
+    "det": {
+      "p": 0.9033306255,
+      "r": 0.6514352665,
+      "f": 0.7569775357
+    },
+    "amod": {
+      "p": 0.8509749304,
+      "r": 0.7199528672,
+      "f": 0.78
+    },
+    "nmod:prep": {
+      "p": 0.8192449048,
+      "r": 0.7416817907,
+      "f": 0.7785362756
+    },
+    "root": {
+      "p": 0.7726093403,
+      "r": 0.6940236391,
+      "f": 0.7312110848
+    },
+    "aux:prtmod": {
+      "p": 0.9042145594,
+      "r": 0.8428571429,
+      "f": 0.8724584104
+    },
+    "compound:nn": {
+      "p": 0.8040945994,
+      "r": 0.7708967851,
+      "f": 0.7871458189
+    },
+    "dobj": {
+      "p": 0.9081300813,
+      "r": 0.8272848467,
+      "f": 0.8658243547
+    },
+    "ccomp": {
+      "p": 0.7877000842,
+      "r": 0.7270606532,
+      "f": 0.7561665993
+    },
+    "advmod:rcomp": {
+      "p": 0.8475609756,
+      "r": 0.7700831025,
+      "f": 0.8069666183
+    },
+    "nmod:topic": {
+      "p": 0.5434782609,
+      "r": 0.487012987,
+      "f": 0.5136986301
+    },
+    "cop": {
+      "p": 0.8351555929,
+      "r": 0.638996139,
+      "f": 0.7240247904
+    },
+    "discourse": {
+      "p": 0.6153846154,
+      "r": 0.5478547855,
+      "f": 0.5796595373
+    },
+    "neg": {
+      "p": 0.8932496075,
+      "r": 0.6765755054,
+      "f": 0.7699594046
+    },
+    "aux:modal": {
+      "p": 0.9019823789,
+      "r": 0.8469493278,
+      "f": 0.8736
+    },
+    "nmod": {
+      "p": 0.7988505747,
+      "r": 0.7544097693,
+      "f": 0.7759944173
+    },
+    "aux:ba": {
+      "p": 0.9265536723,
+      "r": 0.8723404255,
+      "f": 0.898630137
+    },
+    "advmod:loc": {
+      "p": 0.80859375,
+      "r": 0.6142433234,
+      "f": 0.6981450253
+    },
+    "aux:asp": {
+      "p": 0.9320882852,
+      "r": 0.8755980861,
+      "f": 0.9029605263
+    },
+    "conj": {
+      "p": 0.6313854489,
+      "r": 0.6168241966,
+      "f": 0.6240198891
+    },
+    "nsubjpass": {
+      "p": 0.8913043478,
+      "r": 0.82,
+      "f": 0.8541666667
+    },
+    "compound:vc": {
+      "p": 0.5459183673,
+      "r": 0.5544041451,
+      "f": 0.5501285347
+    },
+    "advcl:loc": {
+      "p": 0.7586206897,
+      "r": 0.6285714286,
+      "f": 0.6875
+    },
+    "cc": {
+      "p": 0.7972477064,
+      "r": 0.7710736469,
+      "f": 0.7839422643
+    },
+    "advmod:dvp": {
+      "p": 0.9076923077,
+      "r": 0.7329192547,
+      "f": 0.8109965636
+    },
+    "amod:ordmod": {
+      "p": 0.6666666667,
+      "r": 0.59375,
+      "f": 0.6280991736
+    },
+    "appos": {
+      "p": 0.9434889435,
+      "r": 0.8827586207,
+      "f": 0.9121140143
+    },
+    "nmod:poss": {
+      "p": 0.7647058824,
+      "r": 0.6740740741,
+      "f": 0.7165354331
+    },
+    "name": {
+      "p": 0.6097560976,
+      "r": 0.5555555556,
+      "f": 0.5813953488
+    },
+    "nsubj:xsubj": {
+      "p": 0.5,
+      "r": 0.1,
+      "f": 0.1666666667
+    },
+    "nmod:range": {
+      "p": 0.8295454545,
+      "r": 0.7348993289,
+      "f": 0.7793594306
+    },
+    "parataxis:prnmod": {
+      "p": 0.3663366337,
+      "r": 0.2781954887,
+      "f": 0.3162393162
+    },
+    "erased": {
+      "p": 0.0,
+      "r": 0.0,
+      "f": 0.0
+    },
+    "etc": {
+      "p": 0.9285714286,
+      "r": 0.9285714286,
+      "f": 0.9285714286
+    }
+  },
+  "ents_per_type": {
+    "DATE": {
+      "p": 0.6931530008,
+      "r": 0.8126858276,
+      "f": 0.7481751825
+    },
+    "GPE": {
+      "p": 0.792633015,
+      "r": 0.8519061584,
+      "f": 0.8212014134
+    },
+    "CARDINAL": {
+      "p": 0.5527502254,
+      "r": 0.6179435484,
+      "f": 0.5835316516
+    },
+    "ORDINAL": {
+      "p": 0.8287292818,
+      "r": 0.7894736842,
+      "f": 0.8086253369
+    },
+    "FAC": {
+      "p": 0.5301204819,
+      "r": 0.4731182796,
+      "f": 0.5
+    },
+    "ORG": {
+      "p": 0.7304479879,
+      "r": 0.7321156773,
+      "f": 0.7312808818
+    },
+    "LOC": {
+      "p": 0.1899383984,
+      "r": 0.497311828,
+      "f": 0.2748885587
+    },
+    "NORP": {
+      "p": 0.6797900262,
+      "r": 0.5441176471,
+      "f": 0.6044340723
+    },
+    "QUANTITY": {
+      "p": 0.7363636364,
+      "r": 0.6,
+      "f": 0.6612244898
+    },
+    "PERSON": {
+      "p": 0.8649842271,
+      "r": 0.8833762887,
+      "f": 0.8740835193
+    },
+    "TIME": {
+      "p": 0.711627907,
+      "r": 0.7427184466,
+      "f": 0.7268408551
+    },
+    "WORK_OF_ART": {
+      "p": 0.1849315068,
+      "r": 0.18,
+      "f": 0.1824324324
+    },
+    "MONEY": {
+      "p": 0.8682170543,
+      "r": 0.8296296296,
+      "f": 0.8484848485
+    },
+    "EVENT": {
+      "p": 0.5804195804,
+      "r": 0.6102941176,
+      "f": 0.5949820789
+    },
+    "PERCENT": {
+      "p": 0.7640449438,
+      "r": 0.8192771084,
+      "f": 0.7906976744
+    },
+    "PRODUCT": {
+      "p": 0.5384615385,
+      "r": 0.1428571429,
+      "f": 0.2258064516
+    },
+    "LAW": {
+      "p": 0.3076923077,
+      "r": 0.2666666667,
+      "f": 0.2857142857
+    },
+    "LANGUAGE": {
+      "p": 0.8181818182,
+      "r": 1.0,
+      "f": 0.9
+    }
+  }
+}

config.cfg

@@ -0,0 +1,217 @@
+[paths]
+train = "corpus/zh-core-news/train.spacy"
+dev = "corpus/zh-core-news/dev.spacy"
+vectors = null
+raw = null
+init_tok2vec = null
+vocab_data = null
+
+[system]
+gpu_allocator = "pytorch"
+seed = 1
+
+[nlp]
+lang = "zh"
+pipeline = ["transformer","tagger","parser","attribute_ruler","ner"]
+disabled = []
+before_creation = null
+after_creation = null
+after_pipeline_creation = null
+batch_size = 64
+
+[nlp.tokenizer]
+@tokenizers = "spacy.zh.ChineseTokenizer"
+segmenter = "pkuseg"
+
+[components]
+
+[components.attribute_ruler]
+factory = "attribute_ruler"
+validate = false
+
+[components.ner]
+factory = "ner"
+incorrect_spans_key = null
+moves = null
+update_with_oracle_cut_size = 100
+
+[components.ner.model]
+@architectures = "spacy.TransitionBasedParser.v2"
+state_type = "ner"
+extra_state_tokens = false
+hidden_width = 64
+maxout_pieces = 2
+use_upper = false
+nO = null
+
+[components.ner.model.tok2vec]
+@architectures = "spacy-transformers.TransformerListener.v1"
+grad_factor = 1.0
+upstream = "transformer"
+pooling = {"@layers":"reduce_mean.v1"}
+
+[components.parser]
+factory = "parser"
+learn_tokens = false
+min_action_freq = 30
+moves = null
+update_with_oracle_cut_size = 100
+
+[components.parser.model]
+@architectures = "spacy.TransitionBasedParser.v2"
+state_type = "parser"
+extra_state_tokens = false
+hidden_width = 64
+maxout_pieces = 2
+use_upper = false
+nO = null
+
+[components.parser.model.tok2vec]
+@architectures = "spacy-transformers.TransformerListener.v1"
+grad_factor = 1.0
+upstream = "transformer"
+pooling = {"@layers":"reduce_mean.v1"}
+
+[components.tagger]
+factory = "tagger"
+
+[components.tagger.model]
+@architectures = "spacy.Tagger.v1"
+nO = null
+
+[components.tagger.model.tok2vec]
+@architectures = "spacy-transformers.TransformerListener.v1"
+grad_factor = 1.0
+upstream = "transformer"
+pooling = {"@layers":"reduce_mean.v1"}
+
+[components.transformer]
+factory = "transformer"
+max_batch_items = 4096
+set_extra_annotations = {"@annotation_setters":"spacy-transformers.null_annotation_setter.v1"}
+
+[components.transformer.model]
+@architectures = "spacy-transformers.TransformerModel.v1"
+name = "bert-base-chinese"
+
+[components.transformer.model.get_spans]
+@span_getters = "spacy-transformers.strided_spans.v1"
+window = 128
+stride = 96
+
+[components.transformer.model.tokenizer_config]
+use_fast = true
+
+[corpora]
+
+[corpora.dev]
+@readers = "spacy.Corpus.v1"
+limit = 0
+max_length = 0
+path = ${paths:dev}
+gold_preproc = false
+augmenter = null
+
+[corpora.train]
+@readers = "spacy.Corpus.v1"
+path = ${paths:train}
+max_length = 500
+gold_preproc = false
+limit = 0
+augmenter = null
+
+[training]
+train_corpus = "corpora.train"
+dev_corpus = "corpora.dev"
+seed = ${system:seed}
+gpu_allocator = ${system:gpu_allocator}
+dropout = 0.1
+accumulate_gradient = 3
+patience = 5000
+max_epochs = 0
+max_steps = 20000
+eval_frequency = 1000
+frozen_components = []
+before_to_disk = null
+annotating_components = []
+
+[training.batcher]
+@batchers = "spacy.batch_by_padded.v1"
+discard_oversize = true
+get_length = null
+size = 2000
+buffer = 256
+
+[training.logger]
+@loggers = "spacy.ConsoleLogger.v1"
+progress_bar = false
+
+[training.optimizer]
+@optimizers = "Adam.v1"
+beta1 = 0.9
+beta2 = 0.999
+L2_is_weight_decay = true
+L2 = 0.01
+grad_clip = 1.0
+use_averages = true
+eps = 0.00000001
+
+[training.optimizer.learn_rate]
+@schedules = "warmup_linear.v1"
+warmup_steps = 250
+total_steps = 20000
+initial_rate = 0.00005
+
+[training.score_weights]
+tag_acc = 0.32
+dep_uas = 0.0
+dep_las = 0.32
+dep_las_per_type = null
+sents_p = null
+sents_r = null
+sents_f = 0.04
+ents_f = 0.32
+ents_p = 0.0
+ents_r = 0.0
+ents_per_type = null
+
+[pretraining]
+
+[initialize]
+vocab_data = ${paths.vocab_data}
+vectors = ${paths.vectors}
+init_tok2vec = ${paths.init_tok2vec}
+before_init = null
+after_init = null
+
+[initialize.components]
+
+[initialize.components.ner]
+
+[initialize.components.ner.labels]
+@readers = "spacy.read_labels.v1"
+path = "corpus/labels/ner.json"
+require = false
+
+[initialize.components.parser]
+
+[initialize.components.parser.labels]
+@readers = "spacy.read_labels.v1"
+path = "corpus/labels/parser.json"
+require = false
+
+[initialize.components.tagger]
+
+[initialize.components.tagger.labels]
+@readers = "spacy.read_labels.v1"
+path = "corpus/labels/tagger.json"
+require = false
+
+[initialize.lookups]
+@misc = "spacy.LookupsDataLoader.v1"
+lang = ${nlp.lang}
+tables = []
+
+[initialize.tokenizer]
+pkuseg_model = "assets/pkuseg_model"
+pkuseg_user_dict = "default"

meta.json

@@ -0,0 +1,504 @@
+{
+  "lang":"zh",
+  "name":"core_web_trf",
+  "version":"3.1.0",
+  "description":"Chinese transformer pipeline (bert-base-chinese). Components: transformer, tagger, parser, ner, attribute_ruler.",
+  "author":"Explosion",
+  "email":"contact@explosion.ai",
+  "url":"https://explosion.ai",
+  "license":"MIT",
+  "spacy_version":">=3.1.0,<3.2.0",
+  "spacy_git_version":"caba63b74",
+  "vectors":{
+    "width":0,
+    "vectors":0,
+    "keys":0,
+    "name":null
+  },
+  "labels":{
+    "transformer":[
+
+    ],
+    "tagger":[
+      "AD",
+      "AS",
+      "BA",
+      "CC",
+      "CD",
+      "CS",
+      "DEC",
+      "DEG",
+      "DER",
+      "DEV",
+      "DT",
+      "ETC",
+      "FW",
+      "IJ",
+      "INF",
+      "JJ",
+      "LB",
+      "LC",
+      "M",
+      "MSP",
+      "NN",
+      "NR",
+      "NT",
+      "OD",
+      "ON",
+      "P",
+      "PN",
+      "PU",
+      "SB",
+      "SP",
+      "URL",
+      "VA",
+      "VC",
+      "VE",
+      "VV",
+      "X"
+    ],
+    "parser":[
+      "ROOT",
+      "acl",
+      "advcl:loc",
+      "advmod",
+      "advmod:dvp",
+      "advmod:loc",
+      "advmod:rcomp",
+      "amod",
+      "amod:ordmod",
+      "appos",
+      "aux:asp",
+      "aux:ba",
+      "aux:modal",
+      "aux:prtmod",
+      "auxpass",
+      "case",
+      "cc",
+      "ccomp",
+      "compound:nn",
+      "compound:vc",
+      "conj",
+      "cop",
+      "dep",
+      "det",
+      "discourse",
+      "dobj",
+      "etc",
+      "mark",
+      "mark:clf",
+      "name",
+      "neg",
+      "nmod",
+      "nmod:assmod",
+      "nmod:poss",
+      "nmod:prep",
+      "nmod:range",
+      "nmod:tmod",
+      "nmod:topic",
+      "nsubj",
+      "nsubj:xsubj",
+      "nsubjpass",
+      "nummod",
+      "parataxis:prnmod",
+      "punct",
+      "xcomp"
+    ],
+    "attribute_ruler":[
+
+    ],
+    "ner":[
+      "CARDINAL",
+      "DATE",
+      "EVENT",
+      "FAC",
+      "GPE",
+      "LANGUAGE",
+      "LAW",
+      "LOC",
+      "MONEY",
+      "NORP",
+      "ORDINAL",
+      "ORG",
+      "PERCENT",
+      "PERSON",
+      "PRODUCT",
+      "QUANTITY",
+      "TIME",
+      "WORK_OF_ART"
+    ]
+  },
+  "pipeline":[
+    "transformer",
+    "tagger",
+    "parser",
+    "attribute_ruler",
+    "ner"
+  ],
+  "components":[
+    "transformer",
+    "tagger",
+    "parser",
+    "attribute_ruler",
+    "ner"
+  ],
+  "disabled":[
+
+  ],
+  "performance":{
+    "token_acc":0.9788303388,
+    "tag_acc":0.92444533,
+    "dep_uas":0.7661671924,
+    "dep_las":0.727981345,
+    "ents_p":0.6744976507,
+    "ents_r":0.7414285714,
+    "ents_f":0.7063811967,
+    "sents_p":0.6917940608,
+    "sents_r":0.655402031,
+    "sents_f":0.6731065139,
+    "speed":4304.7686585922,
+    "dep_las_per_type":{
+      "dep":{
+        "p":0.5611908839,
+        "r":0.4304334647,
+        "f":0.4871912168
+      },
+      "case":{
+        "p":0.9069435432,
+        "r":0.8472356935,
+        "f":0.8760734658
+      },
+      "nmod:tmod":{
+        "p":0.8046448087,
+        "r":0.8013605442,
+        "f":0.8029993183
+      },
+      "nummod":{
+        "p":0.9012345679,
+        "r":0.583610926,
+        "f":0.7084512738
+      },
+      "mark:clf":{
+        "p":0.9517326733,
+        "r":0.5736665423,
+        "f":0.7158482662
+      },
+      "auxpass":{
+        "p":0.9293478261,
+        "r":0.9243243243,
+        "f":0.9268292683
+      },
+      "nsubj":{
+        "p":0.8733342307,
+        "r":0.7969536912,
+        "f":0.8333975594
+      },
+      "acl":{
+        "p":0.8216805645,
+        "r":0.7104825291,
+        "f":0.762046401
+      },
+      "advmod":{
+        "p":0.8829383266,
+        "r":0.7643391521,
+        "f":0.819369342
+      },
+      "mark":{
+        "p":0.865225391,
+        "r":0.82427695,
+        "f":0.8442549372
+      },
+      "xcomp":{
+        "p":0.8221343874,
+        "r":0.67752443,
+        "f":0.7428571429
+      },
+      "nmod:assmod":{
+        "p":0.8709787817,
+        "r":0.7920946156,
+        "f":0.8296658517
+      },
+      "det":{
+        "p":0.9033306255,
+        "r":0.6514352665,
+        "f":0.7569775357
+      },
+      "amod":{
+        "p":0.8509749304,
+        "r":0.7199528672,
+        "f":0.78
+      },
+      "nmod:prep":{
+        "p":0.8192449048,
+        "r":0.7416817907,
+        "f":0.7785362756
+      },
+      "root":{
+        "p":0.7726093403,
+        "r":0.6940236391,
+        "f":0.7312110848
+      },
+      "aux:prtmod":{
+        "p":0.9042145594,
+        "r":0.8428571429,
+        "f":0.8724584104
+      },
+      "compound:nn":{
+        "p":0.8040945994,
+        "r":0.7708967851,
+        "f":0.7871458189
+      },
+      "dobj":{
+        "p":0.9081300813,
+        "r":0.8272848467,
+        "f":0.8658243547
+      },
+      "ccomp":{
+        "p":0.7877000842,
+        "r":0.7270606532,
+        "f":0.7561665993
+      },
+      "advmod:rcomp":{
+        "p":0.8475609756,
+        "r":0.7700831025,
+        "f":0.8069666183
+      },
+      "nmod:topic":{
+        "p":0.5434782609,
+        "r":0.487012987,
+        "f":0.5136986301
+      },
+      "cop":{
+        "p":0.8351555929,
+        "r":0.638996139,
+        "f":0.7240247904
+      },
+      "discourse":{
+        "p":0.6153846154,
+        "r":0.5478547855,
+        "f":0.5796595373
+      },
+      "neg":{
+        "p":0.8932496075,
+        "r":0.6765755054,
+        "f":0.7699594046
+      },
+      "aux:modal":{
+        "p":0.9019823789,
+        "r":0.8469493278,
+        "f":0.8736
+      },
+      "nmod":{
+        "p":0.7988505747,
+        "r":0.7544097693,
+        "f":0.7759944173
+      },
+      "aux:ba":{
+        "p":0.9265536723,
+        "r":0.8723404255,
+        "f":0.898630137
+      },
+      "advmod:loc":{
+        "p":0.80859375,
+        "r":0.6142433234,
+        "f":0.6981450253
+      },
+      "aux:asp":{
+        "p":0.9320882852,
+        "r":0.8755980861,
+        "f":0.9029605263
+      },
+      "conj":{
+        "p":0.6313854489,
+        "r":0.6168241966,
+        "f":0.6240198891
+      },
+      "nsubjpass":{
+        "p":0.8913043478,
+        "r":0.82,
+        "f":0.8541666667
+      },
+      "compound:vc":{
+        "p":0.5459183673,
+        "r":0.5544041451,
+        "f":0.5501285347
+      },
+      "advcl:loc":{
+        "p":0.7586206897,
+        "r":0.6285714286,
+        "f":0.6875
+      },
+      "cc":{
+        "p":0.7972477064,
+        "r":0.7710736469,
+        "f":0.7839422643
+      },
+      "advmod:dvp":{
+        "p":0.9076923077,
+        "r":0.7329192547,
+        "f":0.8109965636
+      },
+      "amod:ordmod":{
+        "p":0.6666666667,
+        "r":0.59375,
+        "f":0.6280991736
+      },
+      "appos":{
+        "p":0.9434889435,
+        "r":0.8827586207,
+        "f":0.9121140143
+      },
+      "nmod:poss":{
+        "p":0.7647058824,
+        "r":0.6740740741,
+        "f":0.7165354331
+      },
+      "name":{
+        "p":0.6097560976,
+        "r":0.5555555556,
+        "f":0.5813953488
+      },
+      "nsubj:xsubj":{
+        "p":0.5,
+        "r":0.1,
+        "f":0.1666666667
+      },
+      "nmod:range":{
+        "p":0.8295454545,
+        "r":0.7348993289,
+        "f":0.7793594306
+      },
+      "parataxis:prnmod":{
+        "p":0.3663366337,
+        "r":0.2781954887,
+        "f":0.3162393162
+      },
+      "erased":{
+        "p":0.0,
+        "r":0.0,
+        "f":0.0
+      },
+      "etc":{
+        "p":0.9285714286,
+        "r":0.9285714286,
+        "f":0.9285714286
+      }
+    },
+    "ents_per_type":{
+      "DATE":{
+        "p":0.6931530008,
+        "r":0.8126858276,
+        "f":0.7481751825
+      },
+      "GPE":{
+        "p":0.792633015,
+        "r":0.8519061584,
+        "f":0.8212014134
+      },
+      "CARDINAL":{
+        "p":0.5527502254,
+        "r":0.6179435484,
+        "f":0.5835316516
+      },
+      "ORDINAL":{
+        "p":0.8287292818,
+        "r":0.7894736842,
+        "f":0.8086253369
+      },
+      "FAC":{
+        "p":0.5301204819,
+        "r":0.4731182796,
+        "f":0.5
+      },
+      "ORG":{
+        "p":0.7304479879,
+        "r":0.7321156773,
+        "f":0.7312808818
+      },
+      "LOC":{
+        "p":0.1899383984,
+        "r":0.497311828,
+        "f":0.2748885587
+      },
+      "NORP":{
+        "p":0.6797900262,
+        "r":0.5441176471,
+        "f":0.6044340723
+      },
+      "QUANTITY":{
+        "p":0.7363636364,
+        "r":0.6,
+        "f":0.6612244898
+      },
+      "PERSON":{
+        "p":0.8649842271,
+        "r":0.8833762887,
+        "f":0.8740835193
+      },
+      "TIME":{
+        "p":0.711627907,
+        "r":0.7427184466,
+        "f":0.7268408551
+      },
+      "WORK_OF_ART":{
+        "p":0.1849315068,
+        "r":0.18,
+        "f":0.1824324324
+      },
+      "MONEY":{
+        "p":0.8682170543,
+        "r":0.8296296296,
+        "f":0.8484848485
+      },
+      "EVENT":{
+        "p":0.5804195804,
+        "r":0.6102941176,
+        "f":0.5949820789
+      },
+      "PERCENT":{
+        "p":0.7640449438,
+        "r":0.8192771084,
+        "f":0.7906976744
+      },
+      "PRODUCT":{
+        "p":0.5384615385,
+        "r":0.1428571429,
+        "f":0.2258064516
+      },
+      "LAW":{
+        "p":0.3076923077,
+        "r":0.2666666667,
+        "f":0.2857142857
+      },
+      "LANGUAGE":{
+        "p":0.8181818182,
+        "r":1.0,
+        "f":0.9
+      }
+    }
+  },
+  "sources":[
+    {
+      "name":"OntoNotes 5",
+      "url":"https://catalog.ldc.upenn.edu/LDC2013T19",
+      "license":"commercial (licensed by Explosion)",
+      "author":"Ralph Weischedel, Martha Palmer, Mitchell Marcus, Eduard Hovy, Sameer Pradhan, Lance Ramshaw, Nianwen Xue, Ann Taylor, Jeff Kaufman, Michelle Franchini, Mohammed El-Bachouti, Robert Belvin, Ann Houston"
+    },
+    {
+      "name":"CoreNLP Universal Dependencies Converter",
+      "url":"https://nlp.stanford.edu/software/stanford-dependencies.html",
+      "author":"Stanford NLP Group",
+      "license":"Citation provided for reference, no code packaged with model"
+    },
+    {
+      "name":"bert-base-chinese",
+      "author":"Hugging Face",
+      "url":"https://huggingface.co/bert-base-chinese",
+      "license":""
+    }
+  ],
+  "requirements":[
+    "spacy-transformers>=1.0.3,<1.1.0",
+    "spacy-pkuseg>=0.0.27,<0.1.0"
+  ]
+}

ner/cfg

@@ -0,0 +1,13 @@
+{
+  "moves":null,
+  "update_with_oracle_cut_size":100,
+  "multitasks":[
+
+  ],
+  "min_action_freq":1,
+  "learn_tokens":false,
+  "beam_width":1,
+  "beam_density":0.0,
+  "beam_update_prob":0.0,
+  "incorrect_spans_key":null
+}

ner/moves

@@ -0,0 +1 @@
+��moves��{"0":{},"1":{"GPE":15943,"ORG":15205,"DATE":14256,"PERSON":10912,"CARDINAL":7849,"TIME":2905,"NORP":2685,"EVENT":2602,"MONEY":2519,"LOC":2452,"FAC":2256,"WORK_OF_ART":2014,"QUANTITY":1717,"ORDINAL":1156,"PERCENT":852,"LAW":695,"PRODUCT":486,"LANGUAGE":336},"2":{"GPE":15943,"ORG":15205,"DATE":14256,"PERSON":10912,"CARDINAL":7849,"TIME":2905,"NORP":2685,"EVENT":2602,"MONEY":2519,"LOC":2452,"FAC":2256,"WORK_OF_ART":2014,"QUANTITY":1717,"ORDINAL":1156,"PERCENT":852,"LAW":695,"PRODUCT":486,"LANGUAGE":336},"3":{"GPE":15943,"ORG":15205,"DATE":14256,"PERSON":10912,"CARDINAL":7849,"TIME":2905,"NORP":2685,"EVENT":2602,"MONEY":2519,"LOC":2452,"FAC":2256,"WORK_OF_ART":2014,"QUANTITY":1717,"ORDINAL":1156,"PERCENT":852,"LAW":695,"PRODUCT":486,"LANGUAGE":336},"4":{"GPE":15943,"ORG":15205,"DATE":14256,"PERSON":10912,"CARDINAL":7849,"TIME":2905,"NORP":2685,"EVENT":2602,"MONEY":2519,"LOC":2452,"FAC":2256,"WORK_OF_ART":2014,"QUANTITY":1717,"ORDINAL":1156,"PERCENT":852,"LAW":695,"PRODUCT":486,"LANGUAGE":336,"":1},"5":{"":1}}�cfg��neg_key�

parser/cfg

@@ -0,0 +1,13 @@
+{
+  "moves":null,
+  "update_with_oracle_cut_size":100,
+  "multitasks":[
+
+  ],
+  "min_action_freq":30,
+  "learn_tokens":false,
+  "beam_width":1,
+  "beam_density":0.0,
+  "beam_update_prob":0.0,
+  "incorrect_spans_key":null
+}

parser/moves

@@ -0,0 +1 @@
+��moves��{"0":{"":406724},"1":{"":267280},"2":{"advmod":56948,"nsubj":53528,"compound:nn":43922,"dep":40127,"punct":36036,"case":23985,"nmod:assmod":21598,"nmod:prep":20097,"amod":16922,"acl":11976,"conj":10687,"cop":7237,"det":7209,"nummod":6994,"cc":6236,"aux:modal":5566,"nmod:tmod":5335,"nmod":4914,"neg":4364,"xcomp":3881,"appos":2954,"nmod:topic":2411,"discourse":2163,"advmod:loc":1590,"aux:prtmod":1539,"aux:ba":1311,"auxpass":1220,"advmod:dvp":1142,"advcl:loc":1046,"name":1032,"compound:vc":830,"nmod:poss":560,"amod:ordmod":511,"dobj":406,"nsubjpass":263,"nsubj:xsubj||ccomp":62,"parataxis:prnmod":34,"nsubj:xsubj":32},"3":{"punct":74030,"dobj":45389,"conj":30046,"case":30027,"dep":18664,"ccomp":17217,"mark":16601,"mark:clf":11552,"aux:asp":7896,"discourse":3998,"advmod:rcomp":2388,"nmod:range":1885,"cc":1675,"nmod:prep":1595,"advmod":1117,"etc":941,"compound:vc":790,"parataxis:prnmod":694,"advmod:loc":522,"neg":69,"advcl:loc":39,"acl":39},"4":{"ROOT":34547}}�cfg��neg_key�

tagger/cfg

@@ -0,0 +1,40 @@
+{
+  "labels":[
+    "AD",
+    "AS",
+    "BA",
+    "CC",
+    "CD",
+    "CS",
+    "DEC",
+    "DEG",
+    "DER",
+    "DEV",
+    "DT",
+    "ETC",
+    "FW",
+    "IJ",
+    "INF",
+    "JJ",
+    "LB",
+    "LC",
+    "M",
+    "MSP",
+    "NN",
+    "NR",
+    "NT",
+    "OD",
+    "ON",
+    "P",
+    "PN",
+    "PU",
+    "SB",
+    "SP",
+    "URL",
+    "VA",
+    "VC",
+    "VE",
+    "VV",
+    "X"
+  ]
+}

tokenizer/cfg

@@ -0,0 +1,3 @@
+{
+  "segmenter":"pkuseg"
+}

tokenizer/pkuseg_model/features.msgpack

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fd4322482a7018b9bce9216173ae9d2848efe6d310b468bbb4383fb55c874a18
+size 22685181

tokenizer/pkuseg_model/weights.npz

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5ada075eb25a854f71d6e6fa4e7d55e7be0ae049255b1f8f19d05c13b1b68c9e
+size 37508754

transformer/cfg

@@ -0,0 +1,3 @@
+{
+  "max_batch_items":4096
+}

transformer/model/config.json

@@ -0,0 +1,30 @@
+{
+  "_name_or_path": "/mnt/scratch/tmp/zh_core_web_trf/d999ed1d-d7a0-4c09-b6e1-c8df4f70f55c/training/core/model-best/transformer/model",
+  "architectures": [
+    "BertForMaskedLM"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "directionality": "bidi",
+  "gradient_checkpointing": false,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 768,
+  "initializer_range": 0.02,
+  "intermediate_size": 3072,
+  "layer_norm_eps": 1e-12,
+  "max_position_embeddings": 512,
+  "model_type": "bert",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 12,
+  "pad_token_id": 0,
+  "pooler_fc_size": 768,
+  "pooler_num_attention_heads": 12,
+  "pooler_num_fc_layers": 3,
+  "pooler_size_per_head": 128,
+  "pooler_type": "first_token_transform",
+  "position_embedding_type": "absolute",
+  "transformers_version": "4.6.1",
+  "type_vocab_size": 2,
+  "use_cache": true,
+  "vocab_size": 21128
+}

transformer/model/pytorch_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:88b011d7e6facc2f530831168b8e50391dc0c6fa262867559a70bc73df8c3294
+size 409149169

transformer/model/special_tokens_map.json

@@ -0,0 +1 @@
+{"unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]"}

transformer/model/tokenizer_config.json

@@ -0,0 +1 @@
+{"do_lower_case": false, "unk_token": "[UNK]", "sep_token": "[SEP]", "pad_token": "[PAD]", "cls_token": "[CLS]", "mask_token": "[MASK]", "tokenize_chinese_chars": true, "strip_accents": null, "model_max_length": 512, "special_tokens_map_file": null, "name_or_path": "/mnt/scratch/tmp/zh_core_web_trf/d999ed1d-d7a0-4c09-b6e1-c8df4f70f55c/training/core/model-best/transformer/model"}

vocab/key2row

@@ -0,0 +1 @@
+�

vocab/lookups.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:76be8b528d0075f7aae98d6fa57a6d3c83ae480a8469e668d7b0af968995ac71
+size 1

vocab/strings.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3e472d889257fe39453852761153a717a0aab7a968b8e1dbc1229acd1277cf83
+size 1216265

vocab/vectors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:14772b683e726436d5948ad3fff2b43d036ef2ebbe3458aafed6004e05a40706
+size 128

zh_core_web_trf-any-py3-none-any.whl

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e54306e18ab65a96dcd13dced77de99741ef9a8475f52d81c5f28fdea5c147eb
+size 417437795