Instructions to use hf-internal-testing/tiny-random-MegaForTokenClassification with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use hf-internal-testing/tiny-random-MegaForTokenClassification with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="hf-internal-testing/tiny-random-MegaForTokenClassification")# Load model directly from transformers import AutoModelForTokenClassification model = AutoModelForTokenClassification.from_pretrained("hf-internal-testing/tiny-random-MegaForTokenClassification", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Commit ·
6f55801
1
Parent(s): 450d372
Update tiny models for MegaForTokenClassification
Browse files- pytorch_model.bin +1 -1
- tokenizer_config.json +1 -0
pytorch_model.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 406101
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:77d6323ddd20873ca03b6bcf962b45c1a21104328e948309f8d3b23f47c30dee
|
| 3 |
size 406101
|
tokenizer_config.json
CHANGED
|
@@ -8,6 +8,7 @@
|
|
| 8 |
"rstrip": false,
|
| 9 |
"single_word": false
|
| 10 |
},
|
|
|
|
| 11 |
"cls_token": {
|
| 12 |
"__type": "AddedToken",
|
| 13 |
"content": "<s>",
|
|
|
|
| 8 |
"rstrip": false,
|
| 9 |
"single_word": false
|
| 10 |
},
|
| 11 |
+
"clean_up_tokenization_spaces": true,
|
| 12 |
"cls_token": {
|
| 13 |
"__type": "AddedToken",
|
| 14 |
"content": "<s>",
|