Instructions to use bertin-project/bertin-base-stepwise with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bertin-project/bertin-base-stepwise with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="bertin-project/bertin-base-stepwise")# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("bertin-project/bertin-base-stepwise") model = AutoModelForMaskedLM.from_pretrained("bertin-project/bertin-base-stepwise", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Step... (207000/250000 | Loss: 1.7318421602249146, Acc: 0.651650071144104): 83%|███████████████████▏ | 207980/250000 [13:49:59<19:31:21, 1.67s/it]
Browse files- flax_model.msgpack +1 -1
- outputs/checkpoints/checkpoint-200000/training_state.json +0 -1
- outputs/checkpoints/checkpoint-201000/training_state.json +0 -1
- outputs/checkpoints/checkpoint-202000/training_state.json +0 -1
- outputs/checkpoints/{checkpoint-200000 → checkpoint-205000}/config.json +0 -0
- outputs/checkpoints/{checkpoint-200000 → checkpoint-205000}/data_collator.joblib +0 -0
- outputs/checkpoints/{checkpoint-200000 → checkpoint-205000}/flax_model.msgpack +1 -1
- outputs/checkpoints/{checkpoint-202000 → checkpoint-205000}/optimizer_state.msgpack +1 -1
- outputs/checkpoints/{checkpoint-200000 → checkpoint-205000}/training_args.joblib +0 -0
- outputs/checkpoints/checkpoint-205000/training_state.json +1 -0
- outputs/checkpoints/{checkpoint-201000 → checkpoint-206000}/config.json +0 -0
- outputs/checkpoints/{checkpoint-201000 → checkpoint-206000}/data_collator.joblib +0 -0
- outputs/checkpoints/{checkpoint-202000 → checkpoint-206000}/flax_model.msgpack +1 -1
- outputs/checkpoints/{checkpoint-200000 → checkpoint-206000}/optimizer_state.msgpack +1 -1
- outputs/checkpoints/{checkpoint-201000 → checkpoint-206000}/training_args.joblib +0 -0
- outputs/checkpoints/checkpoint-206000/training_state.json +1 -0
- outputs/checkpoints/{checkpoint-202000 → checkpoint-207000}/config.json +0 -0
- outputs/checkpoints/{checkpoint-202000 → checkpoint-207000}/data_collator.joblib +0 -0
- outputs/checkpoints/{checkpoint-201000 → checkpoint-207000}/flax_model.msgpack +1 -1
- outputs/checkpoints/{checkpoint-201000 → checkpoint-207000}/optimizer_state.msgpack +1 -1
- outputs/checkpoints/{checkpoint-202000 → checkpoint-207000}/training_args.joblib +0 -0
- outputs/checkpoints/checkpoint-207000/training_state.json +1 -0
- outputs/events.out.tfevents.1627128247.tablespoon.2330108.3.v2 +2 -2
- outputs/flax_model.msgpack +1 -1
- outputs/optimizer_state.msgpack +1 -1
- outputs/training_state.json +1 -1
- pytorch_model.bin +1 -1
flax_model.msgpack
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 249750019
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3bf231fe919354012cfcf697a3e170465afb5ca40b7458cf1482032e833acfbb
|
| 3 |
size 249750019
|
outputs/checkpoints/checkpoint-200000/training_state.json
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
{"step": 200001}
|
|
|
|
|
|
outputs/checkpoints/checkpoint-201000/training_state.json
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
{"step": 201001}
|
|
|
|
|
|
outputs/checkpoints/checkpoint-202000/training_state.json
DELETED
|
@@ -1 +0,0 @@
|
|
| 1 |
-
{"step": 202001}
|
|
|
|
|
|
outputs/checkpoints/{checkpoint-200000 → checkpoint-205000}/config.json
RENAMED
|
File without changes
|
outputs/checkpoints/{checkpoint-200000 → checkpoint-205000}/data_collator.joblib
RENAMED
|
File without changes
|
outputs/checkpoints/{checkpoint-200000 → checkpoint-205000}/flax_model.msgpack
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 249750019
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c44a03a54aca66db3dd06919d9e55f6de5951d9342a4de61e9bfbf7ec287c177
|
| 3 |
size 249750019
|
outputs/checkpoints/{checkpoint-202000 → checkpoint-205000}/optimizer_state.msgpack
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 499500278
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:325d0a91767626ac3aac2bea19590b5242cb007bc1d14ac5affc1caf8c7a24e9
|
| 3 |
size 499500278
|
outputs/checkpoints/{checkpoint-200000 → checkpoint-205000}/training_args.joblib
RENAMED
|
File without changes
|
outputs/checkpoints/checkpoint-205000/training_state.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"step": 205001}
|
outputs/checkpoints/{checkpoint-201000 → checkpoint-206000}/config.json
RENAMED
|
File without changes
|
outputs/checkpoints/{checkpoint-201000 → checkpoint-206000}/data_collator.joblib
RENAMED
|
File without changes
|
outputs/checkpoints/{checkpoint-202000 → checkpoint-206000}/flax_model.msgpack
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 249750019
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:09cc212104e94db91f421bd63917a75a14b355abe08e3bd0a9da322a65a30540
|
| 3 |
size 249750019
|
outputs/checkpoints/{checkpoint-200000 → checkpoint-206000}/optimizer_state.msgpack
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 499500278
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d42d7fe5e59fb9ab2990334f39584dda2e0c9dc18e770215332b77081e2e5677
|
| 3 |
size 499500278
|
outputs/checkpoints/{checkpoint-201000 → checkpoint-206000}/training_args.joblib
RENAMED
|
File without changes
|
outputs/checkpoints/checkpoint-206000/training_state.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"step": 206001}
|
outputs/checkpoints/{checkpoint-202000 → checkpoint-207000}/config.json
RENAMED
|
File without changes
|
outputs/checkpoints/{checkpoint-202000 → checkpoint-207000}/data_collator.joblib
RENAMED
|
File without changes
|
outputs/checkpoints/{checkpoint-201000 → checkpoint-207000}/flax_model.msgpack
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 249750019
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3bf231fe919354012cfcf697a3e170465afb5ca40b7458cf1482032e833acfbb
|
| 3 |
size 249750019
|
outputs/checkpoints/{checkpoint-201000 → checkpoint-207000}/optimizer_state.msgpack
RENAMED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 499500278
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:820bbb9ed1ec4d6551f127f06369ae73f4b028b10a2baabefe35d2bca2edb457
|
| 3 |
size 499500278
|
outputs/checkpoints/{checkpoint-202000 → checkpoint-207000}/training_args.joblib
RENAMED
|
File without changes
|
outputs/checkpoints/checkpoint-207000/training_state.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"step": 207001}
|
outputs/events.out.tfevents.1627128247.tablespoon.2330108.3.v2
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c8f4da9026f0e225d3324cbd15ba78c2d234bd5e4ddf2ac45884f9eff41e3207
|
| 3 |
+
size 3955942
|
outputs/flax_model.msgpack
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 249750019
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3bf231fe919354012cfcf697a3e170465afb5ca40b7458cf1482032e833acfbb
|
| 3 |
size 249750019
|
outputs/optimizer_state.msgpack
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 499500278
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:820bbb9ed1ec4d6551f127f06369ae73f4b028b10a2baabefe35d2bca2edb457
|
| 3 |
size 499500278
|
outputs/training_state.json
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
{"step":
|
|
|
|
| 1 |
+
{"step": 207001}
|
pytorch_model.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 498858859
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:26279bac4a1947edca45479ccbd2f63cf30f37940e67bb8c22c620b0bfd2d415
|
| 3 |
size 498858859
|