SOTAagi2030 commited on
Commit
af55453
·
verified ·
1 Parent(s): 8e3d2a1

Upload folder using huggingface_hub

Browse files
Files changed (6) hide show
  1. README.md +53 -0
  2. config.json +4 -0
  3. figures/fig1.png +0 -0
  4. figures/fig2.png +0 -0
  5. figures/fig3.png +0 -0
  6. pytorch_model.bin +3 -0
README.md ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: transformers
4
+ ---
5
+ # EarlyCheckpoint
6
+
7
+ <!-- markdownlint-disable first-line-h1 -->
8
+ <!-- markdownlint-disable html -->
9
+ <!-- markdownlint-disable no-duplicate-header -->
10
+
11
+ <div align="center">
12
+ <img src="figures/fig1.png" width="60%" alt="EarlyCheckpoint" />
13
+ </div>
14
+ <hr>
15
+
16
+ <div align="center" style="line-height: 1;">
17
+ <a href="LICENSE" style="margin: 2px;">
18
+ <img alt="License" src="figures/fig2.png" style="display: inline-block; vertical-align: middle;"/>
19
+ </a>
20
+ </div>
21
+
22
+ ## 1. Introduction
23
+
24
+ EarlyCheckpoint is the first saved checkpoint from our training run, captured at the very beginning of training. It serves as a baseline for comparing training progress.
25
+
26
+ <p align="center">
27
+ <img width="80%" src="figures/fig3.png">
28
+ </p>
29
+
30
+ This model represents the initial state of training and is useful for ablation studies and understanding training dynamics.
31
+
32
+ ## 2. Model Information
33
+
34
+ | Property | Value |
35
+ |---|---|
36
+ | Architecture | BERT |
37
+ | Training Step | step_100 |
38
+ | License | Apache-2.0 |
39
+
40
+ ## 3. How to Use
41
+
42
+ ```python
43
+ from transformers import AutoModel, AutoTokenizer
44
+
45
+ model = AutoModel.from_pretrained("EarlyCheckpoint-v1")
46
+ tokenizer = AutoTokenizer.from_pretrained("EarlyCheckpoint-v1")
47
+ ```
48
+
49
+ ## 4. License
50
+ This model is licensed under the [Apache-2.0 License](LICENSE).
51
+
52
+ ## 5. Contact
53
+ Open an issue on our GitHub for questions.
config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "model_type": "bert",
3
+ "architectures": ["BertModel"]
4
+ }
figures/fig1.png ADDED
figures/fig2.png ADDED
figures/fig3.png ADDED
pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:965362299a238de576a92dfdd3e32aea7a2bacc94b2c41541c8c9258b923f587
3
+ size 23