jnjj commited on
Commit
9385bc0
·
verified ·
1 Parent(s): 6a31bed

Update training progress and artifacts

Browse files
Files changed (3) hide show
  1. README.md +5 -10
  2. config.json +1 -1
  3. model.safetensors +2 -2
README.md CHANGED
@@ -1,15 +1,10 @@
1
-
2
  ---
3
  license: apache-2.0
4
  library_name: transformers
5
  ---
6
- ## Model Trained Sequentially on Hugging Face Datasets
7
  **Base Model:** roneneldan/TinyStories-Instuct-1Layer-21M
8
- This model is being fine-tuned sequentially using LoRA on various datasets
9
- available on the Hugging Face Hub. The resulting model (base + adapter merged) is saved
10
- at the root of this repository as `model.safetensors`.
11
- ### Training Progress
12
- - **Datasets Processed:** 2
13
- - **Text Examples Processed:** 12536
14
- - **Tokens Processed:** 6418432
15
- - **Last Update:** 2025-05-07 13:42:21 UTC
 
 
1
  ---
2
  license: apache-2.0
3
  library_name: transformers
4
  ---
5
+ ## Model Trained Sequentially
6
  **Base Model:** roneneldan/TinyStories-Instuct-1Layer-21M
7
+ **Datasets Processed:** 4
8
+ **Texts:** 24
9
+ **Tokens:** 12288
10
+ **Last Update:** 2025-05-07 14:10:41 UTC
 
 
 
 
config.json CHANGED
@@ -25,5 +25,5 @@
25
  "torch_dtype": "float32",
26
  "transformers_version": "4.51.3",
27
  "use_cache": false,
28
- "vocab_size": 32000
29
  }
 
25
  "torch_dtype": "float32",
26
  "transformers_version": "4.51.3",
27
  "use_cache": false,
28
+ "vocab_size": 50257
29
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:51984a6d7914094b07ed7b8497372ca4e367fc15344b99f2bfe7a092f1941b4c
3
- size 51957256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:00511b47c5f0b7d9eca23523e645102710c2ddd86eeb8ccb90f248a0470c27a5
3
+ size 80000008