User01110 commited on
Commit
d8c4273
·
verified ·
1 Parent(s): 6a76043

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -11
README.md CHANGED
@@ -1,13 +1,19 @@
1
- ---
2
- library_name: transformers
3
- base_model: Qwen/Qwen3-0.6B
4
- tags:
5
- - qwen3
6
- - causal-lm
7
- - tiny-language-model
8
- - novelty-gated-attention
9
- - trust-remote-code
10
- ---
 
 
 
 
 
 
11
 
12
  # tinyLM-8M-exp
13
 
@@ -119,4 +125,4 @@ with torch.no_grad():
119
  print(tokenizer.decode(output[0], skip_special_tokens=True))
120
  ```
121
 
122
- This repo uses a native `Qwen3Config` plus remote model code for the math-only novelty-gated attention block.
 
1
+ ---
2
+ library_name: transformers
3
+ base_model: Qwen/Qwen3-0.6B
4
+ tags:
5
+ - qwen3
6
+ - causal-lm
7
+ - tiny-language-model
8
+ - novelty-gated-attention
9
+ - trust-remote-code
10
+ datasets:
11
+ - HuggingFaceFW/fineweb-edu
12
+ - HuggingFaceTB/smollm-corpus
13
+ - epfml/FineWeb-HQ
14
+ language:
15
+ - en
16
+ ---
17
 
18
  # tinyLM-8M-exp
19
 
 
125
  print(tokenizer.decode(output[0], skip_special_tokens=True))
126
  ```
127
 
128
+ This repo uses a native `Qwen3Config` plus remote model code for the math-only novelty-gated attention block.