Safetensors
English
qwen2
atsuki-yamaguchi commited on
Commit
671faa9
·
verified ·
1 Parent(s): 1f9433b

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +42 -0
README.md ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ datasets:
4
+ - HuggingFaceTB/smollm-corpus
5
+ language:
6
+ - en
7
+ ---
8
+
9
+ # Raw 1B Shared
10
+
11
+
12
+
13
+ ## How to Get Started with the Model
14
+ Use the code below to get started with the model.
15
+ ```python
16
+ from transformers import AutoTokenizer, AutoModelForCausalLM
17
+
18
+ model = AutoModelForCausalLM.from_pretrained(
19
+ "l2t-project/raw-1b-shared"
20
+ )
21
+ tokenizer = AutoTokenizer.from_pretrained(
22
+ "l2t-project/raw-1b-shared"
23
+ )
24
+ ```
25
+
26
+
27
+ ## Citation
28
+ ```
29
+ @article{yamaguchi2026enhancinglinguisticcompetencelanguage,
30
+ title={Enhancing Linguistic Competence of Language Models through Pre-training with Language Learning Tasks},
31
+ author={Atsuki Yamaguchi and Maggie Mi and Nikolaos Aletras},
32
+ year={2026},
33
+ eprint={2601.03448},
34
+ archivePrefix={arXiv},
35
+ primaryClass={cs.CL},
36
+ url={https://arxiv.org/abs/2601.03448},
37
+ journal={arXiv},
38
+ volume={abs/2601.03448}
39
+ }
40
+ ```
41
+
42
+