hydffgg commited on
Commit
a7b9b2f
·
verified ·
1 Parent(s): 9d2def3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -10
README.md CHANGED
@@ -1,20 +1,31 @@
1
  ---
2
- license: apache-2.0
3
  language:
4
- - vi
5
  - en
6
- base_model:
7
- - Qwen/Qwen2.5-Coder-1.5B-Instruct
 
 
 
 
 
 
8
  ---
9
 
10
  # HOS-OSS-270M
11
 
12
  Custom 270M parameter LLaMA-style model.
13
 
14
- - 28 layers
15
- - 1280 hidden size
16
- - 20 attention heads
17
- - 32k vocab
18
- - Random initialized (research purpose)
 
 
 
 
 
 
 
19
 
20
- This model is randomly initialized and not pretrained.
 
1
  ---
 
2
  language:
 
3
  - en
4
+ license: apache-2.0
5
+ library_name: transformers
6
+ pipeline_tag: text-generation
7
+ tags:
8
+ - llama
9
+ - causal-lm
10
+ - 270m
11
+ - research
12
  ---
13
 
14
  # HOS-OSS-270M
15
 
16
  Custom 270M parameter LLaMA-style model.
17
 
18
+ ## Model Details
19
+
20
+ - Architecture: LLaMA-style Transformer
21
+ - Parameters: 270M
22
+ - Vocabulary: 32k
23
+ - Context length: 1024
24
+
25
+ ## Hosted / Supported by
26
+
27
+ This model is hosted on Hugging Face Hub and maintained by **hydffgg**.
28
+
29
+ ## Disclaimer
30
 
31
+ This model is randomly initialized and intended for research purposes only.