Update README.md
Browse files
README.md
CHANGED
|
@@ -8,24 +8,10 @@ tags:
|
|
| 8 |
- llama
|
| 9 |
- causal-lm
|
| 10 |
- 270m
|
| 11 |
-
- research
|
| 12 |
---
|
| 13 |
|
| 14 |
# HOS-OSS-270M
|
| 15 |
|
| 16 |
-
Custom 270M
|
| 17 |
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
- Architecture: LLaMA-style Transformer
|
| 21 |
-
- Parameters: 270M
|
| 22 |
-
- Vocabulary: 32k
|
| 23 |
-
- Context length: 1024
|
| 24 |
-
|
| 25 |
-
## Hosted / Supported by
|
| 26 |
-
|
| 27 |
-
This model is hosted on Hugging Face Hub and maintained by **hydffgg**.
|
| 28 |
-
|
| 29 |
-
## Disclaimer
|
| 30 |
-
|
| 31 |
-
This model is randomly initialized and intended for research purposes only.
|
|
|
|
| 8 |
- llama
|
| 9 |
- causal-lm
|
| 10 |
- 270m
|
|
|
|
| 11 |
---
|
| 12 |
|
| 13 |
# HOS-OSS-270M
|
| 14 |
|
| 15 |
+
Custom 270M LLaMA-style model.
|
| 16 |
|
| 17 |
+
⚠ Random initialized.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|