Improve model card: Add library_name and GitHub link (#1)
Browse files- Improve model card: Add library_name and GitHub link (ed2474bea9a9ae485714e0c0d3b8ff123a5d951e)
Co-authored-by: Niels Rogge <nielsr@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -1,5 +1,7 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
| 3 |
tags:
|
| 4 |
- transformer
|
| 5 |
- causal-lm
|
|
@@ -7,7 +9,6 @@ tags:
|
|
| 7 |
- constructive-learning
|
| 8 |
- frozen-embeddings
|
| 9 |
- bvv
|
| 10 |
-
pipeline_tag: text-generation
|
| 11 |
---
|
| 12 |
|
| 13 |
# Model Card for abs-bvv-2
|
|
@@ -25,6 +26,8 @@ The core idea is to demonstrate an alternative, more modular and resource-effici
|
|
| 25 |
|
| 26 |
`abs-bvv-2` represents the state of the model after 2 layers of progressive training. It has 2 Transformer blocks, a hidden dimension of 4096, and uses the `bvv241` tokenizer family.
|
| 27 |
|
|
|
|
|
|
|
| 28 |
## Intended Use
|
| 29 |
|
| 30 |
This model is primarily an artifact for research into emergent capabilities, constructive learning, and the role of embeddings in LLMs. It can be used for text generation, but it is not fine-tuned for specific downstream tasks and may produce unpredictable outputs. It is suitable for exploring the raw capabilities of a model trained under this novel paradigm.
|
|
@@ -103,4 +106,5 @@ outputs = model.generate(
|
|
| 103 |
do_sample=True
|
| 104 |
)
|
| 105 |
|
| 106 |
-
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
pipeline_tag: text-generation
|
| 4 |
+
library_name: transformers
|
| 5 |
tags:
|
| 6 |
- transformer
|
| 7 |
- causal-lm
|
|
|
|
| 9 |
- constructive-learning
|
| 10 |
- frozen-embeddings
|
| 11 |
- bvv
|
|
|
|
| 12 |
---
|
| 13 |
|
| 14 |
# Model Card for abs-bvv-2
|
|
|
|
| 26 |
|
| 27 |
`abs-bvv-2` represents the state of the model after 2 layers of progressive training. It has 2 Transformer blocks, a hidden dimension of 4096, and uses the `bvv241` tokenizer family.
|
| 28 |
|
| 29 |
+
**Code:** [https://github.com/Bochkov/bvv241](https://github.com/Bochkov/bvv241)
|
| 30 |
+
|
| 31 |
## Intended Use
|
| 32 |
|
| 33 |
This model is primarily an artifact for research into emergent capabilities, constructive learning, and the role of embeddings in LLMs. It can be used for text generation, but it is not fine-tuned for specific downstream tasks and may produce unpredictable outputs. It is suitable for exploring the raw capabilities of a model trained under this novel paradigm.
|
|
|
|
| 106 |
do_sample=True
|
| 107 |
)
|
| 108 |
|
| 109 |
+
print(tokenizer.decode(outputs[0], skip_special_tokens=True))
|
| 110 |
+
```
|