Update README.md
Browse files
README.md
CHANGED
|
@@ -16,6 +16,8 @@ tags:
|
|
| 16 |
- addition
|
| 17 |
- TinyTransformerLM
|
| 18 |
license: apache-2.0
|
|
|
|
|
|
|
| 19 |
---
|
| 20 |
|
| 21 |
# Binary-Calculator-LLM (Proof of Concept)
|
|
@@ -92,5 +94,4 @@ python3 inference_binary_calculator3.py \
|
|
| 92 |
|
| 93 |
* Inputs are **10-bit integers** (0..1023). The output can exceed 10 bits (e.g. addition overflow), so the `BOR..EOR` block is decoded with **variable bit-length**.
|
| 94 |
* The model is **tokenizer-free** in the sense that it operates directly on bits and a tiny set of structural tokens.
|
| 95 |
-
* This is a **POC**: sampling settings (`temperature`, `top_k`) can affect stability. For deterministic behavior, you can lower temperature and/or increase constraints.
|
| 96 |
-
|
|
|
|
| 16 |
- addition
|
| 17 |
- TinyTransformerLM
|
| 18 |
license: apache-2.0
|
| 19 |
+
datasets:
|
| 20 |
+
- PhysiQuanty/BINARY-CARRY-PROPAGATION
|
| 21 |
---
|
| 22 |
|
| 23 |
# Binary-Calculator-LLM (Proof of Concept)
|
|
|
|
| 94 |
|
| 95 |
* Inputs are **10-bit integers** (0..1023). The output can exceed 10 bits (e.g. addition overflow), so the `BOR..EOR` block is decoded with **variable bit-length**.
|
| 96 |
* The model is **tokenizer-free** in the sense that it operates directly on bits and a tiny set of structural tokens.
|
| 97 |
+
* This is a **POC**: sampling settings (`temperature`, `top_k`) can affect stability. For deterministic behavior, you can lower temperature and/or increase constraints.
|
|
|