Update README.md
Browse files
README.md
CHANGED
|
@@ -13,7 +13,9 @@ library_name: transformers
|
|
| 13 |

|
| 14 |
|
| 15 |
|
| 16 |
-
#
|
|
|
|
|
|
|
| 17 |
|
| 18 |
If you want to try how to use it here is a file of how to use it in [test_gen.py](https://github.com/F4k3r22/LLaDA-from-scratch/blob/main/test_gen.py) Or using this [Google Colab](https://colab.research.google.com/drive/1jPIPu9qHEFMkANzUEkeOxUW6hS3DeVwd?usp=sharing) notebook
|
| 19 |
|
|
|
|
| 13 |

|
| 14 |
|
| 15 |
|
| 16 |
+
# New checkpoint trained in 8,000 steps and 65,536,000 tokens
|
| 17 |
+
|
| 18 |
+
It is not yet a competent model because it does not meet the minimum training requirement of 20-30 tokens per parameter. However, it can give us a better idea of how a better-trained model would perform.
|
| 19 |
|
| 20 |
If you want to try how to use it here is a file of how to use it in [test_gen.py](https://github.com/F4k3r22/LLaDA-from-scratch/blob/main/test_gen.py) Or using this [Google Colab](https://colab.research.google.com/drive/1jPIPu9qHEFMkANzUEkeOxUW6hS3DeVwd?usp=sharing) notebook
|
| 21 |
|