Fredtt3 commited on
Commit
3c448df
·
verified ·
1 Parent(s): 2cb0949

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -13,7 +13,9 @@ library_name: transformers
13
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/63cb46191b705cc951e88e6c/2LZWEcQcoLIT4Fm1SHMCB.png)
14
 
15
 
16
- # DISCLAIMER: Ok, a 310M model has been trained in a test in only 200 steps, on a mini dataset of 40,960 tokens the model is not competent, it is only a test and is compatible with Transformers
 
 
17
 
18
  If you want to try how to use it here is a file of how to use it in [test_gen.py](https://github.com/F4k3r22/LLaDA-from-scratch/blob/main/test_gen.py) Or using this [Google Colab](https://colab.research.google.com/drive/1jPIPu9qHEFMkANzUEkeOxUW6hS3DeVwd?usp=sharing) notebook
19
 
 
13
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/63cb46191b705cc951e88e6c/2LZWEcQcoLIT4Fm1SHMCB.png)
14
 
15
 
16
+ # New checkpoint trained in 8,000 steps and 65,536,000 tokens
17
+
18
+ It is not yet a competent model because it does not meet the minimum training requirement of 20-30 tokens per parameter. However, it can give us a better idea of how a better-trained model would perform.
19
 
20
  If you want to try how to use it here is a file of how to use it in [test_gen.py](https://github.com/F4k3r22/LLaDA-from-scratch/blob/main/test_gen.py) Or using this [Google Colab](https://colab.research.google.com/drive/1jPIPu9qHEFMkANzUEkeOxUW6hS3DeVwd?usp=sharing) notebook
21