Update README.md
Browse files
README.md
CHANGED
|
@@ -14,6 +14,6 @@ pipeline_tag: text-generation
|
|
| 14 |
|
| 15 |
# DISCLAIMER: Ok, a 310M model has been trained in a test in only 200 steps, on a mini dataset of 40,960 tokens the model is not competent, it is only a test and is compatible with Transformers
|
| 16 |
|
| 17 |
-
If you want to try how to use it here is a file of how to use it in [test_gen.py](https://github.com/F4k3r22/LLaDA-from-scratch/blob/main/test_gen.py)
|
| 18 |
|
| 19 |
### For those who want to train and get the correct format to be able to load it with `transformers`, everything needed is in [`pre_train.py`](https://github.com/F4k3r22/LLaDA-from-scratch/blob/main/pre_train.py) of the project repo
|
|
|
|
| 14 |
|
| 15 |
# DISCLAIMER: Ok, a 310M model has been trained in a test in only 200 steps, on a mini dataset of 40,960 tokens the model is not competent, it is only a test and is compatible with Transformers
|
| 16 |
|
| 17 |
+
If you want to try how to use it here is a file of how to use it in [test_gen.py](https://github.com/F4k3r22/LLaDA-from-scratch/blob/main/test_gen.py) Or using this Google [Colab](https://colab.research.google.com/drive/1jPIPu9qHEFMkANzUEkeOxUW6hS3DeVwd?usp=sharing) notebook
|
| 18 |
|
| 19 |
### For those who want to train and get the correct format to be able to load it with `transformers`, everything needed is in [`pre_train.py`](https://github.com/F4k3r22/LLaDA-from-scratch/blob/main/pre_train.py) of the project repo
|