Update README.md
Browse files
README.md
CHANGED
|
@@ -191,6 +191,13 @@ My LLMs
|
|
| 191 |
|
| 192 |
---
|
| 193 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 194 |
|
| 195 |
|
| 196 |
Welcome to ask to design your corp model over 33B or 70B or more parameters
|
|
|
|
| 191 |
|
| 192 |
---
|
| 193 |
|
| 194 |
+
# install tokenizer before run
|
| 195 |
+
---
|
| 196 |
+
- mkdir -p tokenizer
|
| 197 |
+
- wget -O tokenizer/tokenizer.json https://huggingface.co/gpt2/resolve/main/tokenizer.json
|
| 198 |
+
- wget -O tokenizer/vocab.json https://huggingface.co/gpt2/resolve/main/vocab.json
|
| 199 |
+
- wget -O tokenizer/merges.txt https://huggingface.co/gpt2/resolve/main/merges.txt
|
| 200 |
+
- wget -O tokenizer/tokenizer_config.json https://huggingface.co/gpt2/resolve/main/tokenizer_config.json
|
| 201 |
|
| 202 |
|
| 203 |
Welcome to ask to design your corp model over 33B or 70B or more parameters
|