Update README.md
Browse files
README.md
CHANGED
|
@@ -6,7 +6,9 @@ language:
|
|
| 6 |
- en
|
| 7 |
---
|
| 8 |
the only files needed for inference is inference.py, word2idk.pkl, and lstm_Hxxx.safetensors
|
| 9 |
-
|
|
|
|
|
|
|
| 10 |
|
| 11 |
usually results in something like
|
| 12 |
|
|
|
|
| 6 |
- en
|
| 7 |
---
|
| 8 |
the only files needed for inference is inference.py, word2idk.pkl, and lstm_Hxxx.safetensors
|
| 9 |
+
|
| 10 |
+
input tokens mist be space separated, as they aren't tokenized like the training data is.
|
| 11 |
+
>python inference.py --temp 0.5 --top_k 64 --model_file lstm_H256.safetensors --start_sequence "User : what is the capital of France ? Bot : " --max_length 32
|
| 12 |
|
| 13 |
usually results in something like
|
| 14 |
|