Update README.md
Browse files
README.md
CHANGED
|
@@ -12,16 +12,6 @@ language:
|
|
| 12 |
- Try them out at [ICGPT](https://icgpt.icpp.world/)
|
| 13 |
- The models were created with the training procedure outlined in [karpathy/llama2.c](https://github.com/karpathy/llama2.c) and then converted into *.gguf format as described below.
|
| 14 |
|
| 15 |
-
## TinyStories models
|
| 16 |
-
|
| 17 |
-
| model | notes |
|
| 18 |
-
|-------|-------|
|
| 19 |
-
| stories260Ktok512.guff | Use this for development & debugging |
|
| 20 |
-
| stories15Mtok4096.guff | Fits in canister & works well ! |
|
| 21 |
-
| stories42Mtok4096.guff | As of April 28, hits instruction limit of canister |
|
| 22 |
-
| stories42Mtok32000.guff | As of April 28, hits instruction limit of canister |
|
| 23 |
-
| stories110Mtok32000.guff | As of April 28, hits instruction limit of canister |
|
| 24 |
-
|
| 25 |
|
| 26 |
## Setup local git with lfs
|
| 27 |
|
|
@@ -77,10 +67,7 @@ convert-llama2c-to-ggml --llama2c-model stories110Mtok32000.bin --copy-vocab-fro
|
|
| 77 |
convert-llama2c-to-ggml --llama2c-model stories42Mtok32000.bin --copy-vocab-from-model models/ggml-vocab-llama.gguf --llama2c-output-model stories42Mtok32000.gguf
|
| 78 |
|
| 79 |
# Run it local, like this
|
| 80 |
-
|
| 81 |
-
|
| 82 |
-
# Quantization
|
| 83 |
-
# TODO
|
| 84 |
```
|
| 85 |
|
| 86 |
|
|
|
|
| 12 |
- Try them out at [ICGPT](https://icgpt.icpp.world/)
|
| 13 |
- The models were created with the training procedure outlined in [karpathy/llama2.c](https://github.com/karpathy/llama2.c) and then converted into *.gguf format as described below.
|
| 14 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
|
| 16 |
## Setup local git with lfs
|
| 17 |
|
|
|
|
| 67 |
convert-llama2c-to-ggml --llama2c-model stories42Mtok32000.bin --copy-vocab-from-model models/ggml-vocab-llama.gguf --llama2c-output-model stories42Mtok32000.gguf
|
| 68 |
|
| 69 |
# Run it local, like this
|
| 70 |
+
./llama-cli -m stories15Mtok4096.gguf -p "Joe loves writing stories" -n 600 -c 128
|
|
|
|
|
|
|
|
|
|
| 71 |
```
|
| 72 |
|
| 73 |
|