icpp commited on
Commit
cb8528a
·
verified ·
1 Parent(s): 4b89f3a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -14
README.md CHANGED
@@ -12,16 +12,6 @@ language:
12
  - Try them out at [ICGPT](https://icgpt.icpp.world/)
13
  - The models were created with the training procedure outlined in [karpathy/llama2.c](https://github.com/karpathy/llama2.c) and then converted into *.gguf format as described below.
14
 
15
- ## TinyStories models
16
-
17
- | model | notes |
18
- |-------|-------|
19
- | stories260Ktok512.guff | Use this for development & debugging |
20
- | stories15Mtok4096.guff | Fits in canister & works well ! |
21
- | stories42Mtok4096.guff | As of April 28, hits instruction limit of canister |
22
- | stories42Mtok32000.guff | As of April 28, hits instruction limit of canister |
23
- | stories110Mtok32000.guff | As of April 28, hits instruction limit of canister |
24
-
25
 
26
  ## Setup local git with lfs
27
 
@@ -77,10 +67,7 @@ convert-llama2c-to-ggml --llama2c-model stories110Mtok32000.bin --copy-vocab-fro
77
  convert-llama2c-to-ggml --llama2c-model stories42Mtok32000.bin --copy-vocab-from-model models/ggml-vocab-llama.gguf --llama2c-output-model stories42Mtok32000.gguf
78
 
79
  # Run it local, like this
80
- main -m stories15Mtok4096.gguf -p "Joe loves writing stories" -n 600 -c 128
81
-
82
- # Quantization
83
- # TODO
84
  ```
85
 
86
 
 
12
  - Try them out at [ICGPT](https://icgpt.icpp.world/)
13
  - The models were created with the training procedure outlined in [karpathy/llama2.c](https://github.com/karpathy/llama2.c) and then converted into *.gguf format as described below.
14
 
 
 
 
 
 
 
 
 
 
 
15
 
16
  ## Setup local git with lfs
17
 
 
67
  convert-llama2c-to-ggml --llama2c-model stories42Mtok32000.bin --copy-vocab-from-model models/ggml-vocab-llama.gguf --llama2c-output-model stories42Mtok32000.gguf
68
 
69
  # Run it local, like this
70
+ ./llama-cli -m stories15Mtok4096.gguf -p "Joe loves writing stories" -n 600 -c 128
 
 
 
71
  ```
72
 
73