| | --- |
| | license: apache-2.0 |
| | --- |
| | |
| | # trackgpt |
| |
|
| | An LLM designed to play TrackMania using WASD. |
| |
|
| | # Dataset: leafspark/tracktext |
| |
|
| | llama.cpp train command: |
| | ``` |
| | train-text-from-scratch --layer 8 --ctx 17000 --vocab-model ../models/ggml-vocab-llama.gguf --embd 64 --head 8 --checkpoint-in chk-fsd-384x36-LATEST.gguf --checkpoint-out chk-fsd-384x36-ITERATION.gguf --model-out ggml-fsd-384x36-f32-ITERATION.gguf --train-data "wikihow.txt" -t 12 -b 8 --seed 1 --adam-iter 2560 --no-checkpointing --save-every 30 --adam-alpha 0.001 |
| | ``` |
| | # Notes |
| |
|
| | Please make sure to remove "0." and " " from your input! This is so that it can fit in the model context window. |
| |
|
| | # Prompt Format |
| |
|
| | ``` |
| | {data} |
| | {{prompt}} |
| | {action} |
| | {{response}} |
| | ``` |
