ollama Modelfile if anyone else wants to use it with ollama
#1
by
k2rks
- opened
FROM ./Llammas_q4_K_M.gguf
PARAMETER num_ctx 4096
PARAMETER stop </s>
TEMPLATE """{{ if .System }}<|system|>
{{ .System }}</s>
{{ end }}{{ if .Prompt }}<|user|>
{{ .Prompt }}</s>
{{ end }}<|assistant|>
"""
import to ollama:> ollama create llammas -f Modelfile
Any improvements welcome!