Upload Modelfile_RTH-LM with huggingface_hub
Browse files- Modelfile_RTH-LM +19 -0
Modelfile_RTH-LM
ADDED
|
@@ -0,0 +1,19 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# 🦙 Ollama Modelfile for RTH-LM (Fractal TCN)
|
| 2 |
+
|
| 3 |
+
# 1. Point to the GGUF file we generated
|
| 4 |
+
FROM ./rth_lm_25b_v1.gguf
|
| 5 |
+
|
| 6 |
+
# 2. Set Parameters
|
| 7 |
+
PARAMETER temperature 0.7
|
| 8 |
+
PARAMETER top_k 40
|
| 9 |
+
PARAMETER top_p 0.9
|
| 10 |
+
|
| 11 |
+
# 3. Define the Prompt Template (Compatible with RTH-LM training)
|
| 12 |
+
TEMPLATE """
|
| 13 |
+
{{ .Prompt }}
|
| 14 |
+
"""
|
| 15 |
+
|
| 16 |
+
# 4. Deployment Note
|
| 17 |
+
# IMPORTANT: This model requires the 'ZetaGrid TCN Patch' for llama.cpp/Ollama
|
| 18 |
+
# to support the Fractal Causal Convolution architecture.
|
| 19 |
+
# See: https://huggingface.co/RthItalia/Rth-lm-25b/discussions for setup guide.
|