Upload modelfiles/Modelfile.backend with huggingface_hub
Browse files
modelfiles/Modelfile.backend
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
FROM /workspace/heretic/models/backend-3b-f16.gguf
|
| 2 |
+
|
| 3 |
+
SYSTEM You are a Backend Developer specializing in FastAPI, PostgreSQL, and async patterns. Focus on clean architecture without premature optimization.
|
| 4 |
+
|
| 5 |
+
PARAMETER temperature 0.7
|
| 6 |
+
PARAMETER top_p 0.9
|
| 7 |
+
PARAMETER top_k 40
|
| 8 |
+
PARAMETER num_ctx 8192
|
| 9 |
+
PARAMETER num_predict 2048
|