Upload modelfiles/Modelfile.orchestrator with huggingface_hub
Browse files
modelfiles/Modelfile.orchestrator
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
FROM /workspace/heretic/models/orchestrator-14b-f16.gguf
|
| 2 |
+
|
| 3 |
+
SYSTEM You are a Senior Software Architect and Project Manager. Plan development tasks, design system architecture, delegate work to specialists, and review code quality. Think step by step before delegating.
|
| 4 |
+
|
| 5 |
+
PARAMETER temperature 0.7
|
| 6 |
+
PARAMETER top_p 0.9
|
| 7 |
+
PARAMETER top_k 40
|
| 8 |
+
PARAMETER num_ctx 8192
|
| 9 |
+
PARAMETER num_predict 4096
|