textilelabs commited on
Commit
cc7cbee
·
verified ·
1 Parent(s): 254754a

Upload 2 files

Browse files
Files changed (2) hide show
  1. README.md +18 -2
  2. ollama/Modelfile +10 -0
README.md CHANGED
@@ -94,9 +94,25 @@ llama-cli -m loom-spark-f32.gguf \
94
  -p "<tools:off>\n<user> who are you?\n<loom>" -n 128 --temp 0.85 --top-k 50
95
  ```
96
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
97
  Note: without a wrapper that executes `<lookup>` calls and splices `<result>`
98
- blocks back in, GGUF runners get the model's honest "I don't know, but here's
99
- what I'd look up" side. That is by design.
100
 
101
  ## Option C — the harness (with internet)
102
 
 
94
  -p "<tools:off>\n<user> who are you?\n<loom>" -n 128 --temp 0.85 --top-k 50
95
  ```
96
 
97
+ ## Option B2 — Ollama
98
+
99
+ The default Ollama template does NOT fit this model (it will ramble). Use the
100
+ Modelfile shipped in `ollama/`:
101
+
102
+ ```bash
103
+ ollama pull hf.co/textilelabs/Loom-Spark
104
+ ollama create loom-spark -f Modelfile # from the ollama/ folder of this repo
105
+ ollama run loom-spark "hi"
106
+ ```
107
+
108
+ That gives the offline persona: greetings, identity, honest deferrals. If a
109
+ reply ends in a `<lookup>…</lookup>` line, that's the model saying *"I'd search
110
+ for this"* — raw runners can't execute searches; for real internet answers use
111
+ the harness (Option C).
112
+
113
  Note: without a wrapper that executes `<lookup>` calls and splices `<result>`
114
+ blocks back in, GGUF/Ollama runners get the model's honest "I don't know, but
115
+ here's what I'd look up" side. That is by design.
116
 
117
  ## Option C — the harness (with internet)
118
 
ollama/Modelfile ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM hf.co/textilelabs/Loom-Spark
2
+ TEMPLATE """<tools:off>
3
+ <user> {{ .Prompt }}
4
+ <loom>"""
5
+ PARAMETER stop "<|endoftext|>"
6
+ PARAMETER stop "<user>"
7
+ PARAMETER stop "<result>"
8
+ PARAMETER temperature 0.85
9
+ PARAMETER top_k 50
10
+ PARAMETER num_predict 160