Upload Modelfile with huggingface_hub

Modelfile

@@ -10,26 +10,22 @@
 # 2) ollama create stcoder-gemma4-12b:<quant> -f Modelfile     e.g. ollama create stcoder-gemma4-12b:q8_0 -f Modelfile
 # 3) ollama run stcoder-gemma4-12b:<quant> "Motor starts 5 seconds after the start button; stop and E-stop drop it."
 #
-# Requires Ollama 0.5 or newer.
+# Requires Ollama 0.32 or newer; verified on 0.32.5.
+#
+# No TEMPLATE line here, deliberately: Ollama uses its built-in `gemma4` renderer, which matches the chat template stored inside the GGUF
+# - the template of the tokenizer this model was trained with, so it cannot drift out of
+# sync with the weights. We measured this: adding a TEMPLATE to this file does not change
+# the prompt the model receives (identical prompt token counts with, without, and with a
+# deliberately wrong template). With llama.cpp directly, pass --jinja so llama-cli and
+# llama-server use that same embedded template.
+#
 # num_ctx 8192 matches the sequence length this model was fine-tuned at.
 # Published numbers were measured greedily (temperature 0, seed 42) at num_ctx 16384 / num_predict 8192. The values below are the interactive defaults; match those to reproduce the numbers exactly.
-# Gemma turn format, not ChatML. Do not mix the two.
-# Q8_0 crashed on a 16 GiB card in our own testing at this context size; drop to Q6_K if you hit an out-of-memory or a load failure.
+# Gemma 4 support in Ollama is recent. If `ollama create` fails on this GGUF, update Ollama before anything else.
 # Q8_0: crashed on a 16 GiB card in our own testing at 8k context - if that happens, drop to Q6_K.
 
 FROM ./gemma4_12b-tc.q8_0.gguf
 
-TEMPLATE """<start_of_turn>user
-{{ if .System }}{{ .System }}
-
-{{ end }}{{ .Prompt }}<end_of_turn>
-<start_of_turn>model
-{{ .Response }}<end_of_turn>
-"""
-
-PARAMETER stop "<end_of_turn>"
-PARAMETER stop "<start_of_turn>"
-
 PARAMETER temperature 0.2
 PARAMETER top_p 0.95
 PARAMETER top_k 20