SAi404
/

tiny_llama

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

SAi404 commited on Oct 18, 2025

Commit

a7d29a3

·

verified ·

1 Parent(s): 1516161

Add README

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -15,4 +15,4 @@ This model was finetuned and converted to GGUF format using [Unsloth](https://gi
 - For multimodal models: **llama-mtmd-cli** **-m** model_name.gguf **--mmproj** mmproj_file.gguf
 ## Available Model files:
-- `tinyllama.Q8_0.gguf`

 - For multimodal models: **llama-mtmd-cli** **-m** model_name.gguf **--mmproj** mmproj_file.gguf
 ## Available Model files:
+- `tinyllama.Q4_K_M.gguf`