How to use from
Docker Model Runner
docker model run hf.co/Sr-Carlos/Final-model-cloud:Q4_K_M
Quick Links

Class_SFT_Fixed_Categories_M_No_Think_gemma_V3 - GGUF

This model was finetuned and converted to GGUF format using Unsloth.

Example usage:

  • For text only LLMs: llama-cli --hf repo_id/model_name -p "why is the sky blue?"
  • For multimodal models: llama-mtmd-cli -m model_name.gguf --mmproj mmproj_file.gguf

Available Model files:

  • gemma-3n-e2b-it.Q4_K_M.gguf

Ollama

An Ollama Modelfile is included for easy deployment.

Note

The model's BOS token behavior was adjusted for GGUF compatibility.

Downloads last month
17
GGUF
Model size
4B params
Architecture
gemma3n
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support