FunctionGemma-270M-Healthcare : GGUF

This model was finetuned and converted to GGUF format using Unsloth.

Example usage:

For text only LLMs: ./llama.cpp/llama-cli -hf rizkysulaeman/FunctionGemma-270M-Healthcare --jinja
For multimodal models: ./llama.cpp/llama-mtmd-cli -hf rizkysulaeman/FunctionGemma-270M-Healthcare --jinja

Available Model files:

The model's BOS token behavior was adjusted for GGUF compatibility. This was trained 2x faster with Unsloth

Safetensors

Model size

0.3B params

Tensor type

BF16

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Quantizations