ministral-14b-web-agent-gguf : GGUF

This model was finetuned and converted to GGUF format using Unsloth.

Example usage:

  • For text only LLMs: ./llama.cpp/llama-cli -hf codeslord/ministral-14b-web-agent-gguf --jinja
  • For multimodal models: ./llama.cpp/llama-mtmd-cli -hf codeslord/ministral-14b-web-agent-gguf --jinja

Available Model files:

  • Ministral-3-14B-Instruct-2512.Q5_K_M.gguf
  • Ministral-3-14B-Instruct-2512.Q8_0.gguf
  • Ministral-3-14B-Instruct-2512.F16.gguf
  • Ministral-3-14B-Instruct-2512.BF16-mmproj.gguf This was trained 2x faster with Unsloth
Downloads last month
182
GGUF
Model size
14B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

5-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support