Ministral 3 3B Base Q4 MNN

4-bit MNN mobile export of mistralai/Ministral-3-3B-Base-2512 for MNN Chat and mnncli.

This repository contains the files required by the MNN LLM runtime at the repository root.

Files

  • config.json
  • export_args.json
  • llm_config.json
  • llm.mnn.json
  • llm.mnn
  • llm.mnn.weight
  • tokenizer.mtok

Export

  • Quantization: 4-bit
  • Block size: 64
  • Source checkpoint: mistralai/Ministral-3-3B-Base-2512
Downloads last month
3
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for shefowl/Ministral-3-3B-Base-Q4-MNN

Finetuned
(55)
this model