Oya (Tiny Aya wallet agent), GGUF Q4_K_M

CohereLabs/tiny-aya-global fine-tuned with LoRA (sft-v2) for tool calling in English, Nigerian Pidgin and Yoruba, merged and quantized with llama.cpp for CPU inference. Prompt format: compact style from https://github.com/Timidan/lexsi-hack (naija_agent/prompting.py). Demo: https://huggingface.co/spaces/timidan/oya

Built with Tiny Aya by Cohere Labs (CC-BY-NC 4.0; Cohere Labs Acceptable Use Policy applies).

Downloads last month
15
GGUF
Model size
3B params
Architecture
cohere2
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for timidan/oya-tiny-aya-gguf

Quantized
(11)
this model

Collection including timidan/oya-tiny-aya-gguf