YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
LocalAI-Llama3-8b-Function-Call-v0.2
This model is a fine-tune on a custom dataset + glaive to work specifically and leverage all the LocalAI features of constrained grammar.
Specifically, the model once enters in tools mode will always reply with JSON.
To run on LocalAI:
local-ai run huggingface://mudler/LocalAI-Llama3-8b-Function-Call-v0.2-GGUF/localai.yaml
If you like my work, consider up donating so can get resources for my fine-tunes!
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

