Hugging Face's logo

mudler
/
LocalAI-Llama3-8b-Function-Call-v0.2

Text Generation
Transformers
Safetensors
llama
LocalAI
conversational
text-generation-inference
Model card Files
xet
Community
2
mudler commited on
Commit
34a5ee4
·
verified ·
1 Parent(s): 65a7dd4

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -9,6 +9,9 @@ tags:
9
 
10
  ![LocalAIFCALL](https://cdn-uploads.huggingface.co/production/uploads/647374aa7ff32a81ac6d35d4/us5JKi9z046p8K-cn_M0w.webp)
11
 
 
 
 
12
  This model is a fine-tune on a custom dataset + glaive to work specifically and leverage all the [LocalAI](https://localai.io) features of constrained grammar.
13
 
14
  Specifically, the model once enters in tools mode will always reply with JSON.
 
9
 
10
  ![LocalAIFCALL](https://cdn-uploads.huggingface.co/production/uploads/647374aa7ff32a81ac6d35d4/us5JKi9z046p8K-cn_M0w.webp)
11
 
12
+ OpenVINO: https://huggingface.co/fakezeta/LocalAI-Llama3-8b-Function-Call-v0.2-ov-int8
13
+ GGUF: https://huggingface.co/mudler/LocalAI-Llama3-8b-Function-Call-v0.2-GGUF
14
+
15
  This model is a fine-tune on a custom dataset + glaive to work specifically and leverage all the [LocalAI](https://localai.io) features of constrained grammar.
16
 
17
  Specifically, the model once enters in tools mode will always reply with JSON.