Update README.md
Browse files
README.md
CHANGED
|
@@ -2,4 +2,38 @@
|
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
|
| 5 |
-
Quantization of [mzbac/llama-3-8B-Instruct-function-calling-v0.2](https://huggingface.co/mzbac/llama-3-8B-Instruct-function-calling-v0.2) info GGUF
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
license: apache-2.0
|
| 3 |
---
|
| 4 |
|
| 5 |
+
Quantization of [mzbac/llama-3-8B-Instruct-function-calling-v0.2](https://huggingface.co/mzbac/llama-3-8B-Instruct-function-calling-v0.2) info GGUF
|
| 6 |
+
|
| 7 |
+
# Llama 3 function calling
|
| 8 |
+
|
| 9 |
+
Tested within LM Studio.
|
| 10 |
+
|
| 11 |
+
|
| 12 |
+
## Request
|
| 13 |
+
```bash
|
| 14 |
+
curl --location 'http://localhost:5000/v1/chat/completions' \
|
| 15 |
+
--header 'Content-Type: application/json' \
|
| 16 |
+
--data '{
|
| 17 |
+
"model": "AABAAB/llama-3-8B-Instruct-function-calling-v0.2/llama-3-8B-Instruct-function-calling-v0.2_Q8_0.gguf",
|
| 18 |
+
"messages": [
|
| 19 |
+
{
|
| 20 |
+
"role": "system",
|
| 21 |
+
"content": "You are a helpful assistant with access to the following functions. Use them if required - {\"name\": \"search_web\",\"description\": \"Perform a web search for a given search terms.\",\"parameter\": {\"type\": \"object\", \"properties\": {\"search_terms\": {\"type\": \"array\",\"items\": {\"type\": \"string\"},\"description\": \"The search queries for which the search is performed.\",\"required\": True,}}},}"
|
| 22 |
+
},
|
| 23 |
+
{
|
| 24 |
+
"role": "user",
|
| 25 |
+
"content": "What is the weather in Sydney?"
|
| 26 |
+
}
|
| 27 |
+
],
|
| 28 |
+
"stream": false
|
| 29 |
+
}'
|
| 30 |
+
```
|
| 31 |
+
|
| 32 |
+
## Response
|
| 33 |
+
|
| 34 |
+
```
|
| 35 |
+
<functioncall> {\"name\": \"search_web\", \"arguments\": {\"search_terms\": [\"weather in Sydney\"]}}
|
| 36 |
+
```
|
| 37 |
+
|
| 38 |
+
|
| 39 |
+
|